TCP Acceleration
Encyclopedia
TCP acceleration is the name of a series of techniques for achieving better throughput on an Internet
connection than standard TCP
achieves, without modifying the end applications. It is an alternative or a supplement to TCP tuning
.
Commonly used approaches include ACK pacing, TCP transparent proxies
in two or more middlebox
es, and TCP offload engines
.
The idea of a TCP accelerator is to terminate TCP connections inside the network processor and then relay the data to a second connection toward the end system. The data packets that originate from the sender are buffered at the accelerator node, which is responsible for performing local retransmissions in the event of packet loss. Thus, in case of losses, the feedback loop between the sender and the receiver is shortened to the one between the acceleration node and the receiver which guarantees a faster delivery of data to the receiver.
Since TCP is a rate-adaptive protocol, the rate at which the TCP sender injects
packets into the network is directly proportional to the prevailing load condition within the network as well as the processing capacity of the receiver. The prevalent conditions within the network are judged by the sender on the basis of the acknowlgedgments received by it. The acceleration node splits the feedback loop between the sender and the receiver and thus guarantees a shorter round trip time (RTT) per packet. A shorter RTT is beneficial as it ensures a quicker response time to any changes in the network and a faster adaptation by the sender to combat these changes.
Disadvantages of the method include the fact that the TCP session has to be directed through the accelerator; this means that if routing changes, so that the accelerator is no longer in the path, the connection will be broken. It also destroys the end-to-end property of the TCP ack mechanism; when the ACK is received by the sender, the packet has been stored by the accelerator, not delivered to the receiver.
Asymmetric TCP acceleration implies the WAN-side protocol has to be TCP of the same 5-tuples and states. The implementations typically terminate the TCP flows on the LAN side like the TCP proxies do. On the WAN side, however, they mirror the TCP state machines and establish (forward) the TCP flows to the peers. To accelerate, they usually run a compatible version of TCP with performance improvements on the WAN side. While most of the improvements, such as FAST TCP
, Zeta-TCP
, etc., are focused on the TCP congestion avoidance algorithm
, some also attempt to promote the performance of other aspects of the protocol. For instance, Zeta-TCP
provides more accurate loss detection and heuristic download acceleration in addition to its congestion avoidance algorithm.
Compared with the symmetric TCP proxies, asymmetric TCP acceleration is more flexible in all kinds of deployment scenarios. A typical setup is to deploy the asymmetric acceleration device on the server side only. Then all the accessing clients, without having to install any extra software, will benefit from it. Performance-wise, without compression factors, asymmetric TCP acceleration is capable of offering the same level of improvement as the symmetric ones.
However, with symmetric deployment, the proxies are able to perform data compression and caching operations which further boost the performance by a factor of the compression ratio. The drawback of the compression/caching, though, is added latency and burst on the receiver side.
Internet
The Internet is a global system of interconnected computer networks that use the standard Internet protocol suite to serve billions of users worldwide...
connection than standard TCP
Transmission Control Protocol
The Transmission Control Protocol is one of the core protocols of the Internet Protocol Suite. TCP is one of the two original components of the suite, complementing the Internet Protocol , and therefore the entire suite is commonly referred to as TCP/IP...
achieves, without modifying the end applications. It is an alternative or a supplement to TCP tuning
TCP tuning
TCP tuning techniques adjust the network congestion avoidance parameters of TCP connections over high-bandwidth, high-latency networks. Well-tuned networks can perform up to 10 times faster in some cases.- Bandwidth-delay product :...
.
Commonly used approaches include ACK pacing, TCP transparent proxies
Proxy server
In computer networks, a proxy server is a server that acts as an intermediary for requests from clients seeking resources from other servers. A client connects to the proxy server, requesting some service, such as a file, connection, web page, or other resource available from a different server...
in two or more middlebox
Middlebox
A middlebox is a device in the Internet thatprovides transport policy enforcement. Examples of these devicesinclude firewalls, network address translators , signature management for intrusion detection...
es, and TCP offload engines
TCP Offload Engine
TCP offload engine or TOE is a technology used in network interface cards to offload processing of the entire TCP/IP stack to the network controller...
.
TCP transparent proxies
TCP transparent proxies involve breaking of long end-to-end control loops to several smaller control loops by intercepting and relaying TCP connections within the network. By adopting this procedure, they allow for the TCP flows to have a shorter reaction time to packet losses which may occur within the network and thus guarantees a higher throughput.The idea of a TCP accelerator is to terminate TCP connections inside the network processor and then relay the data to a second connection toward the end system. The data packets that originate from the sender are buffered at the accelerator node, which is responsible for performing local retransmissions in the event of packet loss. Thus, in case of losses, the feedback loop between the sender and the receiver is shortened to the one between the acceleration node and the receiver which guarantees a faster delivery of data to the receiver.
Since TCP is a rate-adaptive protocol, the rate at which the TCP sender injects
packets into the network is directly proportional to the prevailing load condition within the network as well as the processing capacity of the receiver. The prevalent conditions within the network are judged by the sender on the basis of the acknowlgedgments received by it. The acceleration node splits the feedback loop between the sender and the receiver and thus guarantees a shorter round trip time (RTT) per packet. A shorter RTT is beneficial as it ensures a quicker response time to any changes in the network and a faster adaptation by the sender to combat these changes.
Disadvantages of the method include the fact that the TCP session has to be directed through the accelerator; this means that if routing changes, so that the accelerator is no longer in the path, the connection will be broken. It also destroys the end-to-end property of the TCP ack mechanism; when the ACK is received by the sender, the packet has been stored by the accelerator, not delivered to the receiver.
Asymmetric TCP acceleration
While TCP proxies require such devices to be deployed at both parties of the communication because the protocol running between the proxies are usually proprietary, asymmetric TCP acceleration is able to boost the network performance with unilateral deployment, i.e., only one end of the peers is required to deploy the device or software.Asymmetric TCP acceleration implies the WAN-side protocol has to be TCP of the same 5-tuples and states. The implementations typically terminate the TCP flows on the LAN side like the TCP proxies do. On the WAN side, however, they mirror the TCP state machines and establish (forward) the TCP flows to the peers. To accelerate, they usually run a compatible version of TCP with performance improvements on the WAN side. While most of the improvements, such as FAST TCP
FAST TCP
FAST TCP is a TCP congestion avoidance algorithm especially targeted at long-distance, high latency links, developed at the , California Institute of Technology and now being commercialized by...
, Zeta-TCP
Zeta-TCP
Zeta-TCP refers to a set of proprietary TCP algorithms targeted to improve the end-to-end performance of TCP, regardless of whether the peer is Zeta-TCP or any other TCP protocol stack, in other words, to be compatible with the existing TCP algorithms...
, etc., are focused on the TCP congestion avoidance algorithm
TCP congestion avoidance algorithm
Transmission Control Protocol uses a network congestion avoidance algorithm that includes various aspects of an additive increase/multiplicative decrease scheme, with other schemes such as slow-start in order to achieve congestion avoidance....
, some also attempt to promote the performance of other aspects of the protocol. For instance, Zeta-TCP
Zeta-TCP
Zeta-TCP refers to a set of proprietary TCP algorithms targeted to improve the end-to-end performance of TCP, regardless of whether the peer is Zeta-TCP or any other TCP protocol stack, in other words, to be compatible with the existing TCP algorithms...
provides more accurate loss detection and heuristic download acceleration in addition to its congestion avoidance algorithm.
Compared with the symmetric TCP proxies, asymmetric TCP acceleration is more flexible in all kinds of deployment scenarios. A typical setup is to deploy the asymmetric acceleration device on the server side only. Then all the accessing clients, without having to install any extra software, will benefit from it. Performance-wise, without compression factors, asymmetric TCP acceleration is capable of offering the same level of improvement as the symmetric ones.
However, with symmetric deployment, the proxies are able to perform data compression and caching operations which further boost the performance by a factor of the compression ratio. The drawback of the compression/caching, though, is added latency and burst on the receiver side.