UDP performance tuning for ubuntu 24.04

[Jacob Goldverg]

Hello All,

I have recently been trying to maximize udp(tcp as well but less interested) for high speed data transfers over the Tbps network offered between WASH and LA.
I have already set the MTU on both servers to be 9000(jumbo frames) but I am still seeing very poor single stream performance ~20Mbps UDP and only 1.65Gbps via TCP.

Some tunings I have done on the UDP front that do not seem to be fruitful are:

–udp-window-packets=16384 –udp-ack-every-packets=64 –udp-ack-every-ms=2 –udp-read-buffer=134217728 –udp-write-buffer=134217728

Are there any other OS tricks I can do to reach the 50Gbps marker??

 

The experiment setup I have is two nodes connected over L2STS with a basic nic on each node.

 

Best,

Jacob

[Komal Thareja]

Hi Jacob,

Take a look at this artifact. While it focuses on TCP performance, it also covers OS tuning and CPU pinning / NUMA tuning, both of which should help with your performance work.

One other thing worth considering is the type of NIC you’re using. Basic (virtual) NICs likely won’t give you peak performance — NIC_ConnectX-6 or NIC_ConnectX-5 would be much better candidates.

Best,
Komal

• This reply was modified 21 hours, 31 minutes ago by Komal Thareja.

[Author]

Posts