- This topic has 1 reply, 2 voices, and was last updated 22 hours, 28 minutes ago by .
Viewing 2 posts - 1 through 2 (of 2 total)
Viewing 2 posts - 1 through 2 (of 2 total)
- You must be logged in to reply to this topic.
Home › Forums › FABRIC General Questions and Discussion › UDP performance tuning for ubuntu 24.04
Tagged: performance tuning.
Hello All,
I have recently been trying to maximize udp(tcp as well but less interested) for high speed data transfers over the Tbps network offered between WASH and LA.
I have already set the MTU on both servers to be 9000(jumbo frames) but I am still seeing very poor single stream performance ~20Mbps UDP and only 1.65Gbps via TCP.
Some tunings I have done on the UDP front that do not seem to be fruitful are:
–udp-window-packets=16384 –udp-ack-every-packets=64 –udp-ack-every-ms=2 –udp-read-buffer=134217728 –udp-write-buffer=134217728
Are there any other OS tricks I can do to reach the 50Gbps marker??
The experiment setup I have is two nodes connected over L2STS with a basic nic on each node.
Best,
Jacob
Hi Jacob,
Take a look at this artifact. While it focuses on TCP performance, it also covers OS tuning and CPU pinning / NUMA tuning, both of which should help with your performance work.
One other thing worth considering is the type of NIC you’re using. Basic (virtual) NICs likely won’t give you peak performance — NIC_ConnectX-6 or NIC_ConnectX-5 would be much better candidates.
Best,
Komal