10G network netperf performance (ix)
Sepherosa Ziehau
sepherosa at gmail.com
Thu Mar 13 06:26:44 PDT 2014
Hi all,
Following stats are for folks interested in DragonFly's TCP netperf
performance on 10G network (as of 9f1b012):
Testing system hardware:
Host: i7-3770 w/ hyperthreading enabled, dual channel DDR3-1600 memory (8GB x 2)
NIC: Intel 82599ES (connected w/ Intel XDACBL1M direct attach cable)
TSO burst size is default to 12000B for DragonFly's ix.
+-------+ +-------+
| | | |
| | ix0 ---- ix0 | |
| A | | B |
| | ix1 ---- ix1 | |
| | | |
+-------+ +-------+
B runs 'netserver -N'
1) TCP_STREAM (total 18840Mbps, 2 ports, 5 run average):
tcp_stream -H B0 -i 64 -l 60 &
tcp_stream -H B1 -i 64 -l 60
The above commands starts 128 netperf TCP_STREAM tests to B0 and B1.
The results:
~9424Mbps on for each set of test, i.e. total 18840Mbps (5 run average).
Jain's fairness index for each set of test > 0.85 (1.0 is the best).
CPU usage statistics:
On TX side (A): ~25% sys, ~2% user, ~7% intr. Almost no contention.
On RX side (B): ~35% sys, ~3% user, ~10% intr. Mainly contended on rcvtok.
Interrupt rate is ~16000 on each CPU (interrupt moderation is
default to 8000hz for DragonFly's ix)
2) TCP_STREAM + TCP_MAERTS (total 37279Mbps, 2 ports, 5 run average):
tcp_stream -H B0 -i 32 -l 60 &
tcp_stream -H B1 -i 32 -l 60 &
tcp_stream -H B0 -i 32 -l 60 -r &
tcp_stream -H B1 -i 32 -l 60 -r
The above commands starts 64 netperf TCP_STREAM and 64 TCP_MAERTS
tests to B0 and B1.
The results:
~9220Mbps - ~9400Mbps for each set of test, i.e. total 37279Mbps (5
runs average)
Jain's fairness index for each set of test > 0.80 (1.0 is the best).
CPU usage statistics:
~75% sys, ~4% user, ~20% intr. Mainly contended on rcvtok. The
tests are CPU limited. System is still responsive during the test.
Interrupt rate is ~16000 on each CPU (interrupt moderation is
default to 8000hz for DragonFly's ix)
Best Regards,
sephe
--
Tomorrow Will Never Die
More information about the Users
mailing list