Upgrading to 10 Gbit
and beyond!
(note: this post is antedated to form a proper timeline of the developments of my network, it was actually written in march of 2024)
In my “How it started” post, I talked about the Coloclue Nikhef port service. It’s a great service provided by Coloclue in cooperation with Fusix. It has one small disadvantage though, and that is that the speed is limited to 1 gigabit.
While 1 gigabit was plenty fast at the time, I could see how I could go over that while downloading files from my network, doing speedtests or simply by growth of hosted services.
That’s when I decided to move my machine to Nikhef, bringing a 10G SFP+ DAC cable and an Intel X520 network card with me for the move.
After moving the machine and connecting it to the internet from Nikhef, it was time to upgrade the connections to the oudside world to 10G, too. My Speed-IX connection already was 10G, so I just needed to ask Arend (the owner - and legend - behind Frys-IX) to upgrade me. Which he was happy to do. Thanks Arend! Did I mention connecting to Frys-IX is free for 10G and 100G ports?
Giddy up!
nick@nikh-r630:~$ iperf3 -c achtbaan.nikhef.nl -P 10
Connecting to host achtbaan.nikhef.nl, port 5201
[ 5] local 2001:678:d64::1 port 54260 connected to 2001:610:120:e120:194:171:96:106 port 5201
[ 7] local 2001:678:d64::1 port 54262 connected to 2001:610:120:e120:194:171:96:106 port 5201
[ 9] local 2001:678:d64::1 port 54278 connected to 2001:610:120:e120:194:171:96:106 port 5201
[ 11] local 2001:678:d64::1 port 54286 connected to 2001:610:120:e120:194:171:96:106 port 5201
[ 13] local 2001:678:d64::1 port 54290 connected to 2001:610:120:e120:194:171:96:106 port 5201
[ 15] local 2001:678:d64::1 port 54294 connected to 2001:610:120:e120:194:171:96:106 port 5201
[ 17] local 2001:678:d64::1 port 54296 connected to 2001:610:120:e120:194:171:96:106 port 5201
[ 19] local 2001:678:d64::1 port 54310 connected to 2001:610:120:e120:194:171:96:106 port 5201
[ 21] local 2001:678:d64::1 port 54322 connected to 2001:610:120:e120:194:171:96:106 port 5201
[ 23] local 2001:678:d64::1 port 54326 connected to 2001:610:120:e120:194:171:96:106 port 5201
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 5] 0.00-1.00 sec 40.7 MBytes 341 Mbits/sec 0 259 KBytes
[ 7] 0.00-1.00 sec 41.0 MBytes 344 Mbits/sec 0 270 KBytes
[ 9] 0.00-1.00 sec 161 MBytes 1.35 Gbits/sec 1 565 KBytes
[ 11] 0.00-1.00 sec 161 MBytes 1.35 Gbits/sec 0 577 KBytes
[ 13] 0.00-1.00 sec 40.4 MBytes 339 Mbits/sec 0 257 KBytes
[ 15] 0.00-1.00 sec 160 MBytes 1.34 Gbits/sec 253 405 KBytes
[ 17] 0.00-1.00 sec 160 MBytes 1.34 Gbits/sec 7 565 KBytes
[ 19] 0.00-1.00 sec 40.6 MBytes 341 Mbits/sec 0 256 KBytes
[ 21] 0.00-1.00 sec 159 MBytes 1.33 Gbits/sec 0 560 KBytes
[ 23] 0.00-1.00 sec 159 MBytes 1.34 Gbits/sec 0 557 KBytes
[SUM] 0.00-1.00 sec 1.10 GBytes 9.42 Gbits/sec 261
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 5] 1.00-2.00 sec 39.1 MBytes 328 Mbits/sec 0 259 KBytes
[ 7] 1.00-2.00 sec 39.2 MBytes 329 Mbits/sec 0 270 KBytes
[ 9] 1.00-2.00 sec 159 MBytes 1.33 Gbits/sec 0 565 KBytes
[ 11] 1.00-2.00 sec 157 MBytes 1.32 Gbits/sec 0 577 KBytes
[ 13] 1.00-2.00 sec 39.6 MBytes 332 Mbits/sec 0 257 KBytes
[ 15] 1.00-2.00 sec 157 MBytes 1.32 Gbits/sec 0 482 KBytes
[ 17] 1.00-2.00 sec 158 MBytes 1.33 Gbits/sec 0 565 KBytes
[ 19] 1.00-2.00 sec 39.6 MBytes 332 Mbits/sec 0 256 KBytes
[ 21] 1.00-2.00 sec 158 MBytes 1.32 Gbits/sec 0 560 KBytes
[ 23] 1.00-2.00 sec 158 MBytes 1.32 Gbits/sec 0 584 KBytes
[SUM] 1.00-2.00 sec 1.08 GBytes 9.26 Gbits/sec 0
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 5] 2.00-3.00 sec 39.5 MBytes 331 Mbits/sec 0 259 KBytes
[ 7] 2.00-3.00 sec 39.0 MBytes 327 Mbits/sec 0 270 KBytes
[ 9] 2.00-3.00 sec 157 MBytes 1.32 Gbits/sec 1 565 KBytes
[ 11] 2.00-3.00 sec 156 MBytes 1.31 Gbits/sec 0 577 KBytes
[ 13] 2.00-3.00 sec 39.5 MBytes 331 Mbits/sec 0 257 KBytes
[ 15] 2.00-3.00 sec 157 MBytes 1.32 Gbits/sec 1 491 KBytes
[ 17] 2.00-3.00 sec 159 MBytes 1.33 Gbits/sec 0 565 KBytes
[ 19] 2.00-3.00 sec 38.9 MBytes 327 Mbits/sec 0 256 KBytes
[ 21] 2.00-3.00 sec 157 MBytes 1.31 Gbits/sec 0 560 KBytes
[ 23] 2.00-3.00 sec 158 MBytes 1.33 Gbits/sec 0 584 KBytes
[SUM] 2.00-3.00 sec 1.08 GBytes 9.25 Gbits/sec 2
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 5] 3.00-4.00 sec 39.7 MBytes 333 Mbits/sec 0 271 KBytes
[ 7] 3.00-4.00 sec 39.5 MBytes 331 Mbits/sec 0 270 KBytes
[ 9] 3.00-4.00 sec 158 MBytes 1.32 Gbits/sec 244 565 KBytes
[ 11] 3.00-4.00 sec 157 MBytes 1.32 Gbits/sec 0 634 KBytes
[ 13] 3.00-4.00 sec 39.1 MBytes 328 Mbits/sec 0 257 KBytes
[ 15] 3.00-4.00 sec 158 MBytes 1.32 Gbits/sec 0 502 KBytes
[ 17] 3.00-4.00 sec 157 MBytes 1.32 Gbits/sec 12 565 KBytes
[ 19] 3.00-4.00 sec 39.6 MBytes 332 Mbits/sec 0 256 KBytes
[ 21] 3.00-4.00 sec 158 MBytes 1.32 Gbits/sec 0 619 KBytes
[ 23] 3.00-4.00 sec 157 MBytes 1.32 Gbits/sec 0 612 KBytes
[SUM] 3.00-4.00 sec 1.08 GBytes 9.25 Gbits/sec 256
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 5] 4.00-5.00 sec 39.2 MBytes 329 Mbits/sec 0 271 KBytes
[ 7] 4.00-5.00 sec 39.6 MBytes 332 Mbits/sec 0 270 KBytes
[ 9] 4.00-5.00 sec 157 MBytes 1.32 Gbits/sec 0 565 KBytes
[ 11] 4.00-5.00 sec 158 MBytes 1.32 Gbits/sec 0 634 KBytes
[ 13] 4.00-5.00 sec 39.4 MBytes 331 Mbits/sec 0 257 KBytes
[ 15] 4.00-5.00 sec 158 MBytes 1.32 Gbits/sec 2 506 KBytes
[ 17] 4.00-5.00 sec 158 MBytes 1.33 Gbits/sec 0 565 KBytes
[ 19] 4.00-5.00 sec 39.2 MBytes 329 Mbits/sec 0 256 KBytes
[ 21] 4.00-5.00 sec 156 MBytes 1.31 Gbits/sec 0 619 KBytes
[ 23] 4.00-5.00 sec 157 MBytes 1.32 Gbits/sec 0 641 KBytes
[SUM] 4.00-5.00 sec 1.08 GBytes 9.24 Gbits/sec 2
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 5] 5.00-6.00 sec 39.2 MBytes 329 Mbits/sec 0 271 KBytes
[ 7] 5.00-6.00 sec 39.3 MBytes 330 Mbits/sec 0 270 KBytes
[ 9] 5.00-6.00 sec 158 MBytes 1.32 Gbits/sec 0 565 KBytes
[ 11] 5.00-6.00 sec 156 MBytes 1.31 Gbits/sec 0 634 KBytes
[ 13] 5.00-6.00 sec 39.1 MBytes 328 Mbits/sec 0 257 KBytes
[ 15] 5.00-6.00 sec 158 MBytes 1.33 Gbits/sec 0 506 KBytes
[ 17] 5.00-6.00 sec 157 MBytes 1.31 Gbits/sec 0 565 KBytes
[ 19] 5.00-6.00 sec 39.6 MBytes 332 Mbits/sec 0 256 KBytes
[ 21] 5.00-6.00 sec 158 MBytes 1.33 Gbits/sec 0 619 KBytes
[ 23] 5.00-6.00 sec 158 MBytes 1.32 Gbits/sec 0 641 KBytes
[SUM] 5.00-6.00 sec 1.08 GBytes 9.24 Gbits/sec 0
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 5] 6.00-7.00 sec 39.2 MBytes 329 Mbits/sec 0 271 KBytes
[ 7] 6.00-7.00 sec 39.2 MBytes 329 Mbits/sec 0 295 KBytes
[ 9] 6.00-7.00 sec 156 MBytes 1.31 Gbits/sec 0 565 KBytes
[ 11] 6.00-7.00 sec 156 MBytes 1.31 Gbits/sec 0 634 KBytes
[ 13] 6.00-7.00 sec 39.5 MBytes 331 Mbits/sec 0 257 KBytes
[ 15] 6.00-7.00 sec 157 MBytes 1.32 Gbits/sec 0 506 KBytes
[ 17] 6.00-7.00 sec 158 MBytes 1.32 Gbits/sec 0 565 KBytes
[ 19] 6.00-7.00 sec 38.9 MBytes 327 Mbits/sec 0 256 KBytes
[ 21] 6.00-7.00 sec 156 MBytes 1.31 Gbits/sec 0 619 KBytes
[ 23] 6.00-7.00 sec 158 MBytes 1.32 Gbits/sec 0 641 KBytes
[SUM] 6.00-7.00 sec 1.07 GBytes 9.21 Gbits/sec 0
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 5] 7.00-8.00 sec 39.1 MBytes 328 Mbits/sec 0 271 KBytes
[ 7] 7.00-8.00 sec 38.9 MBytes 327 Mbits/sec 0 295 KBytes
[ 9] 7.00-8.00 sec 157 MBytes 1.32 Gbits/sec 1 567 KBytes
[ 11] 7.00-8.00 sec 159 MBytes 1.33 Gbits/sec 0 634 KBytes
[ 13] 7.00-8.00 sec 39.1 MBytes 328 Mbits/sec 0 257 KBytes
[ 15] 7.00-8.00 sec 156 MBytes 1.31 Gbits/sec 0 506 KBytes
[ 17] 7.00-8.00 sec 157 MBytes 1.32 Gbits/sec 0 412 KBytes
[ 19] 7.00-8.00 sec 39.1 MBytes 328 Mbits/sec 0 256 KBytes
[ 21] 7.00-8.00 sec 157 MBytes 1.32 Gbits/sec 0 654 KBytes
[ 23] 7.00-8.00 sec 158 MBytes 1.32 Gbits/sec 0 641 KBytes
[SUM] 7.00-8.00 sec 1.07 GBytes 9.22 Gbits/sec 1
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 5] 8.00-9.00 sec 39.5 MBytes 331 Mbits/sec 0 271 KBytes
[ 7] 8.00-9.00 sec 39.6 MBytes 332 Mbits/sec 0 295 KBytes
[ 9] 8.00-9.00 sec 158 MBytes 1.33 Gbits/sec 1 567 KBytes
[ 11] 8.00-9.00 sec 158 MBytes 1.32 Gbits/sec 0 634 KBytes
[ 13] 8.00-9.00 sec 39.5 MBytes 331 Mbits/sec 0 257 KBytes
[ 15] 8.00-9.00 sec 156 MBytes 1.31 Gbits/sec 234 508 KBytes
[ 17] 8.00-9.00 sec 157 MBytes 1.31 Gbits/sec 36 447 KBytes
[ 19] 8.00-9.00 sec 39.5 MBytes 331 Mbits/sec 0 256 KBytes
[ 21] 8.00-9.00 sec 158 MBytes 1.32 Gbits/sec 0 654 KBytes
[ 23] 8.00-9.00 sec 157 MBytes 1.32 Gbits/sec 0 641 KBytes
[SUM] 8.00-9.00 sec 1.08 GBytes 9.24 Gbits/sec 271
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 5] 9.00-10.00 sec 39.4 MBytes 331 Mbits/sec 0 271 KBytes
[ 7] 9.00-10.00 sec 39.2 MBytes 329 Mbits/sec 0 295 KBytes
[ 9] 9.00-10.00 sec 156 MBytes 1.31 Gbits/sec 0 567 KBytes
[ 11] 9.00-10.00 sec 156 MBytes 1.31 Gbits/sec 0 634 KBytes
[ 13] 9.00-10.00 sec 38.8 MBytes 326 Mbits/sec 0 257 KBytes
[ 15] 9.00-10.00 sec 158 MBytes 1.33 Gbits/sec 1 509 KBytes
[ 17] 9.00-10.00 sec 157 MBytes 1.32 Gbits/sec 0 453 KBytes
[ 19] 9.00-10.00 sec 39.6 MBytes 332 Mbits/sec 0 397 KBytes
[ 21] 9.00-10.00 sec 156 MBytes 1.31 Gbits/sec 0 654 KBytes
[ 23] 9.00-10.00 sec 158 MBytes 1.32 Gbits/sec 0 705 KBytes
[SUM] 9.00-10.00 sec 1.07 GBytes 9.22 Gbits/sec 1
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 395 MBytes 331 Mbits/sec 0 sender
[ 5] 0.00-10.04 sec 393 MBytes 328 Mbits/sec receiver
[ 7] 0.00-10.00 sec 395 MBytes 331 Mbits/sec 0 sender
[ 7] 0.00-10.04 sec 393 MBytes 329 Mbits/sec receiver
[ 9] 0.00-10.00 sec 1.54 GBytes 1.32 Gbits/sec 248 sender
[ 9] 0.00-10.04 sec 1.54 GBytes 1.32 Gbits/sec receiver
[ 11] 0.00-10.00 sec 1.54 GBytes 1.32 Gbits/sec 0 sender
[ 11] 0.00-10.04 sec 1.53 GBytes 1.31 Gbits/sec receiver
[ 13] 0.00-10.00 sec 394 MBytes 330 Mbits/sec 0 sender
[ 13] 0.00-10.04 sec 393 MBytes 328 Mbits/sec receiver
[ 15] 0.00-10.00 sec 1.54 GBytes 1.32 Gbits/sec 491 sender
[ 15] 0.00-10.04 sec 1.54 GBytes 1.32 Gbits/sec receiver
[ 17] 0.00-10.00 sec 1.54 GBytes 1.32 Gbits/sec 55 sender
[ 17] 0.00-10.04 sec 1.54 GBytes 1.32 Gbits/sec receiver
[ 19] 0.00-10.00 sec 395 MBytes 331 Mbits/sec 0 sender
[ 19] 0.00-10.04 sec 393 MBytes 328 Mbits/sec receiver
[ 21] 0.00-10.00 sec 1.54 GBytes 1.32 Gbits/sec 0 sender
[ 21] 0.00-10.04 sec 1.53 GBytes 1.31 Gbits/sec receiver
[ 23] 0.00-10.00 sec 1.54 GBytes 1.32 Gbits/sec 0 sender
[ 23] 0.00-10.04 sec 1.54 GBytes 1.32 Gbits/sec receiver
[SUM] 0.00-10.00 sec 10.8 GBytes 9.25 Gbits/sec 794 sender
[SUM] 0.00-10.04 sec 10.8 GBytes 9.20 Gbits/sec receiver
iperf Done.
Yee-haw!