Internet2 Land Speed Record
in single and multiple IPv6 TCP stream

29th, Oct.2005

30,000km (actually 35755 km)connection from Tokyo through Seattle to Tokyo, through Chicago to Tokyo Latency 500ms RTT

Network Configuration

treceroute from Opteron7 to Opetron1 (Tokyo - Seattle - WIDE(Tokyo) - Chicago - Tokyo)

traceroute to opteron7c-v6 (2001:200:0:1cf4::10) from 2001:200:0:1cf6::10, 
30 hops max, 24 byte packets
 1  t-lex-sea-900-v6 (2001:200:0:1cf6::2)  88.709 ms  88.697 ms  88.696 ms
 2  nezu-901-v6 (2001:200:0:1cf7::2)  177.368 ms  177.364 ms  177.36 ms
 3  gs4k-chi-3300-v6 (2001:200:0:1cf1::3)  341.194 ms  341.954 ms  340.966 ms
 4  opteron7c-v6 (2001:200:0:1cf4::10)  500.206 ms  500.203 ms  500.203 ms

treceroute from Opteron1 to Opetron7 (Tokyo - Chicago - WIDE(Tokyo) - Seattle - Tokyo)

traceroute to opteron1c-v6 (2001:200:0:1cf6::10) from 2001:200:0:1cf4::10, 
30 hops max, 24 byte packets
 1  gs4k-chi-3698-v6 (2001:200:0:1cf4::1)  163.508 ms  163.536 ms  163.516 ms
 2  nezu-3300-v6 (2001:200:0:1cf1::2)  322.996 ms  322.998 ms  322.999 ms
 3  t-lex-sea-901-v6 (2001:200:0:1cf7::1)  411.672 ms  411.679 ms  411.663 ms
 4  opteron1c-v6 (2001:200:0:1cf6::10)  500.187 ms  500.196 ms  500.186 ms

Internet2 TCP Single stream Land Speed Record measurement

System

• Server configuration
• CPU: Dual AMD Opteron 248, 2.2GHz
• Mother Board: RioWorks HDAMA rev. E
• Memory: 1G bytes, Corsair Twinx CMX512RE-3200LLPT x 2, PC3200, CL=2
• OS: Linux kernel 2.6.12
• Disk Seagate IDE 80GB, 7200r.p.m. (disk speed not essential for performance)
• Network interface card
• Chelsio T110 (10GBASE-SR), TCP offload engine (TOE),
• PCI-X/133 MHz I/O bus connection
• TOE function OFF

Technical points

• (1) IPv6 packets
• (2) 9130B Jumbo frame
• (3) Use of "inter-layer coordination optimization" in TCP[1](Adjusting output rate using Chelsio T110 feature)
• (4) single stream TCP
• (5) All the trans continental connections are WAN PHY based.
• (6) IPv6 communication is almost as fast as that of IPv4.

Target Performance of single stream TCP on 30,000(actual 35,755) km circuit

• 5.58 Gbps (TCP payload), standard frame -> 167,400Terabit meter / second (Internet2 LSR approved Single/Multi TCP Stream record)

• Internet2 Land Speed Record Page

Results

Traffic Graphs

dump of trial

These traces are submitted traial non-drop version(first 100 packets)

sender side log

receiver side log

tcpdump format(sender side)

tcpdump format(receiver side)

Name of Institutions and persons

• The University of Tokyo
• Kei Hiraki
• Mary Inaba
• Junji Tamatsukuri
• Yutaka Sugawara
• Katsushi Inagami
• Takeshi Yoshino
• Nao Aoshima
• WIDE project
• Akira Kato
• Seiichi Yamamoto
• Yuji Sekiya
• JGN2
• Asako Toyoda
• Kazuhiko Nakamura
• Katsushi Kobayashi
• Yoshitaka Hattori
• Jin Tanaka
• Yoichi Tsukioka
• Northwest Giga Pop
• Jan Eveleth
• Bill Mar
• Beth Garrison
• Chelsio Communications
• Felix Marti
• Wael Noureddine
• Fujitsu Computer Technologies LTD
• Ryutaro Kurusu
• Masakazu Sakamoto
• Yuki Furukawa
• Yukichi Ikuta
• NTT Communications
• Katsuyuki Hasebe
• Miyuki Neo
• Yu Inada
• Mitsuo Murakami
• IEEAF

Supported by

• Special Coordination Fund for Promoting Science and Technology, Ministr y of Education, Culture, Sports, Science and Technology, Japan
• Foundry Networks,
• Alaxala Netowrks,
• Hitachi,
• CISCO systems, Inc.
• TOYO Corporation

Data Reservoir / GRAPE-DR project, University of Tokyo