IPv6 Internet Land Speed Record submission

                                                                      Submitted:,2005/11/14 PST

abstract

 

- IPv6 single stream LSR submission on 2005/11/14 10:30PST

- LSR distance is 30,000km (actually 32372 km).

- The bandwidth is 6.96 Gbps.

- 750 seconds (about 32 minutes)

- The result is 208,800terabit meters / second.

- Three routers along the network path

- Software TCP of standard Linux

- Measurement was at about 11/13 21:00, PST

 

- - IPv6 LSR submission with more than 30,000 km distance

- Heavy use of WAN PHY in the network

- 9130B Jumbo frame

- Chelsio N110 NIC. NIC is different from previous submissions

- Dual Opteron server for both sender and receiver

- Use of receiving side pacing by TGNLE-1 by SANSEI-system.

 

1. Contact person

 

Data Reservoir Project / GRAPE-DR project

Kei Hiraki   hiraki@is.s.u-tokyo.ac.jp

 

Department of Computer Science

Graduate School of Information Science and Technology

The University of Tokyo

 

7-3-1, Hongo, Bunkyo-ku, Tokyo, Japan 113-8656

Phone:+81-3-5841-4039

 

2. Name of Institutions and persons

 

The University of Tokyo

              Kei Hiraki

              Mary Inaba

              Junji Tamatsukuri

              Yutaka Sugawara

              Katsushi Inagami

Nao Aoshima

Makoto Nakamura

WIDE project

              Akira Kato

              Hiroshi Esaki

Kazuma Kobayashi

Yuji Sekiya

              Seiichi Yamamoto

Fujitsu Computer Technologies LTD

              Ryutaro Kurusu

              Masakazu Sakamoto

              Yuki Furukawa

              Yukichi Ikuta

NTT Communications

Katsuyuki Hasebe

Miyuki Neo

Yu Inada

Mitsuo Murakami

APAN

              Kazunori Konishi

JGN2

              Asako Toyoda

              Kazuhiko Nakamura

Katsushi Kobayashi

Yoichi Tsukioka

              Yoshitaka Hattori

              Jin Tanaka

              Shinya Hori

IEEAF

Tyco Telecommunications

Northwest Giga Pop

              Jan Eveleth

              Bill Mar

              Beth Garrison

CANARIE

              Rene Hatem

              Damir Pobric

              Thomas Tam

StarLight

              Linda Winkler

              Jake Sallee

SURFnet

              Kees Neggers

              Erik-Jan Bos

SARA

              Pieter de Boer

University of Amsterdam

              Cees de Laat

              Paola Grosso

Freek Dijkstra

 

 

Supported by:

 

- Special Coordination Fund for Promoting Science and Technology, Ministry of Education, Culture, Sports, Science and Technology, Japan

- Microsoft

- Foundry Networks

- Alaxala Networks,

- Hitachi

- CISCO systems

- Bussan Networks

- Netone systems

- Anue systems

- TOYO Corporation

- Fujitsu Panafacom LTD.

 

 

3. Network, systems and results

 

3-1. Network topology

 

The entire network paths used in this experiment is IPv4, Jumbo-frame free.

 

The source and destination systems are located at SC05 Exhibition booth 233, Seattle, WA..  Data transmitted from the source system at first connected to Fujitsu XG800 switch at the exhibition booth, then data go to Foundry NetIron 40G located at Pacific Northwest Gigapop, Seattle, WA. Then data goes through Foundry NetIron40G to another NetIron40G at T-LEX, Tokyo through IEEAF WAN PHY link. This T-LEX NI40G is used as L3 switching device.

 

 At Tokyo, Data from Foundry NetIron40G at T-LEX go to another NetIron40G placed at University of Tokyo through WIDE network. Then it go through Hitachi GS4000 located at University of Tokyo, another GS4000 at Tokyo, then yet another GS4000.  These three GS4000s are belonged to JGN2.

 

From the last Hitachi GS4000 at Tokyo, data go to JGN2’s GS4000 located at StarLight , Chicago through JGN2 network.  This part of the network is operated by APAN. GS4000 at StarLight is used as a router (L3 switching). Then data go to Force10 E600 switch of University of Amsterdam and Hitachi GS4000 both located at SARA, Amsterdam. This GS4000 is also used as a router (L3 switching).

 

After going through Amsterdam, data go back to Seattle.  From Amsterdam to Seattle is CA *NET 4, CANARIE.  At Seattle data go into the same Foundry NetIron40G described above, then go to SC05 exhibition booth 233 by DWDM connection. Data finally go through Fujitsu XG800. The output of the XG800 is connected to SANSEI-system TGNLE-1 receiving-side pacing device, then go to the destination server.

 

  Therefore, the overall network uses 3 routers and L3 switches.

 

(1) Tokyo, T-LEX Foundry NetIron40G

(2) Chicago, JGN2 Hitachi GS4000

(3) Amsterdam, SARA, Hitachi GS4000

 

 

The total length of the network is calculated by the sum of the shortest distance between Tokyo -> Chicago -> Tokyo -> Seattle -> Tokyo. The distance between Otemachi and University of Tokyo is neglected at the calculation. Therefore:

 

 

From                                To                                     Distance

SEA (47°26'56"N 122°18'34"W)     HND (35°33'08"N 139°46'47"E)     7730 km

 HND (35°33'08"N 139°46'47"E) ORD (41°58'43"N 87°54'17"W)      10147 km

 ORD (41°58'43"N 87°54'17"W)    AMS (52°18'31"N 04°45'50"E)       6630 km

 AMS (52°18'31"N 04°45'50"E)     SEA (47°26'56"N 122°18'34"W)     7864 km

                                                        4 segment path:               32372 km

 

(We use “Great Circle Mapper” for calculation of distances.  See

http://gc.kls2.com/cgi-bin/gc?PATH=SEA-HND-ORD-AMS-SEA%0D%0A&RANGE=&PATH-COLOR=red&PATH-UNITS=km&SPEED-GROUND=&SPEED-UNITS=kts&RANGE-STYLE=best&RANGE-COLOR=navy&MAP-STYLE=

)

 

Figure 1, Figure 2 and Figure 3 show network connection used in this measurement. Figure 4 shows the way to calculate LSR distance. Figure 5 shows MRTG graphs along the network path.

 

 

3-2. System

 

The source server and destination server has exactly the same hardware and software configuration.

 

Hardware:

AMD Dual Opteron248, 2.4GHz.(Sender server)

AMD Dual Opteron248, 2.2GHz.(Receiver server)

RioWorks HMADA rev.E motherboard

2GB memory

80GB disk

Chelsio N110 10Gigabit Ethernet Adapter (This is different from the previous submission)

 

Network hardware

 

SANSEI-system TGNLE-1 receiving-side pacing device

 

Software

Linux 2.6.12 operating system kernel with Chelsio T110 driver

iperf for generating TCP packets

 

 

The contents of packets of the first 100 packets are stored by the receiving Opteron server.

  Because of the limitation of receiving speed of the Opteron server, the first 100 packets are captured. The trace data captured by the Opteron server is lossy, and may drop several packets but it is sufficient to show that all the packets carry different payload patters.

 

During measurement, network traffic is monitored by MRTG data from NI40G of Seattle and other locations . Network bandwidth observed by MRTG includes Ethernet headers, IP headers and TCP headers and slightly more than TCP payload bandwidth observed by application software to generate packets.

 

3-3. iperf command used in the measurement

 

Receiving side:

 

iperf -V -s -i 1 -l 292096

 

Sending side

 

iperf -V -c opteron6c-v6 -i 1 -l 292096 -t 750

(Note that we stopped at the middle of the execution, and we calculate

bandwidth from the sum of transfer data)

 

3-4. TCP parameters used

 

(1) MTU 9130B

 

(2) Window size, Sender side 1.00GBReceiver side 1.26GB

 

(3) RFC 1323 Delayed ACKs and Timestamps were disabled

 

3-5. Results

 

The measured data are as follows:

 

(A) output of iperf execution (see Appendix A)

(B) traceroute data (see Appendix B)

(C) Full packet trace of first part of packets.

 

http://data-reservoir.adm.s.u-tokyo.ac.jp/data/sc2005/lsr4/tcpdump-server-20051114_14:19:17.txt

 

(D) Network traffic at intermediate switching points (see Figure 5)

 

 

The bandwidth is 6.96 Gbits/sec.  The actual distance is 32372 km. It is greater than 30,000km. Therefore the LSR distance is 30,000 km.

The result is 208,800 terabit meters / second.

 

3-6. Technical features

 

(1) IPv6 packets

(2) 9130B Jumbo frame

(3) Use of “inter-layer coordination optimization” in TCP[1](Adjusting output rate using Chelsio T110 feature)

(4) single stream TCP

(5) All the trans continental connections are WAN PHY based.

(6) IPv6 communication is almost as fast as that of IPv4.

 

[1] “Inter-Layer Coordination for Parallel TCP Streams on Long Fat Pipe Networks”, Proc. SC2004, Pittsburgh, Nov. 2004.

http://www.sc-conference.org/sc2004/schedule/pdfs/pap254.pdf

 

 

4. On rules for Land Speed Record

 

Rule 1) A data transfer must run for a minimum of 10 continuous minutes over a minimum terrestrial distance of 100 kilometers with a minimum of two router hops in each direction between the source node and the destination node. A maximum of 30,000 kilometers will be allowed for the distance value used in any submission.
 

We run experiment for 12 minutes 30 second. That is more than 10 continuous minutes.

The path has 3 L3 switches used as routing device. They are

 

(1) Tokyo, T-LEX Foundry NetIron40G

(2) Chicago, JGN2 Hitachi GS4000

(3) Amsterdam, SARA, Hitachi GS4000

 

The total length of the network is calculated by the sum of the shortest distance between Tokyo -> Chicago -> Tokyo -> Seattle -> Tokyo. The distance between Otemachi and University of Tokyo is neglected at the calculation. Therefore:

 

 

From                                To                                     Distance

SEA (47°26'56"N 122°18'34"W)     HND (35°33'08"N 139°46'47"E)     7730 km

 HND (35°33'08"N 139°46'47"E) ORD (41°58'43"N 87°54'17"W)      10147 km

 ORD (41°58'43"N 87°54'17"W)    AMS (52°18'31"N 04°45'50"E)       6630 km

 AMS (52°18'31"N 04°45'50"E)     SEA (47°26'56"N 122°18'34"W)     7864 km

                                                        4 segment path:               32372 km

 

 

Total length is 32,372 km.  This satisfies rule 1. The distance used in calculation is 30,000km based on the rule 1.

 

 

Rule 2) The transfers must run across one or more operational and production-oriented high-performance research and educations networks.  Examples of such networks are Abilene, ESnet, CA*net3, NREN and GEANT.
 

The transfers run across WIDE, IEEAF, JGN2 (domestic and international), SURFnet and CANARIE CA*net4.  JGN2(domestic and international) and WIDE network are production-oriented high performance research and educations networks.  Therefore this submission satisfies rule 2.

 

Rule3) All data must be transferred end-to-end between a single pair of IP addresses by bona fide TCP/IP protocol code implementations of RFC 793 and RFC 791.  One IP address is designated the source IP address, while the other is designated the destination address.  All data must be transferred in TCP packets encapsulated in IP packets that use no other IP addresses other than the designated source IP address and the designated destination IP address.  The source node is defined as the equipment associated with the source IP address and which executes the data-source network application, while the destination node is defined as the equipment associated with the destination IP address and which executes the data-sink network application.

 

All data were sent between two opteron servers. Each server has one 10Gbps network interface adapter by Chelsio, and has single IPv6 address.  All data transfer is done by Linux standard TCP that satisfy RFC 793 and RFC 791. Detail of systems is listed in the web page.  Therefore, the system used satisfies rule 3.
 

Rule 4) Instances of all hardware units and software modules used to transfer contest data on the source node, the destination node, the links, and the routers must be offered for commercial sale or as open source software to all U.S. members of the Internet2 community by their respective vendors or developers prior to or immediately after winning the contest.

 

 

Hardware:

AMD Dual Opteron248, 2.4GHz (Sender server)

AMD Dual Opteron248, 2.2GHz (Receiver server)

RioWorks HMADA rev.E motherboard

2GB memory

80GB disk

Chelsio N110 10Gigabit Ethernet Adapter

SANSEI-system TGNLE-1

 

Software

Linux 2.6.12 operating system kernel

iperf for generating TCP packets

(note: SANSEI-system TGNLLE-1 has been a commercial product in Japan from

2004, and it has US dealer.)

All the hardware used are purchased as commercial product, available in U.S.

 

Operating system is Linux 2.6.12 and it is open source.  Driver used is manufactured by Chelsio communications, and generally available.  Therefore, all software and hardware satisfies rule 4.
 

Rule 5) Each entry must include sufficient information that adherence to all contest rules can be readily determined.  Entries must also identify institution(s) and personnel requesting consideration as winners.  Entries must be submitted no later than two weeks prior to each Member Meeting inorder to recieve recognition during the meeting.
 

In the web page of this submission,

 

(A) traceroute data

(B) output of iperf execution

(C) Full packet trace of first part of packets.  Number of packets is more than 50. This trace is produced by tcpdump executed at the receiver server.

(D) A figure of network routes

 

Rule 6) Winners will be recognized in each of the following separate classes:

C) The IPv6 Single-Stream Class winner must utilize a single TCP/IPv6 session.
 

D) The IPv6 Multiple-Stream Class winner may utilize multiple concurrent TCP/IPv6 sessions

Any record setter in a single stream class will be automatically considered for the multiple stream record in the same category.

 

This submission is class C and class D.

 

Rule 7)  In computing the amount of data transferred, only data transferred from user-process-space buffer(s) in the data-source network application to user-process-space buffer(s) in the data-sink network application may be counted.  Received data must vary in content from buffer to buffer and must be verified by checksum or other means that it is identical to the data transmitted from the source node.  The elapsed time of the data transfer is the real time that elapses between the source sending a packet with the SYN bit enabled and sending a packet with the ACK bit enabled following the receipt of a packet(s) with the FIN and ACK bits enabled.

 

 

Payload data on each packet are not identical.  Other issues of this rule is satisfies.

Therefore, rule 7 is satisfies.


 

Rule 8) The winner in each Class will be whichever submitter is judged to have met all rules and whose results yield the largest value of the product of the achieved bandwidth (bits/second) multiplied by the sum of the terrestrial distances between each router location starting from the source node location and ending at the destination node location, using the shortest distance of the Earth's circumference measured in meters between each pair of locations.  The contest unit of measurement is thus bit-meters/second.

 

The bandwidth is 6.96 Gbps.  The distance for calculation is 30,000 km.

The result is 208,800 terabit meters / second.

 

 

Rule 9) A Contest Entry Judging Panel chosen by Internet2 staff from the Internet2 community will determine winners in each class according to the stated rules.

A winning entry must exceed the previous winning entry by at least 10%.
 

This result is 208,800terabit meters / second, and that exceeds the known previous winning entry and submitted value by more than 10% in both single stream and multiple streams. (So far as we know, the current winning entry is

185,400 terabit meters / second)


Appendix A.  Output of iperf

 

# iperf -V -s -i 1 -l 292096

------------------------------------------------------------

Server listening on TCP port 5001

TCP window size: 1.25 GByte (default)

------------------------------------------------------------

[  4] local 2001:200:0:1cf0::12 port 5001 connected with 2001:200:0:1cf3::12 port 50508

[  4]  0.0- 1.0 sec  44.6 KBytes    365 Kbits/sec

[  4]  1.0- 2.0 sec    214 KBytes  1.75 Mbits/sec

[  4]  2.0- 3.0 sec    856 KBytes  7.01 Mbits/sec

[  4]  3.0- 4.0 sec  3.34 MBytes  28.0 Mbits/sec

[  4]  4.0- 5.0 sec  13.4 MBytes    112 Mbits/sec

[  4]  5.0- 6.0 sec  53.5 MBytes    449 Mbits/sec

[  4]  6.0- 7.0 sec    214 MBytes  1.79 Gbits/sec

[  4]  7.0- 8.0 sec    657 MBytes  5.51 Gbits/sec

[  4]  8.0- 9.0 sec    838 MBytes  7.03 Gbits/sec

[  4]  9.0-10.0 sec    847 MBytes  7.11 Gbits/sec

[  4] 10.0-11.0 sec    847 MBytes  7.11 Gbits/sec

[  4] 11.0-12.0 sec    847 MBytes  7.11 Gbits/sec

[  4] 12.0-13.0 sec    847 MBytes  7.11 Gbits/sec

[  4] 13.0-14.0 sec    847 MBytes  7.11 Gbits/sec

[  4] 14.0-15.0 sec    847 MBytes  7.11 Gbits/sec

[  4] 15.0-16.0 sec    847 MBytes  7.11 Gbits/sec

[  4] 16.0-17.0 sec    847 MBytes  7.11 Gbits/sec

[  4] 17.0-18.0 sec    847 MBytes  7.11 Gbits/sec

[  4] 18.0-19.0 sec    847 MBytes  7.11 Gbits/sec

[  4] 19.0-20.0 sec    847 MBytes  7.11 Gbits/sec

[  4] 20.0-21.0 sec    847 MBytes  7.11 Gbits/sec

[  4] 21.0-22.0 sec    847 MBytes  7.11 Gbits/sec

[  4] 22.0-23.0 sec    847 MBytes  7.11 Gbits/sec

[  4] 23.0-24.0 sec    847 MBytes  7.11 Gbits/sec

[  4] 24.0-25.0 sec    847 MBytes  7.11 Gbits/sec

[  4] 25.0-26.0 sec    847 MBytes  7.11 Gbits/sec

[  4] 26.0-27.0 sec    847 MBytes  7.11 Gbits/sec

[  4] 27.0-28.0 sec    847 MBytes  7.11 Gbits/sec

[  4] 28.0-29.0 sec    847 MBytes  7.11 Gbits/sec

[  4] 29.0-30.0 sec    847 MBytes  7.10 Gbits/sec

[  4] 30.0-31.0 sec    847 MBytes  7.11 Gbits/sec

[  4] 31.0-32.0 sec    847 MBytes  7.10 Gbits/sec

[  4] 32.0-33.0 sec    847 MBytes  7.10 Gbits/sec

[  4] 33.0-34.0 sec    846 MBytes  7.10 Gbits/sec

[  4] 34.0-35.0 sec    847 MBytes  7.10 Gbits/sec

[  4] 35.0-36.0 sec    847 MBytes  7.10 Gbits/sec

[  4] 36.0-37.0 sec    846 MBytes  7.10 Gbits/sec

[  4] 37.0-38.0 sec    846 MBytes  7.10 Gbits/sec

[  4] 38.0-39.0 sec    846 MBytes  7.10 Gbits/sec

[  4] 39.0-40.0 sec    846 MBytes  7.10 Gbits/sec

[  4] 40.0-41.0 sec    846 MBytes  7.10 Gbits/sec

[  4] 41.0-42.0 sec    846 MBytes  7.10 Gbits/sec

[  4] 42.0-43.0 sec    846 MBytes  7.10 Gbits/sec

[  4] 43.0-44.0 sec    846 MBytes  7.10 Gbits/sec

[  4] 44.0-45.0 sec    846 MBytes  7.10 Gbits/sec

[  4] 45.0-46.0 sec    846 MBytes  7.09 Gbits/sec

[  4] 46.0-47.0 sec    845 MBytes  7.09 Gbits/sec

[  4] 47.0-48.0 sec    846 MBytes  7.09 Gbits/sec

[  4] 48.0-49.0 sec    845 MBytes  7.09 Gbits/sec

[  4] 49.0-50.0 sec    845 MBytes  7.09 Gbits/sec

[  4] 50.0-51.0 sec    845 MBytes  7.09 Gbits/sec

[  4] 51.0-52.0 sec    845 MBytes  7.09 Gbits/sec

[  4] 52.0-53.0 sec    845 MBytes  7.09 Gbits/sec

[  4] 53.0-54.0 sec    845 MBytes  7.08 Gbits/sec

[  4] 54.0-55.0 sec    845 MBytes  7.09 Gbits/sec

[  4] 55.0-56.0 sec    845 MBytes  7.08 Gbits/sec

[  4] 56.0-57.0 sec    844 MBytes  7.08 Gbits/sec

[  4] 57.0-58.0 sec    844 MBytes  7.08 Gbits/sec

[  4] 58.0-59.0 sec    844 MBytes  7.08 Gbits/sec

[  4] 59.0-60.0 sec    844 MBytes  7.08 Gbits/sec

[  4] 60.0-61.0 sec    843 MBytes  7.07 Gbits/sec

[  4] 61.0-62.0 sec    843 MBytes  7.07 Gbits/sec

[  4] 62.0-63.0 sec    843 MBytes  7.07 Gbits/sec

[  4] 63.0-64.0 sec    842 MBytes  7.07 Gbits/sec

[  4] 64.0-65.0 sec    843 MBytes  7.08 Gbits/sec

[  4] 65.0-66.0 sec    843 MBytes  7.07 Gbits/sec

[  4] 66.0-67.0 sec    842 MBytes  7.07 Gbits/sec

[  4] 67.0-68.0 sec    843 MBytes  7.07 Gbits/sec

[  4] 68.0-69.0 sec    843 MBytes  7.07 Gbits/sec

[  4] 69.0-70.0 sec    843 MBytes  7.07 Gbits/sec

[  4] 70.0-71.0 sec    843 MBytes  7.07 Gbits/sec

[  4] 71.0-72.0 sec    843 MBytes  7.07 Gbits/sec

[  4] 72.0-73.0 sec    843 MBytes  7.07 Gbits/sec

[  4] 73.0-74.0 sec    843 MBytes  7.07 Gbits/sec

[  4] 74.0-75.0 sec    843 MBytes  7.07 Gbits/sec

[  4] 75.0-76.0 sec    843 MBytes  7.07 Gbits/sec

[  4] 76.0-77.0 sec    843 MBytes  7.07 Gbits/sec

[  4] 77.0-78.0 sec    842 MBytes  7.07 Gbits/sec

[  4] 78.0-79.0 sec    843 MBytes  7.07 Gbits/sec

[  4] 79.0-80.0 sec    842 MBytes  7.07 Gbits/sec

[  4] 80.0-81.0 sec    842 MBytes  7.06 Gbits/sec

[  4] 81.0-82.0 sec    842 MBytes  7.07 Gbits/sec

[  4] 82.0-83.0 sec    842 MBytes  7.06 Gbits/sec

[  4] 83.0-84.0 sec    842 MBytes  7.06 Gbits/sec

[  4] 84.0-85.0 sec    842 MBytes  7.07 Gbits/sec

[  4] 85.0-86.0 sec    841 MBytes  7.06 Gbits/sec

[  4] 86.0-87.0 sec    842 MBytes  7.06 Gbits/sec

[  4] 87.0-88.0 sec    842 MBytes  7.06 Gbits/sec

[  4] 88.0-89.0 sec    842 MBytes  7.06 Gbits/sec

[  4] 89.0-90.0 sec    842 MBytes  7.06 Gbits/sec

[  4] 90.0-91.0 sec    841 MBytes  7.06 Gbits/sec

[  4] 91.0-92.0 sec    842 MBytes  7.06 Gbits/sec

[  4] 92.0-93.0 sec    842 MBytes  7.06 Gbits/sec

[  4] 93.0-94.0 sec    842 MBytes  7.06 Gbits/sec

[  4] 94.0-95.0 sec    842 MBytes  7.06 Gbits/sec

[  4] 95.0-96.0 sec    841 MBytes  7.06 Gbits/sec

[  4] 96.0-97.0 sec    841 MBytes  7.06 Gbits/sec

[  4] 97.0-98.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 98.0-99.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 99.0-100.0 sec    841 MBytes  7.05 Gbits/sec

[  4] 100.0-101.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 101.0-102.0 sec    841 MBytes  7.06 Gbits/sec

[  4] 102.0-103.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 103.0-104.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 104.0-105.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 105.0-106.0 sec    841 MBytes  7.06 Gbits/sec

[  4] 106.0-107.0 sec    841 MBytes  7.05 Gbits/sec

[  4] 107.0-108.0 sec    841 MBytes  7.05 Gbits/sec

[  4] 108.0-109.0 sec    842 MBytes  7.06 Gbits/sec

[  4] 109.0-110.0 sec    841 MBytes  7.05 Gbits/sec

[  4] 110.0-111.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 111.0-112.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 112.0-113.0 sec    841 MBytes  7.05 Gbits/sec

[  4] 113.0-114.0 sec    840 MBytes  7.04 Gbits/sec

[  4] 114.0-115.0 sec    841 MBytes  7.05 Gbits/sec

[  4] 115.0-116.0 sec    841 MBytes  7.05 Gbits/sec

[  4] 116.0-117.0 sec    841 MBytes  7.06 Gbits/sec

[  4] 117.0-118.0 sec    841 MBytes  7.05 Gbits/sec

[  4] 118.0-119.0 sec    841 MBytes  7.05 Gbits/sec

[  4] 119.0-120.0 sec    841 MBytes  7.05 Gbits/sec

[  4] 120.0-121.0 sec    841 MBytes  7.05 Gbits/sec

[  4] 121.0-122.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 122.0-123.0 sec    841 MBytes  7.05 Gbits/sec

[  4] 123.0-124.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 124.0-125.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 125.0-126.0 sec    841 MBytes  7.05 Gbits/sec

[  4] 126.0-127.0 sec    841 MBytes  7.05 Gbits/sec

[  4] 127.0-128.0 sec    840 MBytes  7.04 Gbits/sec

[  4] 128.0-129.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 129.0-130.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 130.0-131.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 131.0-132.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 132.0-133.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 133.0-134.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 134.0-135.0 sec    841 MBytes  7.05 Gbits/sec

[  4] 135.0-136.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 136.0-137.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 137.0-138.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 138.0-139.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 139.0-140.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 140.0-141.0 sec    840 MBytes  7.04 Gbits/sec

[  4] 141.0-142.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 142.0-143.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 143.0-144.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 144.0-145.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 145.0-146.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 146.0-147.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 147.0-148.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 148.0-149.0 sec    839 MBytes  7.03 Gbits/sec

[  4] 149.0-150.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 150.0-151.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 151.0-152.0 sec    839 MBytes  7.03 Gbits/sec

[  4] 152.0-153.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 153.0-154.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 154.0-155.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 155.0-156.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 156.0-157.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 157.0-158.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 158.0-159.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 159.0-160.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 160.0-161.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 161.0-162.0 sec    839 MBytes  7.03 Gbits/sec

[  4] 162.0-163.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 163.0-164.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 164.0-165.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 165.0-166.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 166.0-167.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 167.0-168.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 168.0-169.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 169.0-170.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 170.0-171.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 171.0-172.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 172.0-173.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 173.0-174.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 174.0-175.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 175.0-176.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 176.0-177.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 177.0-178.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 178.0-179.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 179.0-180.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 180.0-181.0 sec    839 MBytes  7.03 Gbits/sec

[  4] 181.0-182.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 182.0-183.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 183.0-184.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 184.0-185.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 185.0-186.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 186.0-187.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 187.0-188.0 sec    839 MBytes  7.03 Gbits/sec

[  4] 188.0-189.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 189.0-190.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 190.0-191.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 191.0-192.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 192.0-193.0 sec    839 MBytes  7.03 Gbits/sec

[  4] 193.0-194.0 sec    839 MBytes  7.03 Gbits/sec

[  4] 194.0-195.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 195.0-196.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 196.0-197.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 197.0-198.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 198.0-199.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 199.0-200.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 200.0-201.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 201.0-202.0 sec    839 MBytes  7.03 Gbits/sec

[  4] 202.0-203.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 203.0-204.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 204.0-205.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 205.0-206.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 206.0-207.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 207.0-208.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 208.0-209.0 sec    836 MBytes  7.02 Gbits/sec

[  4] 209.0-210.0 sec    836 MBytes  7.02 Gbits/sec

[  4] 210.0-211.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 211.0-212.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 212.0-213.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 213.0-214.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 214.0-215.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 215.0-216.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 216.0-217.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 217.0-218.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 218.0-219.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 219.0-220.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 220.0-221.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 221.0-222.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 222.0-223.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 223.0-224.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 224.0-225.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 225.0-226.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 226.0-227.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 227.0-228.0 sec    839 MBytes  7.03 Gbits/sec

[  4] 228.0-229.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 229.0-230.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 230.0-231.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 231.0-232.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 232.0-233.0 sec    839 MBytes  7.03 Gbits/sec

[  4] 233.0-234.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 234.0-235.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 235.0-236.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 236.0-237.0 sec    840 MBytes  7.04 Gbits/sec

[  4] 237.0-238.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 238.0-239.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 239.0-240.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 240.0-241.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 241.0-242.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 242.0-243.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 243.0-244.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 244.0-245.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 245.0-246.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 246.0-247.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 247.0-248.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 248.0-249.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 249.0-250.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 250.0-251.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 251.0-252.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 252.0-253.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 253.0-254.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 254.0-255.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 255.0-256.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 256.0-257.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 257.0-258.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 258.0-259.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 259.0-260.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 260.0-261.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 261.0-262.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 262.0-263.0 sec    839 MBytes  7.03 Gbits/sec

[  4] 263.0-264.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 264.0-265.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 265.0-266.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 266.0-267.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 267.0-268.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 268.0-269.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 269.0-270.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 270.0-271.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 271.0-272.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 272.0-273.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 273.0-274.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 274.0-275.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 275.0-276.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 276.0-277.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 277.0-278.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 278.0-279.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 279.0-280.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 280.0-281.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 281.0-282.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 282.0-283.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 283.0-284.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 284.0-285.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 285.0-286.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 286.0-287.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 287.0-288.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 288.0-289.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 289.0-290.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 290.0-291.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 291.0-292.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 292.0-293.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 293.0-294.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 294.0-295.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 295.0-296.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 296.0-297.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 297.0-298.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 298.0-299.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 299.0-300.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 300.0-301.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 301.0-302.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 302.0-303.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 303.0-304.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 304.0-305.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 305.0-306.0 sec    837 MBytes  7.03 Gbits/sec

[  4] 306.0-307.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 307.0-308.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 308.0-309.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 309.0-310.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 310.0-311.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 311.0-312.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 312.0-313.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 313.0-314.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 314.0-315.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 315.0-316.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 316.0-317.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 317.0-318.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 318.0-319.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 319.0-320.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 320.0-321.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 321.0-322.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 322.0-323.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 323.0-324.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 324.0-325.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 325.0-326.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 326.0-327.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 327.0-328.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 328.0-329.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 329.0-330.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 330.0-331.0 sec    837 MBytes  7.03 Gbits/sec

[  4] 331.0-332.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 332.0-333.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 333.0-334.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 334.0-335.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 335.0-336.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 336.0-337.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 337.0-338.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 338.0-339.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 339.0-340.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 340.0-341.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 341.0-342.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 342.0-343.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 343.0-344.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 344.0-345.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 345.0-346.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 346.0-347.0 sec    837 MBytes  7.03 Gbits/sec

[  4] 347.0-348.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 348.0-349.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 349.0-350.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 350.0-351.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 351.0-352.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 352.0-353.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 353.0-354.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 354.0-355.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 355.0-356.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 356.0-357.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 357.0-358.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 358.0-359.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 359.0-360.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 360.0-361.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 361.0-362.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 362.0-363.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 363.0-364.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 364.0-365.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 365.0-366.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 366.0-367.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 367.0-368.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 368.0-369.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 369.0-370.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 370.0-371.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 371.0-372.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 372.0-373.0 sec    836 MBytes  7.02 Gbits/sec

[  4] 373.0-374.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 374.0-375.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 375.0-376.0 sec    836 MBytes  7.02 Gbits/sec

[  4] 376.0-377.0 sec    836 MBytes  7.02 Gbits/sec

[  4] 377.0-378.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 378.0-379.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 379.0-380.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 380.0-381.0 sec    836 MBytes  7.02 Gbits/sec

[  4] 381.0-382.0 sec    836 MBytes  7.02 Gbits/sec

[  4] 382.0-383.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 383.0-384.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 384.0-385.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 385.0-386.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 386.0-387.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 387.0-388.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 388.0-389.0 sec    836 MBytes  7.02 Gbits/sec

[  4] 389.0-390.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 390.0-391.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 391.0-392.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 392.0-393.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 393.0-394.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 394.0-395.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 395.0-396.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 396.0-397.0 sec    836 MBytes  7.02 Gbits/sec

[  4] 397.0-398.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 398.0-399.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 399.0-400.0 sec    836 MBytes  7.02 Gbits/sec

[  4] 400.0-401.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 401.0-402.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 402.0-403.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 403.0-404.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 404.0-405.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 405.0-406.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 406.0-407.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 407.0-408.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 408.0-409.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 409.0-410.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 410.0-411.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 411.0-412.0 sec    836 MBytes  7.02 Gbits/sec

[  4] 412.0-413.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 413.0-414.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 414.0-415.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 415.0-416.0 sec    836 MBytes  7.02 Gbits/sec

[  4] 416.0-417.0 sec    836 MBytes  7.02 Gbits/sec

[  4] 417.0-418.0 sec    838 MBytes  7.03 Gbits/sec

[  4] 418.0-419.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 419.0-420.0 sec    840 MBytes  7.04 Gbits/sec

[  4] 420.0-421.0 sec    843 MBytes  7.07 Gbits/sec

[  4] 421.0-422.0 sec    841 MBytes  7.06 Gbits/sec

[  4] 422.0-423.0 sec    842 MBytes  7.07 Gbits/sec

[  4] 423.0-424.0 sec    840 MBytes  7.04 Gbits/sec

[  4] 424.0-425.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 425.0-426.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 426.0-427.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 427.0-428.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 428.0-429.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 429.0-430.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 430.0-431.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 431.0-432.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 432.0-433.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 433.0-434.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 434.0-435.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 435.0-436.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 436.0-437.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 437.0-438.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 438.0-439.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 439.0-440.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 440.0-441.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 441.0-442.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 442.0-443.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 443.0-444.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 444.0-445.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 445.0-446.0 sec    834 MBytes  7.00 Gbits/sec

[  4] 446.0-447.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 447.0-448.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 448.0-449.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 449.0-450.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 450.0-451.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 451.0-452.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 452.0-453.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 453.0-454.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 454.0-455.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 455.0-456.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 456.0-457.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 457.0-458.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 458.0-459.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 459.0-460.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 460.0-461.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 461.0-462.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 462.0-463.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 463.0-464.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 464.0-465.0 sec    836 MBytes  7.02 Gbits/sec

[  4] 465.0-466.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 466.0-467.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 467.0-468.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 468.0-469.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 469.0-470.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 470.0-471.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 471.0-472.0 sec    836 MBytes  7.02 Gbits/sec

[  4] 472.0-473.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 473.0-474.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 474.0-475.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 475.0-476.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 476.0-477.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 477.0-478.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 478.0-479.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 479.0-480.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 480.0-481.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 481.0-482.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 482.0-483.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 483.0-484.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 484.0-485.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 485.0-486.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 486.0-487.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 487.0-488.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 488.0-489.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 489.0-490.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 490.0-491.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 491.0-492.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 492.0-493.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 493.0-494.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 494.0-495.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 495.0-496.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 496.0-497.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 497.0-498.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 498.0-499.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 499.0-500.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 500.0-501.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 501.0-502.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 502.0-503.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 503.0-504.0 sec    836 MBytes  7.02 Gbits/sec

[  4] 504.0-505.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 505.0-506.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 506.0-507.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 507.0-508.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 508.0-509.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 509.0-510.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 510.0-511.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 511.0-512.0 sec    836 MBytes  7.02 Gbits/sec

[  4] 512.0-513.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 513.0-514.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 514.0-515.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 515.0-516.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 516.0-517.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 517.0-518.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 518.0-519.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 519.0-520.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 520.0-521.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 521.0-522.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 522.0-523.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 523.0-524.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 524.0-525.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 525.0-526.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 526.0-527.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 527.0-528.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 528.0-529.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 529.0-530.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 530.0-531.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 531.0-532.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 532.0-533.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 533.0-534.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 534.0-535.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 535.0-536.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 536.0-537.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 537.0-538.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 538.0-539.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 539.0-540.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 540.0-541.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 541.0-542.0 sec    836 MBytes  7.02 Gbits/sec

[  4] 542.0-543.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 543.0-544.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 544.0-545.0 sec    836 MBytes  7.02 Gbits/sec

[  4] 545.0-546.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 546.0-547.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 547.0-548.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 548.0-549.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 549.0-550.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 550.0-551.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 551.0-552.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 552.0-553.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 553.0-554.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 554.0-555.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 555.0-556.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 556.0-557.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 557.0-558.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 558.0-559.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 559.0-560.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 560.0-561.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 561.0-562.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 562.0-563.0 sec    835 MBytes  7.00 Gbits/sec

[  4] 563.0-564.0 sec    835 MBytes  7.00 Gbits/sec

[  4] 564.0-565.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 565.0-566.0 sec    835 MBytes  7.00 Gbits/sec

[  4] 566.0-567.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 567.0-568.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 568.0-569.0 sec    835 MBytes  7.00 Gbits/sec

[  4] 569.0-570.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 570.0-571.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 571.0-572.0 sec    835 MBytes  7.00 Gbits/sec

[  4] 572.0-573.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 573.0-574.0 sec    835 MBytes  7.00 Gbits/sec

[  4] 574.0-575.0 sec    834 MBytes  7.00 Gbits/sec

[  4] 575.0-576.0 sec    835 MBytes  7.00 Gbits/sec

[  4] 576.0-577.0 sec    834 MBytes  7.00 Gbits/sec

[  4] 577.0-578.0 sec    835 MBytes  7.00 Gbits/sec

[  4] 578.0-579.0 sec    834 MBytes  7.00 Gbits/sec

[  4] 579.0-580.0 sec    834 MBytes  7.00 Gbits/sec

[  4] 580.0-581.0 sec    835 MBytes  7.00 Gbits/sec

[  4] 581.0-582.0 sec    834 MBytes  7.00 Gbits/sec

[  4] 582.0-583.0 sec    834 MBytes  6.99 Gbits/sec

[  4] 583.0-584.0 sec    835 MBytes  7.00 Gbits/sec

[  4] 584.0-585.0 sec    835 MBytes  7.00 Gbits/sec

[  4] 585.0-586.0 sec    834 MBytes  7.00 Gbits/sec

[  4] 586.0-587.0 sec    835 MBytes  7.00 Gbits/sec

[  4] 587.0-588.0 sec    835 MBytes  7.00 Gbits/sec

[  4] 588.0-589.0 sec    835 MBytes  7.00 Gbits/sec

[  4] 589.0-590.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 590.0-591.0 sec    836 MBytes  7.01 Gbits/sec

[  4] 591.0-592.0 sec    835 MBytes  7.00 Gbits/sec

[  4] 592.0-593.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 593.0-594.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 594.0-595.0 sec    834 MBytes  7.00 Gbits/sec

[  4] 595.0-596.0 sec    835 MBytes  7.00 Gbits/sec

[  4] 596.0-597.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 597.0-598.0 sec    834 MBytes  7.00 Gbits/sec

[  4] 598.0-599.0 sec    835 MBytes  7.00 Gbits/sec

[  4] 599.0-600.0 sec    835 MBytes  7.00 Gbits/sec

[  4] 600.0-601.0 sec    835 MBytes  7.00 Gbits/sec

[  4] 601.0-602.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 602.0-603.0 sec    835 MBytes  7.00 Gbits/sec

[  4] 603.0-604.0 sec    841 MBytes  7.06 Gbits/sec

[  4] 604.0-605.0 sec    840 MBytes  7.04 Gbits/sec

[  4] 605.0-606.0 sec    837 MBytes  7.02 Gbits/sec

[  4] 606.0-607.0 sec    840 MBytes  7.05 Gbits/sec

[  4] 607.0-608.0 sec    839 MBytes  7.04 Gbits/sec

[  4] 608.0-609.0 sec    844 MBytes  7.08 Gbits/sec

[  4] 609.0-610.0 sec    835 MBytes  7.01 Gbits/sec

[  4] 610.0-611.0 sec    843 MBytes  7.07 Gbits/sec

[  4] 611.0-612.0 sec    834 MBytes  7.00 Gbits/sec

[  4] 612.0-613.0 sec    834 MBytes  7.00 Gbits/sec

[  4] 613.0-614.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 614.0-615.0 sec    834 MBytes  6.99 Gbits/sec

[  4] 615.0-616.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 616.0-617.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 617.0-618.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 618.0-619.0 sec    832 MBytes  6.98 Gbits/sec

[  4] 619.0-620.0 sec    832 MBytes  6.98 Gbits/sec

[  4] 620.0-621.0 sec    833 MBytes  6.98 Gbits/sec

[  4] 621.0-622.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 622.0-623.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 623.0-624.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 624.0-625.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 625.0-626.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 626.0-627.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 627.0-628.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 628.0-629.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 629.0-630.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 630.0-631.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 631.0-632.0 sec    834 MBytes  6.99 Gbits/sec

[  4] 632.0-633.0 sec    834 MBytes  6.99 Gbits/sec

[  4] 633.0-634.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 634.0-635.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 635.0-636.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 636.0-637.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 637.0-638.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 638.0-639.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 639.0-640.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 640.0-641.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 641.0-642.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 642.0-643.0 sec    834 MBytes  6.99 Gbits/sec

[  4] 643.0-644.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 644.0-645.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 645.0-646.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 646.0-647.0 sec    834 MBytes  6.99 Gbits/sec

[  4] 647.0-648.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 648.0-649.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 649.0-650.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 650.0-651.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 651.0-652.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 652.0-653.0 sec    833 MBytes  6.98 Gbits/sec

[  4] 653.0-654.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 654.0-655.0 sec    833 MBytes  6.98 Gbits/sec

[  4] 655.0-656.0 sec    834 MBytes  6.99 Gbits/sec

[  4] 656.0-657.0 sec    834 MBytes  6.99 Gbits/sec

[  4] 657.0-658.0 sec    834 MBytes  6.99 Gbits/sec

[  4] 658.0-659.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 659.0-660.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 660.0-661.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 661.0-662.0 sec    832 MBytes  6.98 Gbits/sec

[  4] 662.0-663.0 sec    833 MBytes  6.98 Gbits/sec

[  4] 663.0-664.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 664.0-665.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 665.0-666.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 666.0-667.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 667.0-668.0 sec    834 MBytes  6.99 Gbits/sec

[  4] 668.0-669.0 sec    834 MBytes  6.99 Gbits/sec

[  4] 669.0-670.0 sec    834 MBytes  6.99 Gbits/sec

[  4] 670.0-671.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 671.0-672.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 672.0-673.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 673.0-674.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 674.0-675.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 675.0-676.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 676.0-677.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 677.0-678.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 678.0-679.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 679.0-680.0 sec    834 MBytes  6.99 Gbits/sec

[  4] 680.0-681.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 681.0-682.0 sec    834 MBytes  6.99 Gbits/sec

[  4] 682.0-683.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 683.0-684.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 684.0-685.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 685.0-686.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 686.0-687.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 687.0-688.0 sec    834 MBytes  6.99 Gbits/sec

[  4] 688.0-689.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 689.0-690.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 690.0-691.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 691.0-692.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 692.0-693.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 693.0-694.0 sec    834 MBytes  6.99 Gbits/sec

[  4] 694.0-695.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 695.0-696.0 sec    834 MBytes  7.00 Gbits/sec

[  4] 696.0-697.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 697.0-698.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 698.0-699.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 699.0-700.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 700.0-701.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 701.0-702.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 702.0-703.0 sec    834 MBytes  6.99 Gbits/sec

[  4] 703.0-704.0 sec    834 MBytes  6.99 Gbits/sec

[  4] 704.0-705.0 sec    834 MBytes  6.99 Gbits/sec

[  4] 705.0-706.0 sec    834 MBytes  6.99 Gbits/sec

[  4] 706.0-707.0 sec    834 MBytes  6.99 Gbits/sec

[  4] 707.0-708.0 sec    834 MBytes  6.99 Gbits/sec

[  4] 708.0-709.0 sec    834 MBytes  6.99 Gbits/sec

[  4] 709.0-710.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 710.0-711.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 711.0-712.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 712.0-713.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 713.0-714.0 sec    832 MBytes  6.98 Gbits/sec

[  4] 714.0-715.0 sec    833 MBytes  6.98 Gbits/sec

[  4] 715.0-716.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 716.0-717.0 sec    833 MBytes  6.98 Gbits/sec

[  4] 717.0-718.0 sec    832 MBytes  6.98 Gbits/sec

[  4] 718.0-719.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 719.0-720.0 sec    832 MBytes  6.98 Gbits/sec

[  4] 720.0-721.0 sec    832 MBytes  6.98 Gbits/sec

[  4] 721.0-722.0 sec    829 MBytes  6.96 Gbits/sec

[  4] 722.0-723.0 sec    832 MBytes  6.98 Gbits/sec

[  4] 723.0-724.0 sec    833 MBytes  6.98 Gbits/sec

[  4] 724.0-725.0 sec    832 MBytes  6.98 Gbits/sec

[  4] 725.0-726.0 sec    832 MBytes  6.98 Gbits/sec

[  4] 726.0-727.0 sec    832 MBytes  6.98 Gbits/sec

[  4] 727.0-728.0 sec    833 MBytes  6.98 Gbits/sec

[  4] 728.0-729.0 sec    832 MBytes  6.98 Gbits/sec

[  4] 729.0-730.0 sec    832 MBytes  6.98 Gbits/sec

[  4] 730.0-731.0 sec    832 MBytes  6.98 Gbits/sec

[  4] 731.0-732.0 sec    832 MBytes  6.98 Gbits/sec

[  4] 732.0-733.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 733.0-734.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 734.0-735.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 735.0-736.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 736.0-737.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 737.0-738.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 738.0-739.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 739.0-740.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 740.0-741.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 741.0-742.0 sec    833 MBytes  6.98 Gbits/sec

[  4] 742.0-743.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 743.0-744.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 744.0-745.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 745.0-746.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 746.0-747.0 sec    833 MBytes  6.99 Gbits/sec

[  4] 747.0-748.0 sec    832 MBytes  6.98 Gbits/sec

[  4] 748.0-749.0 sec    832 MBytes  6.98 Gbits/sec

[  4] 749.0-750.0 sec    832 MBytes  6.98 Gbits/sec

Total : 6.95 Gbits/sec

 

 

Note: Total is calculated by the script below

 

 

#!/usr/bin/perl

 

$time = 0;

$sum = 0.0;

while($line=<STDIN>){

        $sec_string = "$time.0-";

        chomp $line;

        if (index($line, $sec_string) >= 0){

                if ($line =~ /([0-9\.]+) bits/){

                        $mbps = $1 * 0.000001;

                        print "$mbps\n";

                }

                if ($line =~ /([0-9\.]+) Kbits/){

                        $mbps = $1 * 0.001;

                        print "$mbps\n";

                }

                if ($line =~ /([0-9\.]+) Mbits/){

                        $mbps = $1 * 1;

                        print "$mbps\n";

                }

                if ($line =~ /([0-9\.]+) Gbits/){

                        $mbps = $1 * 1000.0;

                        print "$mbps\n";

                }

 

                $time ++;

                            $sum += $mbps;

        }else {

                            print "error\n";

              }

}

print $sum . "/" . $time . "=" . ($sum/$time) . "\n";

 

 


 

Appendix B.  Output of tracert

 

traceroute to opteron6c-v6 (2001:200:0:1cf0::12) from 2001:200:0:1cf3::12, 30 hops max, 24 byte packets

 1  gs4k-ams-655-v6 (2001:200:0:1cf3::1)  148.67 ms  147.81 ms  147.884 ms

 2  gs4k-chi-359-v6 (2001:200:0:1cf2::1)  252.221 ms  252.089 ms  269.133 ms

 3  ni40g-t-lex-3300-v6 (2001:200:0:1cf1::1)  411.596 ms  411.602 ms  411.592 ms

 4  opteron6c-v6 (2001:200:0:1cf0::12)  500.298 ms  500.319 ms  500.311 ms

 

 

 

 

traceroute to opteron9c-v6 (2001:200:0:1cf3::12) from 2001:200:0:1cf0:207:43ff:fe00:1521, 30 hops max, 24 byte packets

 1  ni40g-t-lex-654-v6 (2001:200:0:1cf0::1)  88.919 ms  88.89 ms  88.883 ms

 2  gs4k-chi-3300-v6 (2001:200:0:1cf1::3)  253.371 ms  252.524 ms  252.516 ms

 3  gs4k-ams-359-v6 (2001:200:0:1cf2::2)  1642.14 ms  356.672 ms  356.665 ms

 4  opteron9c-v6 (2001:200:0:1cf3::12)  500.321 ms  500.319 ms  500.323 ms

 


 

 

 

                           Figure 1.  Network topology

 

Figure 2.  Address assignment

                    Figure 3.  Network routes on the map

 

 

                  Figure 4. Calculation of the distance

 

 

 

               Figure 5.   MRTG graphs along the network path