Network Characterization Tests

Bandwidth testing: All tests are an average of five runs

File Size used: 260 MBytes

Local to Local Tests

umich-umich (MBytes/second) (Depot was configured to receive max 64 threads. The figure values increase to the 90's once we reconfigure depot with 120 threads)

• Umich-Umich (MBytes/second)

1	Thread	70.652
10	Threads	82.114
20	Threads	82.582
40	Threads	85.216
60	Threads	81.658
100	Threads	75.644

---

• caltech-caltech (MBytes/second)

1	Thread	81.321
10	Threads	100.08
20	Threads	99.690
40	Threads	99.160
60	Threads	98.820
100	Threads	97.260

---

• Fermi-Fermi (MBytes/second)

1	Threads	74.200
10	Threads	95.870
20	Threads	95.553
40	Threads	93.290
60	Threads	91.872
100	Threads	90.940

Over the Network Tests

• UMich to Fermi

1	Thread	8.580 MB/s
10	Threads	66.290 MB/s
20	Threads	68.820 MB/s
40	Threads	66.84 MB/s
60	Threads	67.45 MB/s
100	Threads	66.81 MB/s

---

• Umich to Fermi to 4 depots

10	Threads	69.22 MB/s
20	Threads	68.89 MB/s
40	Threads	68.24 MB/s

These numbers probably are limitations on the lors_upload ability to pump out data: 1 or 4 target depots see same throughput.

---

• Fermi to Caltech

1	Thread	0.83MB/s
10	Threads	7.04MB/s
20	Threads	6.95 MB/s
40	Threads	7.06 MB/s

---

• UMich to Caltech

1	Thread	.75 MB/s
10	Threads	6.37 MB/s
20	Threads	6.35 MB/s
40	Threads	6.40 MB/s

---

Large file transfer...1.7GB (Only doing this on relatively fast sites)

• Umich to Fermi

1	Thread	8.74 MB/s
10	Threads	49.46 MB/s
20	Threads	49.43 MB/s
40	Threads	49.4 MB/s

---

Capricorn Test

• Capricorn-ibp.accre

1	Thread	24.89 MB/s
10	Threads	28.63 MB/s
20	Threads	28.44 MB/s
40	Threads	26.74 MB/s
60	Threads	27.51 MB/s
100	Threads	27.37 MB/s

---

iperf testing between caltech and michigan

• caltech-depot01.ultralight.org to umich-depot01.ultralight.org

1	Thread	0.93 MB/s
10	Threads	10.4 MB/s
20	Threads	21.0 MB/s
40	Threads	42.4 MB/s
60	Threads	63.4 MB/s
100	Threads	105.0 MB/s

---

• umich-depot01.ultralight.org to caltech-depot01.ultralight.org

1	Thread	0.93, 0.94 MB/s
10	Threads	10.3, 10.7 MB/s
20	Threads	20.8, 20.9, 20.6 MB/s
40	Threads	11.4, 28.7, 7.02, 20.4 * MB/s
60	Threads	10.4, 35.3, 11.6, 43.5 ** MB/s
100	Threads	58.4, 23.8, 14.1, 22.4 ** MB/s

This table shows results of individual trials rather than an average to the show 
behavior of this connection.

* = Erratic iperf results, some of the threads die before the test completes, 
    bandwidth varies greatly from trial to trial.
** = Same as above plus the test fails to complete some of the time.

---

Vandy Caltech client (ultralight) IBP depot (Non-Ultralight) Test Results

• Vandy Ultralight-caltech-depot01

1	Thread	0.78 MB/s
10	Threads	6.51 MB/s
20	Threads	6.61 MB/s
40	Threads	6.69 MB/s
60	Threads	6.48 MB/s
100	Threads	6.62 MB/s

---

---

Vandy Caltech Ultralight Test Results

• Vandy Ultralight-caltech-depot02

1	Thread	0.72 MB/s
10	Threads	6.37 MB/s
20	Threads	6.34 MB/s
40	Threads	6.44 MB/s
60	Threads	6.49 MB/s
100	Threads	4.40 MB/s

---

Vandy Caltech Ultralight Test Results

• Vandy Non-Ultralight-caltech-depot02 (IBP depot with ultralight kernel on it)

1	Thread	0.77 MB/s
10	Threads	6.51 MB/s
20	Threads	6.62 MB/s
40	Threads	6.69 MB/s
60	Threads	6.67 MB/s
100	Threads	6.51 MB/s

---

Vandy Caltech client (non-ultralight) IBP Depot (non-Ultralight) Test Results

• Vandy Non-Ultralight-caltech-depot01 (non ultralight IBP depot)

1	Thread	0.78 MB/s
10	Threads	6.58 MB/s
20	Threads	6.72 MB/s
40	Threads	6.69 MB/s
60	Threads	6.63 MB/s
100	Threads	6.49 MB/s

---