rank = 1 hostname = woogie Iter = 4240 / 100000, Current rate: 3.24 Mbit/sec (for 20.4secs), Average rate: 3.24 Mbit/sec (for 20.4secs) Iter = 8390 / 100000, Current rate: 0.83 Mbit/sec (for 77.8secs), Average rate: 1.33 Mbit/sec (for 98.3secs) Iter = 9457 / 100000, Current rate: 0.31 Mbit/sec (for 53.5secs), Average rate: 0.97 Mbit/sec (for 151.8secs) Iter = 9919 / 100000, Current rate: 0.33 Mbit/sec (for 21.9secs), Average rate: 0.89 Mbit/sec (for 173.7secs) Iter = 10419 / 100000, Current rate: 0.36 Mbit/sec (for 21.7secs), Average rate: 0.83 Mbit/sec (for 195.4secs) Iter = 10880 / 100000, Current rate: 0.36 Mbit/sec (for 20.2secs), Average rate: 0.79 Mbit/sec (for 215.5secs) Iter = 11338 / 100000, Current rate: 0.34 Mbit/sec (for 21.1secs), Average rate: 0.75 Mbit/sec (for 236.6secs) Iter = 11773 / 100000, Current rate: 0.31 Mbit/sec (for 22.1secs), Average rate: 0.71 Mbit/sec (for 258.7secs) Iter = 12168 / 100000, Current rate: 0.27 Mbit/sec (for 23.0secs), Average rate: 0.67 Mbit/sec (for 281.7secs) Iter = 12541 / 100000, Current rate: 0.29 Mbit/sec (for 20.4secs), Average rate: 0.65 Mbit/sec (for 302.1secs) Iter = 12915 / 100000, Current rate: 0.28 Mbit/sec (for 21.1secs), Average rate: 0.62 Mbit/sec (for 323.1secs) Iter = 13290 / 100000, Current rate: 0.27 Mbit/sec (for 21.6secs), Average rate: 0.60 Mbit/sec (for 344.8secs) Iter = 13664 / 100000, Current rate: 0.26 Mbit/sec (for 22.3secs), Average rate: 0.58 Mbit/sec (for 367.1secs) Iter = 14039 / 100000, Current rate: 0.26 Mbit/sec (for 23.0secs), Average rate: 0.56 Mbit/sec (for 390.1secs) Iter = 14413 / 100000, Current rate: 0.25 Mbit/sec (for 23.5secs), Average rate: 0.54 Mbit/sec (for 413.6secs) Iter = 14731 / 100000, Current rate: 0.25 Mbit/sec (for 20.2secs), Average rate: 0.53 Mbit/sec (for 433.8secs) Iter = 15047 / 100000, Current rate: 0.24 Mbit/sec (for 20.6secs), Average rate: 0.52 Mbit/sec (for 454.4secs) Iter = 15355 / 100000, Current rate: 0.23 Mbit/sec (for 21.0secs), Average rate: 0.50 Mbit/sec (for 475.3secs) Iter = 15661 / 100000, Current rate: 0.22 Mbit/sec (for 21.4secs), Average rate: 0.49 Mbit/sec (for 496.7secs) Iter = 15973 / 100000, Current rate: 0.22 Mbit/sec (for 21.8secs), Average rate: 0.48 Mbit/sec (for 518.5secs) Iter = 16286 / 100000, Current rate: 0.22 Mbit/sec (for 22.3secs), Average rate: 0.47 Mbit/sec (for 540.8secs) Iter = 16598 / 100000, Current rate: 0.21 Mbit/sec (for 22.7secs), Average rate: 0.46 Mbit/sec (for 563.5secs) Iter = 16910 / 100000, Current rate: 0.21 Mbit/sec (for 23.1secs), Average rate: 0.45 Mbit/sec (for 586.5secs) Iter = 17222 / 100000, Current rate: 0.21 Mbit/sec (for 23.5secs), Average rate: 0.44 Mbit/sec (for 610.0secs) Iter = 17534 / 100000, Current rate: 0.20 Mbit/sec (for 23.9secs), Average rate: 0.43 Mbit/sec (for 633.9secs) Iter = 17846 / 100000, Current rate: 0.20 Mbit/sec (for 24.3secs), Average rate: 0.42 Mbit/sec (for 658.2secs) Iter = 18158 / 100000, Current rate: 0.19 Mbit/sec (for 25.2secs), Average rate: 0.42 Mbit/sec (for 683.4secs) Iter = 18408 / 100000, Current rate: 0.18 Mbit/sec (for 22.0secs), Average rate: 0.41 Mbit/sec (for 705.4secs) Iter = 18657 / 100000, Current rate: 0.17 Mbit/sec (for 23.4secs), Average rate: 0.40 Mbit/sec (for 728.9secs) ========================================== MPI_Send Recognized error rank - 1 iter = 18907, fail: ------------------------------------------ ErrorCode: 0x2C09AE0F ErrorString: Other MPI error, error stack: MPI_Send(173)..............: MPI_Send(buf=0x1962930, count=2048, MPI_CHAR, dest=0, tag=50, MPI_COMM_WORLD) failed MPID_nem_tcp_connpoll(1827): Communication error with rank 0: Connection reset by peer ==========================================