Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.803792197s FAIL (2025-10-02 08:31:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.803846191s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 6.123124102s FAIL (2025-10-02 08:30:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.123159929s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 6.21572348s FAIL (2025-10-02 08:29:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.215756313s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 7.898584146s FAIL (2025-10-02 08:28:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 7.898618832s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 6.062225343s FAIL (2025-10-02 08:27:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.062258565s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 6.066775355s FAIL (2025-10-02 08:27:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.066809548s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.810973393s FAIL (2025-10-02 08:26:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.811008069s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.964129616s FAIL (2025-10-02 08:25:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.964162608s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 6.069228215s FAIL (2025-10-02 08:24:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.069257409s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 6.026053842s FAIL (2025-10-02 08:23:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.026084542s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.76679209s FAIL (2025-10-02 08:22:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.766827689s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 6.069648296s FAIL (2025-10-02 08:22:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.0696868s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 6.031123807s FAIL (2025-10-02 08:21:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.031159685s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 6.038330833s FAIL (2025-10-02 08:21:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.038369125s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.728141393s FAIL (2025-10-02 08:20:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.728171381s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 6.068483389s FAIL (2025-10-02 08:20:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.06851565s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 6.064687963s FAIL (2025-10-02 08:19:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.06471253s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 6.257014066s FAIL (2025-10-02 08:19:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.257045696s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.897693374s FAIL (2025-10-02 08:19:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.897727218s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 6.066849688s FAIL (2025-10-02 08:18:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.066883281s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 6.05196742s FAIL (2025-10-02 08:16:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.051993149s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.824981577s FAIL (2025-10-02 08:15:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.825019658s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.973137363s FAIL (2025-10-02 08:15:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.973246761s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 6.004147343s FAIL (2025-10-02 08:14:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.004176678s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 6.078436102s FAIL (2025-10-02 08:13:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.07847162s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.144083575s FAIL (2025-10-02 08:13:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.144114685s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 6.074476301s FAIL (2025-10-02 08:11:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.074542869s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.843042563s FAIL (2025-10-02 08:10:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.843075316s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.962538151s FAIL (2025-10-02 08:09:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.962574199s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.966711479s FAIL (2025-10-02 08:08:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.966743399s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.791318185s FAIL (2025-10-02 08:07:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.791366669s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.934977857s FAIL (2025-10-02 08:06:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.935014445s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.257912405s FAIL (2025-10-02 08:06:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 30.257985554s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.709220107s FAIL (2025-10-02 07:29:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.70933201s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.293618996s FAIL (2025-10-02 07:29:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 2 06:45:01.165728558 (209h13m46.627821051s) [upload=183988]: Got next segment. Inline: false Oct 2 06:45:01.165773403 (209h13m46.627865886s) [upload=183988]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 2 06:45:01.165780918 (209h13m46.627873401s) [upload=183988]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 06:45:01.431617535 (209h13m46.893710028s) [seg_pos={0 0}, upload=183988]: Begin upload segment... Oct 2 06:45:01.431697767 (209h13m46.89379025s) [seg_pos={0 0}, upload=183988]: Done begin upload segment. Oct 2 06:45:01.431733565 (209h13m46.893826048s) [noise=true , address=45.91.116.11:4118 , piece_id=KBHSEEDCAKKH76W7FBETEES4UXAMTTA2AQAHETDNJ6ZND73X2OGQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.431781507 (209h13m46.89387399s) [noise=true , address=45.91.116.6:4975 , piece_id=ZNB45P2Q3Q3LUS3DG4FPV5IHHBGSCE5VBCXCW3HFL56GN6EKO7JQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.432603612 (209h13m46.894696095s) [noise=true , address=45.91.116.5:4299 , piece_id=2YUDNHDTW3DDWZJPHUV4AHHAO6GJI3TVUKMXO3JDBDIG3YB5XLEA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.433107522 (209h13m46.895199995s) [noise=true , address=145.79.227.16:4909 , piece_id=DVOXCRCAGC43BIDHGJOGQBZLDM4QBUONXGWF3GVVUZ4V5YSC6NOA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.433549994 (209h13m46.895642477s) [noise=true , address=77.90.31.11:4554 , piece_id=J5OKH5FR5YIBUZEN55CPSKDJ7L3O7PGF5VDS2X3C7CGTBCXUEVUA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.434770508 (209h13m46.896862991s) [noise=true , address=45.91.116.8:4047 , piece_id=ZSWJVTA7HW7U2IHRKGKDUHNYCCSMK3YJ3KJBQLOIQ773XCGLWV3Q, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.435293313 (209h13m46.897385796s) [noise=true , address=77.90.31.21:4878 , piece_id=6S3KSKZN7QKWQCSAOJHVNCLET7JBWPZIRNFQI2SX3UKDMT732KLA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.435758981 (209h13m46.897851464s) [noise=true , address=77.90.31.12:4589 , piece_id=OVKIKUBOCPLT3VJVV4ML6QIQLGOA2S4AIBUUR5IYKAUE2IQVUDGA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.436566698 (209h13m46.898659182s) [noise=true , address=145.79.227.2:4115 , piece_id=DZADXAOVVZSNVIMHVE5N7XA4U7Y2RS6U6JQLTC2X6YSWWSGVP6YQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.437037004 (209h13m46.899129487s) [noise=true , address=145.79.227.13:4801 , piece_id=ZL7KE3QVM63VCBNMAUEXELEERW2JC65RTCVUUQKYLFTEJZBZPRVA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.437501258 (209h13m46.899593741s) [noise=true , address=45.91.116.8:4048 , piece_id=FVQDCO7EYOYOAOORYY7DAQYIAXWBBDN7OF7E5B2Z3MT34QUGGLUQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.437998455 (209h13m46.900090938s) [noise=true , address=45.91.116.13:4155 , piece_id=JMRFSKD77UQKZXUZIFCQPAAVCNFDNGNV7U2SKSAJDOKARS6NKA5A, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.439162861 (209h13m46.901255345s) [noise=true , address=45.91.116.4:4939 , piece_id=MGTGITWIRGG53CWAY7276LOHSVJGACIAAMSISMKPZGJLECG52PLQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.439750080 (209h13m46.901842563s) [noise=true , address=45.91.116.12:4227 , piece_id=MGYI2TR4MPA6DKGFYIVMGTGLD5DO5BROGFCKWOP4Z4RNRWOSBPMQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.441380735 (209h13m46.903473208s) [noise=true , address=145.79.227.11:4730 , piece_id=QEESDYHFF4TTJ6DOW5BAXORGOSWAKLVFDUWMYZT5POSJ6J5D7IOA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.443563041 (209h13m46.905655524s) [noise=true , address=145.79.227.5:4221 , piece_id=SWGYPEIGFBLMMVAUFNIEQ63SL5SEDXFOCGIFCB7C7ZNCDYDZS7BQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:03.164025603 (209h13m48.626118096s) [upload=183988]: Next returned nil segment Oct 2 06:45:03.164074216 (209h13m48.626166699s) [upload=183988]: Waiting for error group managing segments... Oct 2 06:45:03.564517516 (209h13m49.026609999s) [noise=true , address=45.91.116.6:4975 , piece_id=ZNB45P2Q3Q3LUS3DG4FPV5IHHBGSCE5VBCXCW3HFL56GN6EKO7JQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.610247563 (209h13m49.072340046s) [noise=true , address=77.90.31.21:4878 , piece_id=6S3KSKZN7QKWQCSAOJHVNCLET7JBWPZIRNFQI2SX3UKDMT732KLA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.616241056 (209h13m49.078333549s) [noise=true , address=45.91.116.11:4118 , piece_id=KBHSEEDCAKKH76W7FBETEES4UXAMTTA2AQAHETDNJ6ZND73X2OGQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.632371971 (209h13m49.094464475s) [noise=true , address=77.90.31.12:4589 , piece_id=OVKIKUBOCPLT3VJVV4ML6QIQLGOA2S4AIBUUR5IYKAUE2IQVUDGA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.639558567 (209h13m49.10165105s) [noise=true , address=45.91.116.12:4227 , piece_id=MGYI2TR4MPA6DKGFYIVMGTGLD5DO5BROGFCKWOP4Z4RNRWOSBPMQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.649768408 (209h13m49.111860891s) [noise=true , address=77.90.31.11:4554 , piece_id=J5OKH5FR5YIBUZEN55CPSKDJ7L3O7PGF5VDS2X3C7CGTBCXUEVUA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.654368487 (209h13m49.11646099s) [noise=true , address=45.91.116.5:4299 , piece_id=2YUDNHDTW3DDWZJPHUV4AHHAO6GJI3TVUKMXO3JDBDIG3YB5XLEA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.688906413 (209h13m49.150998906s) [noise=true , address=45.91.116.4:4939 , piece_id=MGTGITWIRGG53CWAY7276LOHSVJGACIAAMSISMKPZGJLECG52PLQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.706565178 (209h13m49.168657671s) [noise=true , address=45.91.116.8:4047 , piece_id=ZSWJVTA7HW7U2IHRKGKDUHNYCCSMK3YJ3KJBQLOIQ773XCGLWV3Q, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.744669075 (209h13m49.206761558s) [noise=true , address=45.91.116.13:4155 , piece_id=JMRFSKD77UQKZXUZIFCQPAAVCNFDNGNV7U2SKSAJDOKARS6NKA5A, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.767094667 (209h13m49.22918715s) [noise=true , address=45.91.116.8:4048 , piece_id=FVQDCO7EYOYOAOORYY7DAQYIAXWBBDN7OF7E5B2Z3MT34QUGGLUQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:30.458020428 (209h14m15.920112912s) [noise=true , address=145.79.227.13:4801 , piece_id=ZL7KE3QVM63VCBNMAUEXELEERW2JC65RTCVUUQKYLFTEJZBZPRVA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:42996->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:42996->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42996->145.79.227.13:4801: use of closed network connection Oct 2 06:45:30.458236099 (209h14m15.920328572s) [noise=true , address=145.79.227.5:4221 , piece_id=SWGYPEIGFBLMMVAUFNIEQ63SL5SEDXFOCGIFCB7C7ZNCDYDZS7BQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:42060->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:42060->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42060->145.79.227.5:4221: use of closed network connection Oct 2 06:45:30.458311102 (209h14m15.920403585s) [noise=true , address=145.79.227.2:4115 , piece_id=DZADXAOVVZSNVIMHVE5N7XA4U7Y2RS6U6JQLTC2X6YSWWSGVP6YQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:55776->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:55776->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55776->145.79.227.2:4115: use of closed network connection Oct 2 06:45:30.458404109 (209h14m15.920496592s) [noise=true , address=145.79.227.11:4730 , piece_id=QEESDYHFF4TTJ6DOW5BAXORGOSWAKLVFDUWMYZT5POSJ6J5D7IOA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:47498->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:47498->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47498->145.79.227.11:4730: use of closed network connection Oct 2 06:45:30.458519669 (209h14m15.920612142s) [noise=true , address=145.79.227.16:4909 , piece_id=DVOXCRCAGC43BIDHGJOGQBZLDM4QBUONXGWF3GVVUZ4V5YSC6NOA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:36010->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:36010->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36010->145.79.227.16:4909: use of closed network connection Oct 2 06:45:30.458566669 (209h14m15.920659152s) [seg_pos={0 0}, upload=183988]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 2 06:45:30.710989853 (209h14m16.173082346s) [upload=183988]: Done uploading segments... Oct 2 06:45:30.711022285 (209h14m16.173114778s) [upload=183988]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 6.293643714s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.201047123s FAIL (2025-10-02 07:29:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 2 06:45:01.165728558 (209h13m46.627821051s) [upload=183988]: Got next segment. Inline: false Oct 2 06:45:01.165773403 (209h13m46.627865886s) [upload=183988]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 2 06:45:01.165780918 (209h13m46.627873401s) [upload=183988]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 06:45:01.431617535 (209h13m46.893710028s) [seg_pos={0 0}, upload=183988]: Begin upload segment... Oct 2 06:45:01.431697767 (209h13m46.89379025s) [seg_pos={0 0}, upload=183988]: Done begin upload segment. Oct 2 06:45:01.431733565 (209h13m46.893826048s) [noise=true , address=45.91.116.11:4118 , piece_id=KBHSEEDCAKKH76W7FBETEES4UXAMTTA2AQAHETDNJ6ZND73X2OGQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.431781507 (209h13m46.89387399s) [noise=true , address=45.91.116.6:4975 , piece_id=ZNB45P2Q3Q3LUS3DG4FPV5IHHBGSCE5VBCXCW3HFL56GN6EKO7JQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.432603612 (209h13m46.894696095s) [noise=true , address=45.91.116.5:4299 , piece_id=2YUDNHDTW3DDWZJPHUV4AHHAO6GJI3TVUKMXO3JDBDIG3YB5XLEA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.433107522 (209h13m46.895199995s) [noise=true , address=145.79.227.16:4909 , piece_id=DVOXCRCAGC43BIDHGJOGQBZLDM4QBUONXGWF3GVVUZ4V5YSC6NOA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.433549994 (209h13m46.895642477s) [noise=true , address=77.90.31.11:4554 , piece_id=J5OKH5FR5YIBUZEN55CPSKDJ7L3O7PGF5VDS2X3C7CGTBCXUEVUA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.434770508 (209h13m46.896862991s) [noise=true , address=45.91.116.8:4047 , piece_id=ZSWJVTA7HW7U2IHRKGKDUHNYCCSMK3YJ3KJBQLOIQ773XCGLWV3Q, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.435293313 (209h13m46.897385796s) [noise=true , address=77.90.31.21:4878 , piece_id=6S3KSKZN7QKWQCSAOJHVNCLET7JBWPZIRNFQI2SX3UKDMT732KLA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.435758981 (209h13m46.897851464s) [noise=true , address=77.90.31.12:4589 , piece_id=OVKIKUBOCPLT3VJVV4ML6QIQLGOA2S4AIBUUR5IYKAUE2IQVUDGA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.436566698 (209h13m46.898659182s) [noise=true , address=145.79.227.2:4115 , piece_id=DZADXAOVVZSNVIMHVE5N7XA4U7Y2RS6U6JQLTC2X6YSWWSGVP6YQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.437037004 (209h13m46.899129487s) [noise=true , address=145.79.227.13:4801 , piece_id=ZL7KE3QVM63VCBNMAUEXELEERW2JC65RTCVUUQKYLFTEJZBZPRVA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.437501258 (209h13m46.899593741s) [noise=true , address=45.91.116.8:4048 , piece_id=FVQDCO7EYOYOAOORYY7DAQYIAXWBBDN7OF7E5B2Z3MT34QUGGLUQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.437998455 (209h13m46.900090938s) [noise=true , address=45.91.116.13:4155 , piece_id=JMRFSKD77UQKZXUZIFCQPAAVCNFDNGNV7U2SKSAJDOKARS6NKA5A, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.439162861 (209h13m46.901255345s) [noise=true , address=45.91.116.4:4939 , piece_id=MGTGITWIRGG53CWAY7276LOHSVJGACIAAMSISMKPZGJLECG52PLQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.439750080 (209h13m46.901842563s) [noise=true , address=45.91.116.12:4227 , piece_id=MGYI2TR4MPA6DKGFYIVMGTGLD5DO5BROGFCKWOP4Z4RNRWOSBPMQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.441380735 (209h13m46.903473208s) [noise=true , address=145.79.227.11:4730 , piece_id=QEESDYHFF4TTJ6DOW5BAXORGOSWAKLVFDUWMYZT5POSJ6J5D7IOA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.443563041 (209h13m46.905655524s) [noise=true , address=145.79.227.5:4221 , piece_id=SWGYPEIGFBLMMVAUFNIEQ63SL5SEDXFOCGIFCB7C7ZNCDYDZS7BQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:03.164025603 (209h13m48.626118096s) [upload=183988]: Next returned nil segment Oct 2 06:45:03.164074216 (209h13m48.626166699s) [upload=183988]: Waiting for error group managing segments... Oct 2 06:45:03.564517516 (209h13m49.026609999s) [noise=true , address=45.91.116.6:4975 , piece_id=ZNB45P2Q3Q3LUS3DG4FPV5IHHBGSCE5VBCXCW3HFL56GN6EKO7JQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.610247563 (209h13m49.072340046s) [noise=true , address=77.90.31.21:4878 , piece_id=6S3KSKZN7QKWQCSAOJHVNCLET7JBWPZIRNFQI2SX3UKDMT732KLA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.616241056 (209h13m49.078333549s) [noise=true , address=45.91.116.11:4118 , piece_id=KBHSEEDCAKKH76W7FBETEES4UXAMTTA2AQAHETDNJ6ZND73X2OGQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.632371971 (209h13m49.094464475s) [noise=true , address=77.90.31.12:4589 , piece_id=OVKIKUBOCPLT3VJVV4ML6QIQLGOA2S4AIBUUR5IYKAUE2IQVUDGA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.639558567 (209h13m49.10165105s) [noise=true , address=45.91.116.12:4227 , piece_id=MGYI2TR4MPA6DKGFYIVMGTGLD5DO5BROGFCKWOP4Z4RNRWOSBPMQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.649768408 (209h13m49.111860891s) [noise=true , address=77.90.31.11:4554 , piece_id=J5OKH5FR5YIBUZEN55CPSKDJ7L3O7PGF5VDS2X3C7CGTBCXUEVUA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.654368487 (209h13m49.11646099s) [noise=true , address=45.91.116.5:4299 , piece_id=2YUDNHDTW3DDWZJPHUV4AHHAO6GJI3TVUKMXO3JDBDIG3YB5XLEA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.688906413 (209h13m49.150998906s) [noise=true , address=45.91.116.4:4939 , piece_id=MGTGITWIRGG53CWAY7276LOHSVJGACIAAMSISMKPZGJLECG52PLQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.706565178 (209h13m49.168657671s) [noise=true , address=45.91.116.8:4047 , piece_id=ZSWJVTA7HW7U2IHRKGKDUHNYCCSMK3YJ3KJBQLOIQ773XCGLWV3Q, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.744669075 (209h13m49.206761558s) [noise=true , address=45.91.116.13:4155 , piece_id=JMRFSKD77UQKZXUZIFCQPAAVCNFDNGNV7U2SKSAJDOKARS6NKA5A, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.767094667 (209h13m49.22918715s) [noise=true , address=45.91.116.8:4048 , piece_id=FVQDCO7EYOYOAOORYY7DAQYIAXWBBDN7OF7E5B2Z3MT34QUGGLUQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:30.458020428 (209h14m15.920112912s) [noise=true , address=145.79.227.13:4801 , piece_id=ZL7KE3QVM63VCBNMAUEXELEERW2JC65RTCVUUQKYLFTEJZBZPRVA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:42996->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:42996->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42996->145.79.227.13:4801: use of closed network connection Oct 2 06:45:30.458236099 (209h14m15.920328572s) [noise=true , address=145.79.227.5:4221 , piece_id=SWGYPEIGFBLMMVAUFNIEQ63SL5SEDXFOCGIFCB7C7ZNCDYDZS7BQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:42060->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:42060->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42060->145.79.227.5:4221: use of closed network connection Oct 2 06:45:30.458311102 (209h14m15.920403585s) [noise=true , address=145.79.227.2:4115 , piece_id=DZADXAOVVZSNVIMHVE5N7XA4U7Y2RS6U6JQLTC2X6YSWWSGVP6YQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:55776->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:55776->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55776->145.79.227.2:4115: use of closed network connection Oct 2 06:45:30.458404109 (209h14m15.920496592s) [noise=true , address=145.79.227.11:4730 , piece_id=QEESDYHFF4TTJ6DOW5BAXORGOSWAKLVFDUWMYZT5POSJ6J5D7IOA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:47498->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:47498->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47498->145.79.227.11:4730: use of closed network connection Oct 2 06:45:30.458519669 (209h14m15.920612142s) [noise=true , address=145.79.227.16:4909 , piece_id=DVOXCRCAGC43BIDHGJOGQBZLDM4QBUONXGWF3GVVUZ4V5YSC6NOA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:36010->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:36010->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36010->145.79.227.16:4909: use of closed network connection Oct 2 06:45:30.458566669 (209h14m15.920659152s) [seg_pos={0 0}, upload=183988]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 2 06:45:30.710989853 (209h14m16.173082346s) [upload=183988]: Done uploading segments... Oct 2 06:45:30.711022285 (209h14m16.173114778s) [upload=183988]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 6.201078873s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.750760137s FAIL (2025-10-02 07:28:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.75077783s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 6.165764989s FAIL (2025-10-02 07:28:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 2 06:45:01.165728558 (209h13m46.627821051s) [upload=183988]: Got next segment. Inline: false Oct 2 06:45:01.165773403 (209h13m46.627865886s) [upload=183988]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 2 06:45:01.165780918 (209h13m46.627873401s) [upload=183988]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 06:45:01.431617535 (209h13m46.893710028s) [seg_pos={0 0}, upload=183988]: Begin upload segment... Oct 2 06:45:01.431697767 (209h13m46.89379025s) [seg_pos={0 0}, upload=183988]: Done begin upload segment. Oct 2 06:45:01.431733565 (209h13m46.893826048s) [noise=true , address=45.91.116.11:4118 , piece_id=KBHSEEDCAKKH76W7FBETEES4UXAMTTA2AQAHETDNJ6ZND73X2OGQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.431781507 (209h13m46.89387399s) [noise=true , address=45.91.116.6:4975 , piece_id=ZNB45P2Q3Q3LUS3DG4FPV5IHHBGSCE5VBCXCW3HFL56GN6EKO7JQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.432603612 (209h13m46.894696095s) [noise=true , address=45.91.116.5:4299 , piece_id=2YUDNHDTW3DDWZJPHUV4AHHAO6GJI3TVUKMXO3JDBDIG3YB5XLEA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.433107522 (209h13m46.895199995s) [noise=true , address=145.79.227.16:4909 , piece_id=DVOXCRCAGC43BIDHGJOGQBZLDM4QBUONXGWF3GVVUZ4V5YSC6NOA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.433549994 (209h13m46.895642477s) [noise=true , address=77.90.31.11:4554 , piece_id=J5OKH5FR5YIBUZEN55CPSKDJ7L3O7PGF5VDS2X3C7CGTBCXUEVUA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.434770508 (209h13m46.896862991s) [noise=true , address=45.91.116.8:4047 , piece_id=ZSWJVTA7HW7U2IHRKGKDUHNYCCSMK3YJ3KJBQLOIQ773XCGLWV3Q, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.435293313 (209h13m46.897385796s) [noise=true , address=77.90.31.21:4878 , piece_id=6S3KSKZN7QKWQCSAOJHVNCLET7JBWPZIRNFQI2SX3UKDMT732KLA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.435758981 (209h13m46.897851464s) [noise=true , address=77.90.31.12:4589 , piece_id=OVKIKUBOCPLT3VJVV4ML6QIQLGOA2S4AIBUUR5IYKAUE2IQVUDGA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.436566698 (209h13m46.898659182s) [noise=true , address=145.79.227.2:4115 , piece_id=DZADXAOVVZSNVIMHVE5N7XA4U7Y2RS6U6JQLTC2X6YSWWSGVP6YQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.437037004 (209h13m46.899129487s) [noise=true , address=145.79.227.13:4801 , piece_id=ZL7KE3QVM63VCBNMAUEXELEERW2JC65RTCVUUQKYLFTEJZBZPRVA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.437501258 (209h13m46.899593741s) [noise=true , address=45.91.116.8:4048 , piece_id=FVQDCO7EYOYOAOORYY7DAQYIAXWBBDN7OF7E5B2Z3MT34QUGGLUQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.437998455 (209h13m46.900090938s) [noise=true , address=45.91.116.13:4155 , piece_id=JMRFSKD77UQKZXUZIFCQPAAVCNFDNGNV7U2SKSAJDOKARS6NKA5A, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.439162861 (209h13m46.901255345s) [noise=true , address=45.91.116.4:4939 , piece_id=MGTGITWIRGG53CWAY7276LOHSVJGACIAAMSISMKPZGJLECG52PLQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.439750080 (209h13m46.901842563s) [noise=true , address=45.91.116.12:4227 , piece_id=MGYI2TR4MPA6DKGFYIVMGTGLD5DO5BROGFCKWOP4Z4RNRWOSBPMQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.441380735 (209h13m46.903473208s) [noise=true , address=145.79.227.11:4730 , piece_id=QEESDYHFF4TTJ6DOW5BAXORGOSWAKLVFDUWMYZT5POSJ6J5D7IOA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.443563041 (209h13m46.905655524s) [noise=true , address=145.79.227.5:4221 , piece_id=SWGYPEIGFBLMMVAUFNIEQ63SL5SEDXFOCGIFCB7C7ZNCDYDZS7BQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:03.164025603 (209h13m48.626118096s) [upload=183988]: Next returned nil segment Oct 2 06:45:03.164074216 (209h13m48.626166699s) [upload=183988]: Waiting for error group managing segments... Oct 2 06:45:03.564517516 (209h13m49.026609999s) [noise=true , address=45.91.116.6:4975 , piece_id=ZNB45P2Q3Q3LUS3DG4FPV5IHHBGSCE5VBCXCW3HFL56GN6EKO7JQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.610247563 (209h13m49.072340046s) [noise=true , address=77.90.31.21:4878 , piece_id=6S3KSKZN7QKWQCSAOJHVNCLET7JBWPZIRNFQI2SX3UKDMT732KLA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.616241056 (209h13m49.078333549s) [noise=true , address=45.91.116.11:4118 , piece_id=KBHSEEDCAKKH76W7FBETEES4UXAMTTA2AQAHETDNJ6ZND73X2OGQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.632371971 (209h13m49.094464475s) [noise=true , address=77.90.31.12:4589 , piece_id=OVKIKUBOCPLT3VJVV4ML6QIQLGOA2S4AIBUUR5IYKAUE2IQVUDGA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.639558567 (209h13m49.10165105s) [noise=true , address=45.91.116.12:4227 , piece_id=MGYI2TR4MPA6DKGFYIVMGTGLD5DO5BROGFCKWOP4Z4RNRWOSBPMQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.649768408 (209h13m49.111860891s) [noise=true , address=77.90.31.11:4554 , piece_id=J5OKH5FR5YIBUZEN55CPSKDJ7L3O7PGF5VDS2X3C7CGTBCXUEVUA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.654368487 (209h13m49.11646099s) [noise=true , address=45.91.116.5:4299 , piece_id=2YUDNHDTW3DDWZJPHUV4AHHAO6GJI3TVUKMXO3JDBDIG3YB5XLEA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.688906413 (209h13m49.150998906s) [noise=true , address=45.91.116.4:4939 , piece_id=MGTGITWIRGG53CWAY7276LOHSVJGACIAAMSISMKPZGJLECG52PLQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.706565178 (209h13m49.168657671s) [noise=true , address=45.91.116.8:4047 , piece_id=ZSWJVTA7HW7U2IHRKGKDUHNYCCSMK3YJ3KJBQLOIQ773XCGLWV3Q, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.744669075 (209h13m49.206761558s) [noise=true , address=45.91.116.13:4155 , piece_id=JMRFSKD77UQKZXUZIFCQPAAVCNFDNGNV7U2SKSAJDOKARS6NKA5A, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.767094667 (209h13m49.22918715s) [noise=true , address=45.91.116.8:4048 , piece_id=FVQDCO7EYOYOAOORYY7DAQYIAXWBBDN7OF7E5B2Z3MT34QUGGLUQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:30.458020428 (209h14m15.920112912s) [noise=true , address=145.79.227.13:4801 , piece_id=ZL7KE3QVM63VCBNMAUEXELEERW2JC65RTCVUUQKYLFTEJZBZPRVA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:42996->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:42996->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42996->145.79.227.13:4801: use of closed network connection Oct 2 06:45:30.458236099 (209h14m15.920328572s) [noise=true , address=145.79.227.5:4221 , piece_id=SWGYPEIGFBLMMVAUFNIEQ63SL5SEDXFOCGIFCB7C7ZNCDYDZS7BQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:42060->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:42060->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42060->145.79.227.5:4221: use of closed network connection Oct 2 06:45:30.458311102 (209h14m15.920403585s) [noise=true , address=145.79.227.2:4115 , piece_id=DZADXAOVVZSNVIMHVE5N7XA4U7Y2RS6U6JQLTC2X6YSWWSGVP6YQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:55776->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:55776->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55776->145.79.227.2:4115: use of closed network connection Oct 2 06:45:30.458404109 (209h14m15.920496592s) [noise=true , address=145.79.227.11:4730 , piece_id=QEESDYHFF4TTJ6DOW5BAXORGOSWAKLVFDUWMYZT5POSJ6J5D7IOA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:47498->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:47498->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47498->145.79.227.11:4730: use of closed network connection Oct 2 06:45:30.458519669 (209h14m15.920612142s) [noise=true , address=145.79.227.16:4909 , piece_id=DVOXCRCAGC43BIDHGJOGQBZLDM4QBUONXGWF3GVVUZ4V5YSC6NOA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:36010->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:36010->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36010->145.79.227.16:4909: use of closed network connection Oct 2 06:45:30.458566669 (209h14m15.920659152s) [seg_pos={0 0}, upload=183988]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 2 06:45:30.710989853 (209h14m16.173082346s) [upload=183988]: Done uploading segments... Oct 2 06:45:30.711022285 (209h14m16.173114778s) [upload=183988]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 6.165798442s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.728449461s FAIL (2025-10-02 07:28:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.728473898s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 6.172310846s FAIL (2025-10-02 07:28:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 2 06:45:01.165728558 (209h13m46.627821051s) [upload=183988]: Got next segment. Inline: false Oct 2 06:45:01.165773403 (209h13m46.627865886s) [upload=183988]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 2 06:45:01.165780918 (209h13m46.627873401s) [upload=183988]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 06:45:01.431617535 (209h13m46.893710028s) [seg_pos={0 0}, upload=183988]: Begin upload segment... Oct 2 06:45:01.431697767 (209h13m46.89379025s) [seg_pos={0 0}, upload=183988]: Done begin upload segment. Oct 2 06:45:01.431733565 (209h13m46.893826048s) [noise=true , address=45.91.116.11:4118 , piece_id=KBHSEEDCAKKH76W7FBETEES4UXAMTTA2AQAHETDNJ6ZND73X2OGQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.431781507 (209h13m46.89387399s) [noise=true , address=45.91.116.6:4975 , piece_id=ZNB45P2Q3Q3LUS3DG4FPV5IHHBGSCE5VBCXCW3HFL56GN6EKO7JQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.432603612 (209h13m46.894696095s) [noise=true , address=45.91.116.5:4299 , piece_id=2YUDNHDTW3DDWZJPHUV4AHHAO6GJI3TVUKMXO3JDBDIG3YB5XLEA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.433107522 (209h13m46.895199995s) [noise=true , address=145.79.227.16:4909 , piece_id=DVOXCRCAGC43BIDHGJOGQBZLDM4QBUONXGWF3GVVUZ4V5YSC6NOA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.433549994 (209h13m46.895642477s) [noise=true , address=77.90.31.11:4554 , piece_id=J5OKH5FR5YIBUZEN55CPSKDJ7L3O7PGF5VDS2X3C7CGTBCXUEVUA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.434770508 (209h13m46.896862991s) [noise=true , address=45.91.116.8:4047 , piece_id=ZSWJVTA7HW7U2IHRKGKDUHNYCCSMK3YJ3KJBQLOIQ773XCGLWV3Q, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.435293313 (209h13m46.897385796s) [noise=true , address=77.90.31.21:4878 , piece_id=6S3KSKZN7QKWQCSAOJHVNCLET7JBWPZIRNFQI2SX3UKDMT732KLA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.435758981 (209h13m46.897851464s) [noise=true , address=77.90.31.12:4589 , piece_id=OVKIKUBOCPLT3VJVV4ML6QIQLGOA2S4AIBUUR5IYKAUE2IQVUDGA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.436566698 (209h13m46.898659182s) [noise=true , address=145.79.227.2:4115 , piece_id=DZADXAOVVZSNVIMHVE5N7XA4U7Y2RS6U6JQLTC2X6YSWWSGVP6YQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.437037004 (209h13m46.899129487s) [noise=true , address=145.79.227.13:4801 , piece_id=ZL7KE3QVM63VCBNMAUEXELEERW2JC65RTCVUUQKYLFTEJZBZPRVA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.437501258 (209h13m46.899593741s) [noise=true , address=45.91.116.8:4048 , piece_id=FVQDCO7EYOYOAOORYY7DAQYIAXWBBDN7OF7E5B2Z3MT34QUGGLUQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.437998455 (209h13m46.900090938s) [noise=true , address=45.91.116.13:4155 , piece_id=JMRFSKD77UQKZXUZIFCQPAAVCNFDNGNV7U2SKSAJDOKARS6NKA5A, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.439162861 (209h13m46.901255345s) [noise=true , address=45.91.116.4:4939 , piece_id=MGTGITWIRGG53CWAY7276LOHSVJGACIAAMSISMKPZGJLECG52PLQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.439750080 (209h13m46.901842563s) [noise=true , address=45.91.116.12:4227 , piece_id=MGYI2TR4MPA6DKGFYIVMGTGLD5DO5BROGFCKWOP4Z4RNRWOSBPMQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.441380735 (209h13m46.903473208s) [noise=true , address=145.79.227.11:4730 , piece_id=QEESDYHFF4TTJ6DOW5BAXORGOSWAKLVFDUWMYZT5POSJ6J5D7IOA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.443563041 (209h13m46.905655524s) [noise=true , address=145.79.227.5:4221 , piece_id=SWGYPEIGFBLMMVAUFNIEQ63SL5SEDXFOCGIFCB7C7ZNCDYDZS7BQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:03.164025603 (209h13m48.626118096s) [upload=183988]: Next returned nil segment Oct 2 06:45:03.164074216 (209h13m48.626166699s) [upload=183988]: Waiting for error group managing segments... Oct 2 06:45:03.564517516 (209h13m49.026609999s) [noise=true , address=45.91.116.6:4975 , piece_id=ZNB45P2Q3Q3LUS3DG4FPV5IHHBGSCE5VBCXCW3HFL56GN6EKO7JQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.610247563 (209h13m49.072340046s) [noise=true , address=77.90.31.21:4878 , piece_id=6S3KSKZN7QKWQCSAOJHVNCLET7JBWPZIRNFQI2SX3UKDMT732KLA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.616241056 (209h13m49.078333549s) [noise=true , address=45.91.116.11:4118 , piece_id=KBHSEEDCAKKH76W7FBETEES4UXAMTTA2AQAHETDNJ6ZND73X2OGQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.632371971 (209h13m49.094464475s) [noise=true , address=77.90.31.12:4589 , piece_id=OVKIKUBOCPLT3VJVV4ML6QIQLGOA2S4AIBUUR5IYKAUE2IQVUDGA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.639558567 (209h13m49.10165105s) [noise=true , address=45.91.116.12:4227 , piece_id=MGYI2TR4MPA6DKGFYIVMGTGLD5DO5BROGFCKWOP4Z4RNRWOSBPMQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.649768408 (209h13m49.111860891s) [noise=true , address=77.90.31.11:4554 , piece_id=J5OKH5FR5YIBUZEN55CPSKDJ7L3O7PGF5VDS2X3C7CGTBCXUEVUA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.654368487 (209h13m49.11646099s) [noise=true , address=45.91.116.5:4299 , piece_id=2YUDNHDTW3DDWZJPHUV4AHHAO6GJI3TVUKMXO3JDBDIG3YB5XLEA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.688906413 (209h13m49.150998906s) [noise=true , address=45.91.116.4:4939 , piece_id=MGTGITWIRGG53CWAY7276LOHSVJGACIAAMSISMKPZGJLECG52PLQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.706565178 (209h13m49.168657671s) [noise=true , address=45.91.116.8:4047 , piece_id=ZSWJVTA7HW7U2IHRKGKDUHNYCCSMK3YJ3KJBQLOIQ773XCGLWV3Q, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.744669075 (209h13m49.206761558s) [noise=true , address=45.91.116.13:4155 , piece_id=JMRFSKD77UQKZXUZIFCQPAAVCNFDNGNV7U2SKSAJDOKARS6NKA5A, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.767094667 (209h13m49.22918715s) [noise=true , address=45.91.116.8:4048 , piece_id=FVQDCO7EYOYOAOORYY7DAQYIAXWBBDN7OF7E5B2Z3MT34QUGGLUQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:30.458020428 (209h14m15.920112912s) [noise=true , address=145.79.227.13:4801 , piece_id=ZL7KE3QVM63VCBNMAUEXELEERW2JC65RTCVUUQKYLFTEJZBZPRVA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:42996->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:42996->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42996->145.79.227.13:4801: use of closed network connection Oct 2 06:45:30.458236099 (209h14m15.920328572s) [noise=true , address=145.79.227.5:4221 , piece_id=SWGYPEIGFBLMMVAUFNIEQ63SL5SEDXFOCGIFCB7C7ZNCDYDZS7BQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:42060->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:42060->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42060->145.79.227.5:4221: use of closed network connection Oct 2 06:45:30.458311102 (209h14m15.920403585s) [noise=true , address=145.79.227.2:4115 , piece_id=DZADXAOVVZSNVIMHVE5N7XA4U7Y2RS6U6JQLTC2X6YSWWSGVP6YQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:55776->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:55776->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55776->145.79.227.2:4115: use of closed network connection Oct 2 06:45:30.458404109 (209h14m15.920496592s) [noise=true , address=145.79.227.11:4730 , piece_id=QEESDYHFF4TTJ6DOW5BAXORGOSWAKLVFDUWMYZT5POSJ6J5D7IOA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:47498->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:47498->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47498->145.79.227.11:4730: use of closed network connection Oct 2 06:45:30.458519669 (209h14m15.920612142s) [noise=true , address=145.79.227.16:4909 , piece_id=DVOXCRCAGC43BIDHGJOGQBZLDM4QBUONXGWF3GVVUZ4V5YSC6NOA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:36010->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:36010->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36010->145.79.227.16:4909: use of closed network connection Oct 2 06:45:30.458566669 (209h14m15.920659152s) [seg_pos={0 0}, upload=183988]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 2 06:45:30.710989853 (209h14m16.173082346s) [upload=183988]: Done uploading segments... Oct 2 06:45:30.711022285 (209h14m16.173114778s) [upload=183988]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 6.172353347s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.760799362s FAIL (2025-10-02 07:27:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.760846592s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.99912689s FAIL (2025-10-02 07:26:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 2 06:45:01.165728558 (209h13m46.627821051s) [upload=183988]: Got next segment. Inline: false Oct 2 06:45:01.165773403 (209h13m46.627865886s) [upload=183988]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 2 06:45:01.165780918 (209h13m46.627873401s) [upload=183988]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 06:45:01.431617535 (209h13m46.893710028s) [seg_pos={0 0}, upload=183988]: Begin upload segment... Oct 2 06:45:01.431697767 (209h13m46.89379025s) [seg_pos={0 0}, upload=183988]: Done begin upload segment. Oct 2 06:45:01.431733565 (209h13m46.893826048s) [noise=true , address=45.91.116.11:4118 , piece_id=KBHSEEDCAKKH76W7FBETEES4UXAMTTA2AQAHETDNJ6ZND73X2OGQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.431781507 (209h13m46.89387399s) [noise=true , address=45.91.116.6:4975 , piece_id=ZNB45P2Q3Q3LUS3DG4FPV5IHHBGSCE5VBCXCW3HFL56GN6EKO7JQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.432603612 (209h13m46.894696095s) [noise=true , address=45.91.116.5:4299 , piece_id=2YUDNHDTW3DDWZJPHUV4AHHAO6GJI3TVUKMXO3JDBDIG3YB5XLEA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.433107522 (209h13m46.895199995s) [noise=true , address=145.79.227.16:4909 , piece_id=DVOXCRCAGC43BIDHGJOGQBZLDM4QBUONXGWF3GVVUZ4V5YSC6NOA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.433549994 (209h13m46.895642477s) [noise=true , address=77.90.31.11:4554 , piece_id=J5OKH5FR5YIBUZEN55CPSKDJ7L3O7PGF5VDS2X3C7CGTBCXUEVUA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.434770508 (209h13m46.896862991s) [noise=true , address=45.91.116.8:4047 , piece_id=ZSWJVTA7HW7U2IHRKGKDUHNYCCSMK3YJ3KJBQLOIQ773XCGLWV3Q, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.435293313 (209h13m46.897385796s) [noise=true , address=77.90.31.21:4878 , piece_id=6S3KSKZN7QKWQCSAOJHVNCLET7JBWPZIRNFQI2SX3UKDMT732KLA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.435758981 (209h13m46.897851464s) [noise=true , address=77.90.31.12:4589 , piece_id=OVKIKUBOCPLT3VJVV4ML6QIQLGOA2S4AIBUUR5IYKAUE2IQVUDGA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.436566698 (209h13m46.898659182s) [noise=true , address=145.79.227.2:4115 , piece_id=DZADXAOVVZSNVIMHVE5N7XA4U7Y2RS6U6JQLTC2X6YSWWSGVP6YQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.437037004 (209h13m46.899129487s) [noise=true , address=145.79.227.13:4801 , piece_id=ZL7KE3QVM63VCBNMAUEXELEERW2JC65RTCVUUQKYLFTEJZBZPRVA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.437501258 (209h13m46.899593741s) [noise=true , address=45.91.116.8:4048 , piece_id=FVQDCO7EYOYOAOORYY7DAQYIAXWBBDN7OF7E5B2Z3MT34QUGGLUQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.437998455 (209h13m46.900090938s) [noise=true , address=45.91.116.13:4155 , piece_id=JMRFSKD77UQKZXUZIFCQPAAVCNFDNGNV7U2SKSAJDOKARS6NKA5A, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.439162861 (209h13m46.901255345s) [noise=true , address=45.91.116.4:4939 , piece_id=MGTGITWIRGG53CWAY7276LOHSVJGACIAAMSISMKPZGJLECG52PLQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.439750080 (209h13m46.901842563s) [noise=true , address=45.91.116.12:4227 , piece_id=MGYI2TR4MPA6DKGFYIVMGTGLD5DO5BROGFCKWOP4Z4RNRWOSBPMQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.441380735 (209h13m46.903473208s) [noise=true , address=145.79.227.11:4730 , piece_id=QEESDYHFF4TTJ6DOW5BAXORGOSWAKLVFDUWMYZT5POSJ6J5D7IOA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.443563041 (209h13m46.905655524s) [noise=true , address=145.79.227.5:4221 , piece_id=SWGYPEIGFBLMMVAUFNIEQ63SL5SEDXFOCGIFCB7C7ZNCDYDZS7BQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:03.164025603 (209h13m48.626118096s) [upload=183988]: Next returned nil segment Oct 2 06:45:03.164074216 (209h13m48.626166699s) [upload=183988]: Waiting for error group managing segments... Oct 2 06:45:03.564517516 (209h13m49.026609999s) [noise=true , address=45.91.116.6:4975 , piece_id=ZNB45P2Q3Q3LUS3DG4FPV5IHHBGSCE5VBCXCW3HFL56GN6EKO7JQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.610247563 (209h13m49.072340046s) [noise=true , address=77.90.31.21:4878 , piece_id=6S3KSKZN7QKWQCSAOJHVNCLET7JBWPZIRNFQI2SX3UKDMT732KLA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.616241056 (209h13m49.078333549s) [noise=true , address=45.91.116.11:4118 , piece_id=KBHSEEDCAKKH76W7FBETEES4UXAMTTA2AQAHETDNJ6ZND73X2OGQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.632371971 (209h13m49.094464475s) [noise=true , address=77.90.31.12:4589 , piece_id=OVKIKUBOCPLT3VJVV4ML6QIQLGOA2S4AIBUUR5IYKAUE2IQVUDGA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.639558567 (209h13m49.10165105s) [noise=true , address=45.91.116.12:4227 , piece_id=MGYI2TR4MPA6DKGFYIVMGTGLD5DO5BROGFCKWOP4Z4RNRWOSBPMQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.649768408 (209h13m49.111860891s) [noise=true , address=77.90.31.11:4554 , piece_id=J5OKH5FR5YIBUZEN55CPSKDJ7L3O7PGF5VDS2X3C7CGTBCXUEVUA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.654368487 (209h13m49.11646099s) [noise=true , address=45.91.116.5:4299 , piece_id=2YUDNHDTW3DDWZJPHUV4AHHAO6GJI3TVUKMXO3JDBDIG3YB5XLEA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.688906413 (209h13m49.150998906s) [noise=true , address=45.91.116.4:4939 , piece_id=MGTGITWIRGG53CWAY7276LOHSVJGACIAAMSISMKPZGJLECG52PLQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.706565178 (209h13m49.168657671s) [noise=true , address=45.91.116.8:4047 , piece_id=ZSWJVTA7HW7U2IHRKGKDUHNYCCSMK3YJ3KJBQLOIQ773XCGLWV3Q, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.744669075 (209h13m49.206761558s) [noise=true , address=45.91.116.13:4155 , piece_id=JMRFSKD77UQKZXUZIFCQPAAVCNFDNGNV7U2SKSAJDOKARS6NKA5A, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.767094667 (209h13m49.22918715s) [noise=true , address=45.91.116.8:4048 , piece_id=FVQDCO7EYOYOAOORYY7DAQYIAXWBBDN7OF7E5B2Z3MT34QUGGLUQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:30.458020428 (209h14m15.920112912s) [noise=true , address=145.79.227.13:4801 , piece_id=ZL7KE3QVM63VCBNMAUEXELEERW2JC65RTCVUUQKYLFTEJZBZPRVA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:42996->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:42996->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42996->145.79.227.13:4801: use of closed network connection Oct 2 06:45:30.458236099 (209h14m15.920328572s) [noise=true , address=145.79.227.5:4221 , piece_id=SWGYPEIGFBLMMVAUFNIEQ63SL5SEDXFOCGIFCB7C7ZNCDYDZS7BQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:42060->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:42060->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42060->145.79.227.5:4221: use of closed network connection Oct 2 06:45:30.458311102 (209h14m15.920403585s) [noise=true , address=145.79.227.2:4115 , piece_id=DZADXAOVVZSNVIMHVE5N7XA4U7Y2RS6U6JQLTC2X6YSWWSGVP6YQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:55776->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:55776->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55776->145.79.227.2:4115: use of closed network connection Oct 2 06:45:30.458404109 (209h14m15.920496592s) [noise=true , address=145.79.227.11:4730 , piece_id=QEESDYHFF4TTJ6DOW5BAXORGOSWAKLVFDUWMYZT5POSJ6J5D7IOA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:47498->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:47498->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47498->145.79.227.11:4730: use of closed network connection Oct 2 06:45:30.458519669 (209h14m15.920612142s) [noise=true , address=145.79.227.16:4909 , piece_id=DVOXCRCAGC43BIDHGJOGQBZLDM4QBUONXGWF3GVVUZ4V5YSC6NOA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:36010->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:36010->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36010->145.79.227.16:4909: use of closed network connection Oct 2 06:45:30.458566669 (209h14m15.920659152s) [seg_pos={0 0}, upload=183988]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 2 06:45:30.710989853 (209h14m16.173082346s) [upload=183988]: Done uploading segments... Oct 2 06:45:30.711022285 (209h14m16.173114778s) [upload=183988]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.999186443s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.77024614s FAIL (2025-10-02 07:26:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.770285276s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.623743665s FAIL (2025-10-02 07:26:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.623771438s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.997799583s FAIL (2025-10-02 07:25:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 2 06:45:01.165728558 (209h13m46.627821051s) [upload=183988]: Got next segment. Inline: false Oct 2 06:45:01.165773403 (209h13m46.627865886s) [upload=183988]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 2 06:45:01.165780918 (209h13m46.627873401s) [upload=183988]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 06:45:01.431617535 (209h13m46.893710028s) [seg_pos={0 0}, upload=183988]: Begin upload segment... Oct 2 06:45:01.431697767 (209h13m46.89379025s) [seg_pos={0 0}, upload=183988]: Done begin upload segment. Oct 2 06:45:01.431733565 (209h13m46.893826048s) [noise=true , address=45.91.116.11:4118 , piece_id=KBHSEEDCAKKH76W7FBETEES4UXAMTTA2AQAHETDNJ6ZND73X2OGQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.431781507 (209h13m46.89387399s) [noise=true , address=45.91.116.6:4975 , piece_id=ZNB45P2Q3Q3LUS3DG4FPV5IHHBGSCE5VBCXCW3HFL56GN6EKO7JQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.432603612 (209h13m46.894696095s) [noise=true , address=45.91.116.5:4299 , piece_id=2YUDNHDTW3DDWZJPHUV4AHHAO6GJI3TVUKMXO3JDBDIG3YB5XLEA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.433107522 (209h13m46.895199995s) [noise=true , address=145.79.227.16:4909 , piece_id=DVOXCRCAGC43BIDHGJOGQBZLDM4QBUONXGWF3GVVUZ4V5YSC6NOA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.433549994 (209h13m46.895642477s) [noise=true , address=77.90.31.11:4554 , piece_id=J5OKH5FR5YIBUZEN55CPSKDJ7L3O7PGF5VDS2X3C7CGTBCXUEVUA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.434770508 (209h13m46.896862991s) [noise=true , address=45.91.116.8:4047 , piece_id=ZSWJVTA7HW7U2IHRKGKDUHNYCCSMK3YJ3KJBQLOIQ773XCGLWV3Q, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.435293313 (209h13m46.897385796s) [noise=true , address=77.90.31.21:4878 , piece_id=6S3KSKZN7QKWQCSAOJHVNCLET7JBWPZIRNFQI2SX3UKDMT732KLA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.435758981 (209h13m46.897851464s) [noise=true , address=77.90.31.12:4589 , piece_id=OVKIKUBOCPLT3VJVV4ML6QIQLGOA2S4AIBUUR5IYKAUE2IQVUDGA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.436566698 (209h13m46.898659182s) [noise=true , address=145.79.227.2:4115 , piece_id=DZADXAOVVZSNVIMHVE5N7XA4U7Y2RS6U6JQLTC2X6YSWWSGVP6YQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.437037004 (209h13m46.899129487s) [noise=true , address=145.79.227.13:4801 , piece_id=ZL7KE3QVM63VCBNMAUEXELEERW2JC65RTCVUUQKYLFTEJZBZPRVA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.437501258 (209h13m46.899593741s) [noise=true , address=45.91.116.8:4048 , piece_id=FVQDCO7EYOYOAOORYY7DAQYIAXWBBDN7OF7E5B2Z3MT34QUGGLUQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.437998455 (209h13m46.900090938s) [noise=true , address=45.91.116.13:4155 , piece_id=JMRFSKD77UQKZXUZIFCQPAAVCNFDNGNV7U2SKSAJDOKARS6NKA5A, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.439162861 (209h13m46.901255345s) [noise=true , address=45.91.116.4:4939 , piece_id=MGTGITWIRGG53CWAY7276LOHSVJGACIAAMSISMKPZGJLECG52PLQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.439750080 (209h13m46.901842563s) [noise=true , address=45.91.116.12:4227 , piece_id=MGYI2TR4MPA6DKGFYIVMGTGLD5DO5BROGFCKWOP4Z4RNRWOSBPMQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.441380735 (209h13m46.903473208s) [noise=true , address=145.79.227.11:4730 , piece_id=QEESDYHFF4TTJ6DOW5BAXORGOSWAKLVFDUWMYZT5POSJ6J5D7IOA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.443563041 (209h13m46.905655524s) [noise=true , address=145.79.227.5:4221 , piece_id=SWGYPEIGFBLMMVAUFNIEQ63SL5SEDXFOCGIFCB7C7ZNCDYDZS7BQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:03.164025603 (209h13m48.626118096s) [upload=183988]: Next returned nil segment Oct 2 06:45:03.164074216 (209h13m48.626166699s) [upload=183988]: Waiting for error group managing segments... Oct 2 06:45:03.564517516 (209h13m49.026609999s) [noise=true , address=45.91.116.6:4975 , piece_id=ZNB45P2Q3Q3LUS3DG4FPV5IHHBGSCE5VBCXCW3HFL56GN6EKO7JQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.610247563 (209h13m49.072340046s) [noise=true , address=77.90.31.21:4878 , piece_id=6S3KSKZN7QKWQCSAOJHVNCLET7JBWPZIRNFQI2SX3UKDMT732KLA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.616241056 (209h13m49.078333549s) [noise=true , address=45.91.116.11:4118 , piece_id=KBHSEEDCAKKH76W7FBETEES4UXAMTTA2AQAHETDNJ6ZND73X2OGQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.632371971 (209h13m49.094464475s) [noise=true , address=77.90.31.12:4589 , piece_id=OVKIKUBOCPLT3VJVV4ML6QIQLGOA2S4AIBUUR5IYKAUE2IQVUDGA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.639558567 (209h13m49.10165105s) [noise=true , address=45.91.116.12:4227 , piece_id=MGYI2TR4MPA6DKGFYIVMGTGLD5DO5BROGFCKWOP4Z4RNRWOSBPMQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.649768408 (209h13m49.111860891s) [noise=true , address=77.90.31.11:4554 , piece_id=J5OKH5FR5YIBUZEN55CPSKDJ7L3O7PGF5VDS2X3C7CGTBCXUEVUA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.654368487 (209h13m49.11646099s) [noise=true , address=45.91.116.5:4299 , piece_id=2YUDNHDTW3DDWZJPHUV4AHHAO6GJI3TVUKMXO3JDBDIG3YB5XLEA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.688906413 (209h13m49.150998906s) [noise=true , address=45.91.116.4:4939 , piece_id=MGTGITWIRGG53CWAY7276LOHSVJGACIAAMSISMKPZGJLECG52PLQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.706565178 (209h13m49.168657671s) [noise=true , address=45.91.116.8:4047 , piece_id=ZSWJVTA7HW7U2IHRKGKDUHNYCCSMK3YJ3KJBQLOIQ773XCGLWV3Q, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.744669075 (209h13m49.206761558s) [noise=true , address=45.91.116.13:4155 , piece_id=JMRFSKD77UQKZXUZIFCQPAAVCNFDNGNV7U2SKSAJDOKARS6NKA5A, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.767094667 (209h13m49.22918715s) [noise=true , address=45.91.116.8:4048 , piece_id=FVQDCO7EYOYOAOORYY7DAQYIAXWBBDN7OF7E5B2Z3MT34QUGGLUQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:30.458020428 (209h14m15.920112912s) [noise=true , address=145.79.227.13:4801 , piece_id=ZL7KE3QVM63VCBNMAUEXELEERW2JC65RTCVUUQKYLFTEJZBZPRVA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:42996->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:42996->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42996->145.79.227.13:4801: use of closed network connection Oct 2 06:45:30.458236099 (209h14m15.920328572s) [noise=true , address=145.79.227.5:4221 , piece_id=SWGYPEIGFBLMMVAUFNIEQ63SL5SEDXFOCGIFCB7C7ZNCDYDZS7BQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:42060->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:42060->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42060->145.79.227.5:4221: use of closed network connection Oct 2 06:45:30.458311102 (209h14m15.920403585s) [noise=true , address=145.79.227.2:4115 , piece_id=DZADXAOVVZSNVIMHVE5N7XA4U7Y2RS6U6JQLTC2X6YSWWSGVP6YQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:55776->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:55776->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55776->145.79.227.2:4115: use of closed network connection Oct 2 06:45:30.458404109 (209h14m15.920496592s) [noise=true , address=145.79.227.11:4730 , piece_id=QEESDYHFF4TTJ6DOW5BAXORGOSWAKLVFDUWMYZT5POSJ6J5D7IOA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:47498->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:47498->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47498->145.79.227.11:4730: use of closed network connection Oct 2 06:45:30.458519669 (209h14m15.920612142s) [noise=true , address=145.79.227.16:4909 , piece_id=DVOXCRCAGC43BIDHGJOGQBZLDM4QBUONXGWF3GVVUZ4V5YSC6NOA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:36010->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:36010->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36010->145.79.227.16:4909: use of closed network connection Oct 2 06:45:30.458566669 (209h14m15.920659152s) [seg_pos={0 0}, upload=183988]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 2 06:45:30.710989853 (209h14m16.173082346s) [upload=183988]: Done uploading segments... Oct 2 06:45:30.711022285 (209h14m16.173114778s) [upload=183988]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.99796038s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.792891082s FAIL (2025-10-02 07:25:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.792955314s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.976182521s FAIL (2025-10-02 07:25:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.97621831s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 6.253374301s FAIL (2025-10-02 07:24:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 2 06:45:01.165728558 (209h13m46.627821051s) [upload=183988]: Got next segment. Inline: false Oct 2 06:45:01.165773403 (209h13m46.627865886s) [upload=183988]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 2 06:45:01.165780918 (209h13m46.627873401s) [upload=183988]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 06:45:01.431617535 (209h13m46.893710028s) [seg_pos={0 0}, upload=183988]: Begin upload segment... Oct 2 06:45:01.431697767 (209h13m46.89379025s) [seg_pos={0 0}, upload=183988]: Done begin upload segment. Oct 2 06:45:01.431733565 (209h13m46.893826048s) [noise=true , address=45.91.116.11:4118 , piece_id=KBHSEEDCAKKH76W7FBETEES4UXAMTTA2AQAHETDNJ6ZND73X2OGQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.431781507 (209h13m46.89387399s) [noise=true , address=45.91.116.6:4975 , piece_id=ZNB45P2Q3Q3LUS3DG4FPV5IHHBGSCE5VBCXCW3HFL56GN6EKO7JQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.432603612 (209h13m46.894696095s) [noise=true , address=45.91.116.5:4299 , piece_id=2YUDNHDTW3DDWZJPHUV4AHHAO6GJI3TVUKMXO3JDBDIG3YB5XLEA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.433107522 (209h13m46.895199995s) [noise=true , address=145.79.227.16:4909 , piece_id=DVOXCRCAGC43BIDHGJOGQBZLDM4QBUONXGWF3GVVUZ4V5YSC6NOA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.433549994 (209h13m46.895642477s) [noise=true , address=77.90.31.11:4554 , piece_id=J5OKH5FR5YIBUZEN55CPSKDJ7L3O7PGF5VDS2X3C7CGTBCXUEVUA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.434770508 (209h13m46.896862991s) [noise=true , address=45.91.116.8:4047 , piece_id=ZSWJVTA7HW7U2IHRKGKDUHNYCCSMK3YJ3KJBQLOIQ773XCGLWV3Q, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.435293313 (209h13m46.897385796s) [noise=true , address=77.90.31.21:4878 , piece_id=6S3KSKZN7QKWQCSAOJHVNCLET7JBWPZIRNFQI2SX3UKDMT732KLA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.435758981 (209h13m46.897851464s) [noise=true , address=77.90.31.12:4589 , piece_id=OVKIKUBOCPLT3VJVV4ML6QIQLGOA2S4AIBUUR5IYKAUE2IQVUDGA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.436566698 (209h13m46.898659182s) [noise=true , address=145.79.227.2:4115 , piece_id=DZADXAOVVZSNVIMHVE5N7XA4U7Y2RS6U6JQLTC2X6YSWWSGVP6YQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.437037004 (209h13m46.899129487s) [noise=true , address=145.79.227.13:4801 , piece_id=ZL7KE3QVM63VCBNMAUEXELEERW2JC65RTCVUUQKYLFTEJZBZPRVA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.437501258 (209h13m46.899593741s) [noise=true , address=45.91.116.8:4048 , piece_id=FVQDCO7EYOYOAOORYY7DAQYIAXWBBDN7OF7E5B2Z3MT34QUGGLUQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.437998455 (209h13m46.900090938s) [noise=true , address=45.91.116.13:4155 , piece_id=JMRFSKD77UQKZXUZIFCQPAAVCNFDNGNV7U2SKSAJDOKARS6NKA5A, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.439162861 (209h13m46.901255345s) [noise=true , address=45.91.116.4:4939 , piece_id=MGTGITWIRGG53CWAY7276LOHSVJGACIAAMSISMKPZGJLECG52PLQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.439750080 (209h13m46.901842563s) [noise=true , address=45.91.116.12:4227 , piece_id=MGYI2TR4MPA6DKGFYIVMGTGLD5DO5BROGFCKWOP4Z4RNRWOSBPMQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.441380735 (209h13m46.903473208s) [noise=true , address=145.79.227.11:4730 , piece_id=QEESDYHFF4TTJ6DOW5BAXORGOSWAKLVFDUWMYZT5POSJ6J5D7IOA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.443563041 (209h13m46.905655524s) [noise=true , address=145.79.227.5:4221 , piece_id=SWGYPEIGFBLMMVAUFNIEQ63SL5SEDXFOCGIFCB7C7ZNCDYDZS7BQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:03.164025603 (209h13m48.626118096s) [upload=183988]: Next returned nil segment Oct 2 06:45:03.164074216 (209h13m48.626166699s) [upload=183988]: Waiting for error group managing segments... Oct 2 06:45:03.564517516 (209h13m49.026609999s) [noise=true , address=45.91.116.6:4975 , piece_id=ZNB45P2Q3Q3LUS3DG4FPV5IHHBGSCE5VBCXCW3HFL56GN6EKO7JQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.610247563 (209h13m49.072340046s) [noise=true , address=77.90.31.21:4878 , piece_id=6S3KSKZN7QKWQCSAOJHVNCLET7JBWPZIRNFQI2SX3UKDMT732KLA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.616241056 (209h13m49.078333549s) [noise=true , address=45.91.116.11:4118 , piece_id=KBHSEEDCAKKH76W7FBETEES4UXAMTTA2AQAHETDNJ6ZND73X2OGQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.632371971 (209h13m49.094464475s) [noise=true , address=77.90.31.12:4589 , piece_id=OVKIKUBOCPLT3VJVV4ML6QIQLGOA2S4AIBUUR5IYKAUE2IQVUDGA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.639558567 (209h13m49.10165105s) [noise=true , address=45.91.116.12:4227 , piece_id=MGYI2TR4MPA6DKGFYIVMGTGLD5DO5BROGFCKWOP4Z4RNRWOSBPMQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.649768408 (209h13m49.111860891s) [noise=true , address=77.90.31.11:4554 , piece_id=J5OKH5FR5YIBUZEN55CPSKDJ7L3O7PGF5VDS2X3C7CGTBCXUEVUA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.654368487 (209h13m49.11646099s) [noise=true , address=45.91.116.5:4299 , piece_id=2YUDNHDTW3DDWZJPHUV4AHHAO6GJI3TVUKMXO3JDBDIG3YB5XLEA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.688906413 (209h13m49.150998906s) [noise=true , address=45.91.116.4:4939 , piece_id=MGTGITWIRGG53CWAY7276LOHSVJGACIAAMSISMKPZGJLECG52PLQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.706565178 (209h13m49.168657671s) [noise=true , address=45.91.116.8:4047 , piece_id=ZSWJVTA7HW7U2IHRKGKDUHNYCCSMK3YJ3KJBQLOIQ773XCGLWV3Q, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.744669075 (209h13m49.206761558s) [noise=true , address=45.91.116.13:4155 , piece_id=JMRFSKD77UQKZXUZIFCQPAAVCNFDNGNV7U2SKSAJDOKARS6NKA5A, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.767094667 (209h13m49.22918715s) [noise=true , address=45.91.116.8:4048 , piece_id=FVQDCO7EYOYOAOORYY7DAQYIAXWBBDN7OF7E5B2Z3MT34QUGGLUQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:30.458020428 (209h14m15.920112912s) [noise=true , address=145.79.227.13:4801 , piece_id=ZL7KE3QVM63VCBNMAUEXELEERW2JC65RTCVUUQKYLFTEJZBZPRVA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:42996->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:42996->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42996->145.79.227.13:4801: use of closed network connection Oct 2 06:45:30.458236099 (209h14m15.920328572s) [noise=true , address=145.79.227.5:4221 , piece_id=SWGYPEIGFBLMMVAUFNIEQ63SL5SEDXFOCGIFCB7C7ZNCDYDZS7BQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:42060->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:42060->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42060->145.79.227.5:4221: use of closed network connection Oct 2 06:45:30.458311102 (209h14m15.920403585s) [noise=true , address=145.79.227.2:4115 , piece_id=DZADXAOVVZSNVIMHVE5N7XA4U7Y2RS6U6JQLTC2X6YSWWSGVP6YQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:55776->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:55776->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55776->145.79.227.2:4115: use of closed network connection Oct 2 06:45:30.458404109 (209h14m15.920496592s) [noise=true , address=145.79.227.11:4730 , piece_id=QEESDYHFF4TTJ6DOW5BAXORGOSWAKLVFDUWMYZT5POSJ6J5D7IOA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:47498->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:47498->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47498->145.79.227.11:4730: use of closed network connection Oct 2 06:45:30.458519669 (209h14m15.920612142s) [noise=true , address=145.79.227.16:4909 , piece_id=DVOXCRCAGC43BIDHGJOGQBZLDM4QBUONXGWF3GVVUZ4V5YSC6NOA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:36010->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:36010->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36010->145.79.227.16:4909: use of closed network connection Oct 2 06:45:30.458566669 (209h14m15.920659152s) [seg_pos={0 0}, upload=183988]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 2 06:45:30.710989853 (209h14m16.173082346s) [upload=183988]: Done uploading segments... Oct 2 06:45:30.711022285 (209h14m16.173114778s) [upload=183988]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 6.253474532s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 6.032928765s FAIL (2025-10-02 07:24:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== 2 06:45:01.165728558 (209h13m46.627821051s) [upload=183988]: Got next segment. Inline: false Oct 2 06:45:01.165773403 (209h13m46.627865886s) [upload=183988]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 2 06:45:01.165780918 (209h13m46.627873401s) [upload=183988]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 06:45:01.431617535 (209h13m46.893710028s) [seg_pos={0 0}, upload=183988]: Begin upload segment... Oct 2 06:45:01.431697767 (209h13m46.89379025s) [seg_pos={0 0}, upload=183988]: Done begin upload segment. Oct 2 06:45:01.431733565 (209h13m46.893826048s) [noise=true , address=45.91.116.11:4118 , piece_id=KBHSEEDCAKKH76W7FBETEES4UXAMTTA2AQAHETDNJ6ZND73X2OGQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.431781507 (209h13m46.89387399s) [noise=true , address=45.91.116.6:4975 , piece_id=ZNB45P2Q3Q3LUS3DG4FPV5IHHBGSCE5VBCXCW3HFL56GN6EKO7JQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.432603612 (209h13m46.894696095s) [noise=true , address=45.91.116.5:4299 , piece_id=2YUDNHDTW3DDWZJPHUV4AHHAO6GJI3TVUKMXO3JDBDIG3YB5XLEA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.433107522 (209h13m46.895199995s) [noise=true , address=145.79.227.16:4909 , piece_id=DVOXCRCAGC43BIDHGJOGQBZLDM4QBUONXGWF3GVVUZ4V5YSC6NOA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.433549994 (209h13m46.895642477s) [noise=true , address=77.90.31.11:4554 , piece_id=J5OKH5FR5YIBUZEN55CPSKDJ7L3O7PGF5VDS2X3C7CGTBCXUEVUA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.434770508 (209h13m46.896862991s) [noise=true , address=45.91.116.8:4047 , piece_id=ZSWJVTA7HW7U2IHRKGKDUHNYCCSMK3YJ3KJBQLOIQ773XCGLWV3Q, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.435293313 (209h13m46.897385796s) [noise=true , address=77.90.31.21:4878 , piece_id=6S3KSKZN7QKWQCSAOJHVNCLET7JBWPZIRNFQI2SX3UKDMT732KLA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.435758981 (209h13m46.897851464s) [noise=true , address=77.90.31.12:4589 , piece_id=OVKIKUBOCPLT3VJVV4ML6QIQLGOA2S4AIBUUR5IYKAUE2IQVUDGA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.436566698 (209h13m46.898659182s) [noise=true , address=145.79.227.2:4115 , piece_id=DZADXAOVVZSNVIMHVE5N7XA4U7Y2RS6U6JQLTC2X6YSWWSGVP6YQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.437037004 (209h13m46.899129487s) [noise=true , address=145.79.227.13:4801 , piece_id=ZL7KE3QVM63VCBNMAUEXELEERW2JC65RTCVUUQKYLFTEJZBZPRVA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.437501258 (209h13m46.899593741s) [noise=true , address=45.91.116.8:4048 , piece_id=FVQDCO7EYOYOAOORYY7DAQYIAXWBBDN7OF7E5B2Z3MT34QUGGLUQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.437998455 (209h13m46.900090938s) [noise=true , address=45.91.116.13:4155 , piece_id=JMRFSKD77UQKZXUZIFCQPAAVCNFDNGNV7U2SKSAJDOKARS6NKA5A, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.439162861 (209h13m46.901255345s) [noise=true , address=45.91.116.4:4939 , piece_id=MGTGITWIRGG53CWAY7276LOHSVJGACIAAMSISMKPZGJLECG52PLQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.439750080 (209h13m46.901842563s) [noise=true , address=45.91.116.12:4227 , piece_id=MGYI2TR4MPA6DKGFYIVMGTGLD5DO5BROGFCKWOP4Z4RNRWOSBPMQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.441380735 (209h13m46.903473208s) [noise=true , address=145.79.227.11:4730 , piece_id=QEESDYHFF4TTJ6DOW5BAXORGOSWAKLVFDUWMYZT5POSJ6J5D7IOA, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:01.443563041 (209h13m46.905655524s) [noise=true , address=145.79.227.5:4221 , piece_id=SWGYPEIGFBLMMVAUFNIEQ63SL5SEDXFOCGIFCB7C7ZNCDYDZS7BQ, seg_pos={0 0}, upload=183988]: Uploading piece... Oct 2 06:45:03.164025603 (209h13m48.626118096s) [upload=183988]: Next returned nil segment Oct 2 06:45:03.164074216 (209h13m48.626166699s) [upload=183988]: Waiting for error group managing segments... Oct 2 06:45:03.564517516 (209h13m49.026609999s) [noise=true , address=45.91.116.6:4975 , piece_id=ZNB45P2Q3Q3LUS3DG4FPV5IHHBGSCE5VBCXCW3HFL56GN6EKO7JQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.610247563 (209h13m49.072340046s) [noise=true , address=77.90.31.21:4878 , piece_id=6S3KSKZN7QKWQCSAOJHVNCLET7JBWPZIRNFQI2SX3UKDMT732KLA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.616241056 (209h13m49.078333549s) [noise=true , address=45.91.116.11:4118 , piece_id=KBHSEEDCAKKH76W7FBETEES4UXAMTTA2AQAHETDNJ6ZND73X2OGQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.632371971 (209h13m49.094464475s) [noise=true , address=77.90.31.12:4589 , piece_id=OVKIKUBOCPLT3VJVV4ML6QIQLGOA2S4AIBUUR5IYKAUE2IQVUDGA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.639558567 (209h13m49.10165105s) [noise=true , address=45.91.116.12:4227 , piece_id=MGYI2TR4MPA6DKGFYIVMGTGLD5DO5BROGFCKWOP4Z4RNRWOSBPMQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.649768408 (209h13m49.111860891s) [noise=true , address=77.90.31.11:4554 , piece_id=J5OKH5FR5YIBUZEN55CPSKDJ7L3O7PGF5VDS2X3C7CGTBCXUEVUA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.654368487 (209h13m49.11646099s) [noise=true , address=45.91.116.5:4299 , piece_id=2YUDNHDTW3DDWZJPHUV4AHHAO6GJI3TVUKMXO3JDBDIG3YB5XLEA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.688906413 (209h13m49.150998906s) [noise=true , address=45.91.116.4:4939 , piece_id=MGTGITWIRGG53CWAY7276LOHSVJGACIAAMSISMKPZGJLECG52PLQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.706565178 (209h13m49.168657671s) [noise=true , address=45.91.116.8:4047 , piece_id=ZSWJVTA7HW7U2IHRKGKDUHNYCCSMK3YJ3KJBQLOIQ773XCGLWV3Q, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.744669075 (209h13m49.206761558s) [noise=true , address=45.91.116.13:4155 , piece_id=JMRFSKD77UQKZXUZIFCQPAAVCNFDNGNV7U2SKSAJDOKARS6NKA5A, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:03.767094667 (209h13m49.22918715s) [noise=true , address=45.91.116.8:4048 , piece_id=FVQDCO7EYOYOAOORYY7DAQYIAXWBBDN7OF7E5B2Z3MT34QUGGLUQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: <nil> Oct 2 06:45:30.458020428 (209h14m15.920112912s) [noise=true , address=145.79.227.13:4801 , piece_id=ZL7KE3QVM63VCBNMAUEXELEERW2JC65RTCVUUQKYLFTEJZBZPRVA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:42996->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:42996->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42996->145.79.227.13:4801: use of closed network connection Oct 2 06:45:30.458236099 (209h14m15.920328572s) [noise=true , address=145.79.227.5:4221 , piece_id=SWGYPEIGFBLMMVAUFNIEQ63SL5SEDXFOCGIFCB7C7ZNCDYDZS7BQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:42060->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:42060->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42060->145.79.227.5:4221: use of closed network connection Oct 2 06:45:30.458311102 (209h14m15.920403585s) [noise=true , address=145.79.227.2:4115 , piece_id=DZADXAOVVZSNVIMHVE5N7XA4U7Y2RS6U6JQLTC2X6YSWWSGVP6YQ, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:55776->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:55776->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55776->145.79.227.2:4115: use of closed network connection Oct 2 06:45:30.458404109 (209h14m15.920496592s) [noise=true , address=145.79.227.11:4730 , piece_id=QEESDYHFF4TTJ6DOW5BAXORGOSWAKLVFDUWMYZT5POSJ6J5D7IOA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:47498->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:47498->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47498->145.79.227.11:4730: use of closed network connection Oct 2 06:45:30.458519669 (209h14m15.920612142s) [noise=true , address=145.79.227.16:4909 , piece_id=DVOXCRCAGC43BIDHGJOGQBZLDM4QBUONXGWF3GVVUZ4V5YSC6NOA, seg_pos={0 0}, upload=183988]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:36010->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:36010->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36010->145.79.227.16:4909: use of closed network connection Oct 2 06:45:30.458566669 (209h14m15.920659152s) [seg_pos={0 0}, upload=183988]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 2 06:45:30.710989853 (209h14m16.173082346s) [upload=183988]: Done uploading segments... Oct 2 06:45:30.711022285 (209h14m16.173114778s) [upload=183988]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 6.032965325s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.561764243s FAIL (2025-10-02 07:23:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.561791074s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)