Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 6.331970842s FAIL (2025-10-02 13:27:24 UTC) orbiter warning: unexpected EOF Duration: 6.331998186s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 6.318443983s FAIL (2025-10-02 13:26:18 UTC) orbiter warning: unexpected EOF Duration: 6.318477376s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 6.196017838s FAIL (2025-10-02 13:25:12 UTC) orbiter warning: unexpected EOF Duration: 6.196048928s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.116970486s FAIL (2025-10-02 13:24:31 UTC) orbiter warning: unexpected EOF Duration: 6.11699871s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 6.040817638s FAIL (2025-10-02 13:23:36 UTC) orbiter warning: unexpected EOF Duration: 6.040853967s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 6.375230464s FAIL (2025-10-02 13:23:18 UTC) orbiter warning: unexpected EOF Duration: 6.375261072s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.530530954s FAIL (2025-10-02 13:22:33 UTC) orbiter warning: unexpected EOF Duration: 6.530561022s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 6.064142573s FAIL (2025-10-02 13:21:45 UTC) orbiter warning: unexpected EOF Duration: 6.064300654s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 6.369593379s FAIL (2025-10-02 13:20:58 UTC) orbiter warning: unexpected EOF Duration: 6.369791908s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 6.335975007s FAIL (2025-10-02 13:19:51 UTC) orbiter warning: unexpected EOF Duration: 6.336002759s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.258589935s FAIL (2025-10-02 13:19:35 UTC) orbiter warning: unexpected EOF Duration: 6.258621845s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 6.095845359s FAIL (2025-10-02 13:18:45 UTC) orbiter warning: unexpected EOF Duration: 6.095902257s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 6.266399405s FAIL (2025-10-02 13:18:24 UTC) orbiter warning: unexpected EOF Duration: 6.266429683s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 6.356254256s FAIL (2025-10-02 13:17:16 UTC) orbiter warning: unexpected EOF Duration: 6.356275287s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 6.311178073s FAIL (2025-10-02 13:16:48 UTC) orbiter warning: unexpected EOF Duration: 6.311207569s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 6.483955834s FAIL (2025-10-02 13:16:22 UTC) orbiter warning: unexpected EOF Duration: 6.483976203s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 6.040832144s FAIL (2025-10-02 13:16:00 UTC) orbiter warning: unexpected EOF Duration: 6.040863796s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 26.676249035s FAIL (2025-10-02 13:15:43 UTC) orbiter warning: unexpected EOF Duration: 26.676616575s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.183644802s FAIL (2025-10-02 08:52:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.183677315s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.103330359s FAIL (2025-10-02 08:51:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.103366007s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 6.277112683s FAIL (2025-10-02 08:50:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.277140575s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 6.430939034s FAIL (2025-10-02 08:50:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.430974331s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 6.120395831s FAIL (2025-10-02 08:49:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.120425827s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 10.913183127s FAIL (2025-10-02 08:48:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 10.913210137s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 6.399981193s FAIL (2025-10-02 08:47:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.400009917s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 6.200796052s FAIL (2025-10-02 08:47:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.20082618s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 6.384156821s FAIL (2025-10-02 08:46:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.384262041s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 7.113888715s FAIL (2025-10-02 08:45:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 7.113947056s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 6.209731947s FAIL (2025-10-02 08:44:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.209798142s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 6.232233589s FAIL (2025-10-02 08:44:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.232268086s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 7.463453527s FAIL (2025-10-02 08:43:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 7.46348629s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 6.269903772s FAIL (2025-10-02 08:42:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.269989305s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 6.796942998s FAIL (2025-10-02 08:42:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.796979908s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 6.59078492s FAIL (2025-10-02 08:40:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.590817661s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 6.560753848s FAIL (2025-10-02 08:40:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.560790176s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 6.441696662s FAIL (2025-10-02 08:39:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.441761745s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 6.334761526s FAIL (2025-10-02 08:38:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.33481652s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 6.701627529s FAIL (2025-10-02 08:37:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.701661213s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 6.548924639s FAIL (2025-10-02 08:37:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.548966349s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 6.758187405s FAIL (2025-10-02 08:36:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.758219476s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 6.15002826s FAIL (2025-10-02 08:35:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.150060761s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 5.983040946s FAIL (2025-10-02 08:34:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.983076253s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 6.389134715s FAIL (2025-10-02 08:33:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.389290311s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 7.073306143s FAIL (2025-10-02 08:32:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 7.073343545s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.2222499s FAIL (2025-10-02 08:32:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.222306098s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.803792197s FAIL (2025-10-02 08:31:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 5.803846191s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 6.123124102s FAIL (2025-10-02 08:30:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.123159929s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 6.21572348s FAIL (2025-10-02 08:29:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.215756313s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 7.898584146s FAIL (2025-10-02 08:28:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 7.898618832s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 6.062225343s FAIL (2025-10-02 08:27:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== _ObjectBegin Oct 2 08:05:53.155202229 (210h34m38.617294702s) [upload=185172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 2 08:05:53.403443175 (210h34m38.865535648s) [seg_pos={0 0}, upload=185172]: Begin upload segment... Oct 2 08:05:53.403513839 (210h34m38.865606322s) [seg_pos={0 0}, upload=185172]: Done begin upload segment. Oct 2 08:05:53.403541703 (210h34m38.865634186s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.403557814 (210h34m38.865650297s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404175349 (210h34m38.866267822s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404617692 (210h34m38.866710175s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.404954884 (210h34m38.867047367s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405252300 (210h34m38.867344783s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.405648916 (210h34m38.867741399s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406216686 (210h34m38.868309159s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.406565731 (210h34m38.868658214s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407059652 (210h34m38.869152125s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.407691636 (210h34m38.869784109s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.408204272 (210h34m38.870296755s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.411015475 (210h34m38.873107958s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.412320620 (210h34m38.874413093s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.413423601 (210h34m38.875516074s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:53.414687948 (210h34m38.876780431s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Uploading piece... Oct 2 08:05:55.195117584 (210h34m40.657210067s) [upload=185172]: Next returned nil segment Oct 2 08:05:55.195143483 (210h34m40.657235976s) [upload=185172]: Waiting for error group managing segments... Oct 2 08:05:55.522823269 (210h34m40.984915742s) [noise=true , address=45.91.116.7:4011 , piece_id=LHP4SDPN5CDMR5GN6JMSCYT5LFNWJTGDOKTU4NHI5UVUXBSUN3UA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.539354197 (210h34m41.00144668s) [noise=true , address=45.91.116.12:4227 , piece_id=FV3GK44W2T5B63IU3UV7A4RNFVOK3LZB4YGA5B2OW23BQA5YV62A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.589618242 (210h34m41.051710715s) [noise=true , address=45.91.116.11:4119 , piece_id=37NIDNY3RIF63W76XR3GBITAFXDHANVPCSVJ6QUXC2KYOLCR4SAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:55.594484328 (210h34m41.056576811s) [noise=true , address=77.90.31.17:4771 , piece_id=NNCNKRLOSUUS3G5LXQWSRXPHZAVQYCBY3JW4TUPU7THQJAVTRSGQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:05:56.318766523 (210h34m41.780859006s) [noise=true , address=77.90.31.18:4806 , piece_id=SZJU4MDIDLJMG43MNMYTFW777O4L6JR6RDV6Z6LAFIX2Q53OUFVA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:16.102298642 (210h35m1.564391125s) [noise=true , address=145.79.227.18:4007 , piece_id=JF7F6YTDT4DD4WFKGIQSLGWV6HB5U5U44GMOIITMFRQZD363S5LQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:21.846752098 (210h35m7.308844581s) [noise=true , address=145.79.227.14:4839 , piece_id=VXEO345DEC7IR52VOXUGGG2XRJAZRIZ5Z2MN7SBYKQN7STTJR77Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.103357463 (210h35m7.565449946s) [noise=true , address=145.79.227.13:4804 , piece_id=YGOTNECBQKR3CNRFTQ43TRMMMZ66YRURSSISO4UDSN4VBZZ7EOTA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.281626336 (210h35m7.743718819s) [noise=true , address=145.79.227.11:4729 , piece_id=BQBD7H72F6SPZPCQONCPCJAQ4M2IU236A6LKLINJJ35OBJPHWUAQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: <nil> Oct 2 08:06:22.468696781 (210h35m7.930789274s) [noise=true , address=145.79.227.5:4223 , piece_id=4XQZXDWFMYJMQIUA5LXVIC6JZPO53JJA5C7VKP3JICKWL6LKVY6Q, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56204->145.79.227.5:4223: use of closed network connection Oct 2 08:06:22.468804075 (210h35m7.930896558s) [noise=true , address=145.79.227.2:4114 , piece_id=UEFUJAPXQXIPIFYEPFBMEBVWTPEEO5CBWRPJXVKMVLOFXPOQMXPQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36462->145.79.227.2:4114: use of closed network connection Oct 2 08:06:22.468949423 (210h35m7.931041916s) [noise=true , address=145.79.227.19:4077 , piece_id=SQDAVXAWL2UK2446FMC7MZDCWNCB5KLAN7KRO3YTIEZPPVEWNHKA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32804->145.79.227.19:4077: use of closed network connection Oct 2 08:06:22.469161777 (210h35m7.93125426s) [noise=true , address=145.79.227.14:4837 , piece_id=B2DLY4UVRRKA4BAAPYT6V5OYRLJ5MTCRLNYYXW7JTPISV4S3H2JQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469218104 (210h35m7.931310587s) [noise=true , address=145.79.227.15:4876 , piece_id=V7X2R5A7TA557GXGUYQSK6MA4RKZ7BYOSMW3J3TQAAXON6QZ4AEA, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: expected piece hash; context deadline exceeded; EOF Oct 2 08:06:22.469308837 (210h35m7.93140133s) [noise=true , address=145.79.227.4:4185 , piece_id=GTXCR3RZLF3EWI3MXLED3EJ6RH3JK2WDUM3ITJJX7HKWIEJNDF5A, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40846->145.79.227.4:4185: use of closed network connection Oct 2 08:06:22.469829148 (210h35m7.931921641s) [noise=true , address=145.79.227.16:4909 , piece_id=JCDLSDG2NSIZLH2Z2LJYPH3LUFHBAWXD7U35YTK7TRUHOKFC6UDQ, seg_pos={0 0}, upload=185172]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection; write tcp 188.166.225.170:54680->145.79.227.16:4909: use of closed network connection Oct 2 08:06:22.469905503 (210h35m7.931997986s) [seg_pos={0 0}, upload=185172]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 2 08:06:22.716705124 (210h35m8.178797697s) [upload=185172]: Done uploading segments... Oct 2 08:06:22.716735833 (210h35m8.178828316s) [upload=185172]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration:* 6.062258565s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)