Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.796348788s FAIL (2025-07-09 15:17:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.796368305s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.139179762s FAIL (2025-07-09 15:16:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.139206234s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 6.485168642s FAIL (2025-07-09 15:15:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.485189162s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 6.371601149s FAIL (2025-07-09 15:15:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.371619775s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 6.267756869s FAIL (2025-07-09 15:14:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.267770425s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 6.491083136s FAIL (2025-07-09 15:13:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.491447183s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 6.203328907s FAIL (2025-07-09 15:13:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.203348926s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 6.068532003s FAIL (2025-07-09 15:12:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.06857233s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.000733209s FAIL (2025-07-09 15:11:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.00076478s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.750145927s FAIL (2025-07-09 11:53:50 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.750168769s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.129177377s FAIL (2025-07-09 11:52:59 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 6.129201131s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.780497816s FAIL (2025-07-09 11:52:16 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.780517724s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.763339255s FAIL (2025-07-09 11:51:57 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.763370234s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.828694353s FAIL (2025-07-09 11:51:23 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.828725493s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.570078099s FAIL (2025-07-09 11:50:34 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.570098607s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.610345948s FAIL (2025-07-09 11:49:41 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.610371736s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.711435062s FAIL (2025-07-09 11:48:54 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.711462804s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.693136518s FAIL (2025-07-09 11:47:48 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.693164793s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.588301576s FAIL (2025-07-09 11:47:14 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.588329909s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 5.612264839s FAIL (2025-07-09 11:46:07 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.612294536s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 5.858228153s FAIL (2025-07-09 11:44:56 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.858261006s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.804981888s FAIL (2025-07-09 11:44:11 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.805004943s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 5.829426133s FAIL (2025-07-09 11:43:07 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.829453636s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 5.592232493s FAIL (2025-07-09 11:42:35 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.592259806s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.701580584s FAIL (2025-07-09 11:42:06 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.701605302s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.605196219s FAIL (2025-07-09 11:41:38 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.605228692s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.544834017s FAIL (2025-07-09 11:41:15 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.544854727s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.822091797s FAIL (2025-07-09 11:40:04 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.822124189s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.79285396s FAIL (2025-07-09 11:39:47 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.792876043s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.893026418s FAIL (2025-07-09 11:39:04 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.893057427s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.778464s FAIL (2025-07-09 11:38:24 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.778493087s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.661923268s FAIL (2025-07-09 11:37:16 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.661948386s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 5.845792851s FAIL (2025-07-09 11:36:12 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.845812859s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 6.013357061s FAIL (2025-07-09 11:34:57 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 6.013384071s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 5.883491935s FAIL (2025-07-09 11:34:13 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.883550237s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 5.539566897s FAIL (2025-07-09 11:33:48 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.539617784s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.613738863s FAIL (2025-07-09 11:32:37 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.613771836s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.551482888s FAIL (2025-07-09 11:32:21 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.551512924s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 5.547445893s FAIL (2025-07-09 11:31:58 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.547472533s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.948107595s FAIL (2025-07-09 11:31:13 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.948134629s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.599074347s FAIL (2025-07-09 11:30:56 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.59910164s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.547731629s FAIL (2025-07-09 11:29:56 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.547758771s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.857603537s FAIL (2025-07-09 11:29:02 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.857629478s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.545049528s FAIL (2025-07-09 11:28:46 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.545073014s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.753404456s FAIL (2025-07-09 11:28:01 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.75343163s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.855413636s FAIL (2025-07-09 11:27:31 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.855438895s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.627190778s FAIL (2025-07-09 11:26:48 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.627219492s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.753644276s FAIL (2025-07-09 11:26:31 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.753673925s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.528399334s FAIL (2025-07-09 11:25:45 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.528423861s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.730402119s FAIL (2025-07-09 11:25:14 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.730428319s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)