Orbiter History

Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 430446 reports (Page 8314 of 8609)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.60169806s FAIL (2025-07-09 11:18:46 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.601743108s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.971415723s FAIL (2025-07-09 11:17:35 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.971451131s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.849199353s FAIL (2025-07-09 11:17:09 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.849224632s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.601260071s FAIL (2025-07-09 11:16:31 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.601290419s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.845687132s FAIL (2025-07-09 11:15:27 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.845713654s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.851764519s FAIL (2025-07-09 11:14:20 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.851788295s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.573917132s FAIL (2025-07-09 11:13:33 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.573946328s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.498606638s FAIL (2025-07-09 11:12:45 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.498669738s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.650186246s FAIL (2025-07-09 11:12:02 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.650216794s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 54.582964993s FAIL (2025-07-09 11:11:49 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 54.582980413s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.237587363s FAIL (2025-07-09 11:10:54 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6033721s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235792171 (385h59m30.006433506s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.235878076 (385h59m30.006519411s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236054272 (385h59m30.006695607s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236307997 (385h59m30.006949333s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236464537 (385h59m30.007105922s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236548648 (385h59m30.007189983s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236812513 (385h59m30.007453848s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.236933605 (385h59m30.00757494s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237113579 (385h59m30.007754915s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237156341 (385h59m30.007797666s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237373316 (385h59m30.008014651s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237411439 (385h59m30.008052774s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237578508 (385h59m30.008219843s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237684331 (385h59m30.008325666s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.237932205 (385h59m30.00857354s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238155823 (385h59m30.008797158s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:55.238380482 (385h59m30.009021817s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Uploading piece... Jul 9 11:09:56.345582902 (385h59m31.116224237s) [upload=308828]: Next returned nil segment Jul 9 11:09:56.345600635 (385h59m31.11624197s) [upload=308828]: Waiting for error group managing segments... Jul 9 11:09:56.625260973 (385h59m31.395902308s) [noise=true , address=79.127.205.233:4645 , piece_id=OO2JUSXBO7X27K6SUT2WWS42OEDZDTW2BLUAAMAXLVAUC3NBZLTA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:56.631625179 (385h59m31.402266514s) [noise=true , address=79.127.205.246:4280 , piece_id=NBYEURBIQLER45GAJRXXHVIU7FIDVQVCSZHQXESD5G4ZWSKATWZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.034892760 (385h59m31.805534095s) [noise=true , address=104.36.82.40:4971 , piece_id=5CUFV63Q5GUVBZIG4PJC7A5XCQGRVMDB5RIE7C6MCYXV3RTFM3HQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.044325937 (385h59m31.814967262s) [noise=true , address=104.36.82.36:4628 , piece_id=QYX73L3XWNVKZRPBMYFXFGWZNZ7D6C3YOS6SRPB4GBFPBCTQVSZQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.075898190 (385h59m31.846539515s) [noise=true , address=104.36.82.42:4804 , piece_id=JHU5K2NNZAHLF33NZUZSW3OJZABI6TTN6YG547EMRVCAVIXR2CVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.086444327 (385h59m31.857085652s) [noise=true , address=104.36.82.6:4884 , piece_id=B5LTSLQ4AF6DYGIPQSNNSFVQ2MRDXD5V5GZIK2UH6UTEYAJYPLMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.102041286 (385h59m31.872682631s) [noise=true , address=104.36.82.19:4424 , piece_id=EOQKX6PEUU5VVFPQEHXDQOCC6BWOH56CHT53GDXS2Z2F7EHOMVFQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.115912725 (385h59m31.88655407s) [noise=true , address=104.36.82.22:4516 , piece_id=2ZRA4YFM6XLCV5V5XXPDOURB3P5WHZSOE5CWAMYKXB6ZYISRUSKA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.145012557 (385h59m31.915653912s) [noise=true , address=104.36.82.18:4399 , piece_id=PDLJRGZPO55PG745P4ITZMWPBJAF62PEL4MLMPB3NE4WZEVW2VSA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:09:57.169224219 (385h59m31.939865544s) [noise=true , address=104.36.82.34:4549 , piece_id=AHEA7ZJ5XURGNH5YZLUIAHMTCUMJOF2HD72NRSTZ3ZL6THKYJSTQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:01.603865460 (385h59m36.374506795s) [noise=true , address=45.91.116.5:4304 , piece_id=ZQBJBAD7LNECRZ2K7UOT3PXHB4BF5P32BNRCTTDNE54DYNG4LQAA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:03.129948310 (385h59m37.900589645s) [noise=true , address=45.91.116.7:4016 , piece_id=XNULF3XZ5XUUTGUAX3GXB5SBPVXWMNVXJQEXDXOKZOVLRC5FR44Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:44.395341646 (386h0m19.165982971s) [noise=true , address=77.90.31.19:4859 , piece_id=7OWC6NQ6EMZK7QN7BIJ7LCXJOMO3SMV4BPBH2FZTQTH34HN5KZNA, seg_pos={0 0}, upload=308828]: Done uploading piece. err: <nil> Jul 9 11:10:54.160641391 (386h0m28.931282716s) [noise=true , address=77.90.31.12:4602 , piece_id=AVK6AQJXPVBCW4VWCR7NIAJWCZWM37G3CXFBDEA6OUVT7U7VXMKQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 11:10:54.160809813 (386h0m28.931451138s) [noise=true , address=77.90.31.13:4630 , piece_id=GPSFSH7BUJW4DTYBP53BXKQFRL6KMIKWS2SQITCRJ6GMTOCWOH4Q, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn, address:77.90.31.13:4630): protocol: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32960->77.90.31.13:4630: use of closed network connection Jul 9 11:10:54.160866010 (386h0m28.931507345s) [noise=true , address=77.90.31.16:4751 , piece_id=GXEEI4XH67IR5PSQU3VWG5WZR3LW553KBXU6GWAV62AXF4SPRDVQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:12Sj7nPQiL1EmwvnVCpRv1HEeDYFnknTXLNZTvhAUmHDcP2Wpuf, address:77.90.31.16:4751): protocol: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37994->77.90.31.16:4751: use of closed network connection Jul 9 11:10:54.160909424 (386h0m28.931550759s) [noise=true , address=77.90.31.10:4529 , piece_id=4H2OCF5QTP3EIDVSJ5BJ4RQ4UQHYO6OL5VL7RLUZHIBS7RVSSDMQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:122zPTREDCWCmywLC5fsUzDr59NHxzFMAUTp23icLjJzL7mHgdm, address:77.90.31.10:4529): protocol: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60698->77.90.31.10:4529: use of closed network connection Jul 9 11:10:54.160925774 (386h0m28.931567109s) [noise=true , address=77.90.31.11:4558 , piece_id=XZXB6FG2H65BX3FJ6T5I7ACORVRELIK43JAVH74HQRPD7G2UCKLQ, seg_pos={0 0}, upload=308828]: Done uploading piece. err: ecclient: upload failed (node:1mGEP1n1icC2gEkyRVy6BeM4vsrgqYWaQeB5rUtxjrWQjyFhTS, address:77.90.31.11:4558): protocol: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47974->77.90.31.11:4558: use of closed network connection Jul 9 11:10:54.160949540 (386h0m28.931590875s) [seg_pos={0 0}, upload=308828]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 11:10:54.396491572 (386h0m29.167132907s) [upload=308828]: Done uploading segments... Jul 9 11:10:54.396527270 (386h0m29.167168605s) [upload=308828]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1m0.237609825s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 744.307935ms target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-07-09 07:29:39 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 744.335908ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 732.053379ms target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-07-09 07:29:05 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 732.071403ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 863.57259ms target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-07-09 07:28:32 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 863.643568ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 733.841671ms target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-07-09 07:27:43 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 733.870225ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 882.268991ms target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-07-09 07:27:14 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 882.291564ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.328706506s FAIL (2025-07-09 07:26:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.328726526s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 721.672329ms target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-07-09 07:26:03 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 721.709048ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.917595719s FAIL (2025-07-09 07:25:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.917636547s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 700.117597ms target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-07-09 07:24:59 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 700.139549ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 6.180381795s FAIL (2025-07-09 07:24:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.180403206s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 753.259922ms target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-07-09 07:23:59 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 753.280703ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 6.249283688s FAIL (2025-07-09 07:23:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.249307592s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 719.267548ms target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-07-09 07:22:55 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 719.291412ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 6.26109777s FAIL (2025-07-09 07:22:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.261117848s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.997941161s FAIL (2025-07-09 07:22:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.99796202s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 704.688624ms target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-07-09 07:22:25 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 704.719043ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 6.29688189s FAIL (2025-07-09 07:22:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.2968973s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.278727459s FAIL (2025-07-09 07:21:47 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2.2787542s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 702.018466ms target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-07-09 07:21:14 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 702.043254ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 6.069168463s FAIL (2025-07-09 07:21:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.069196095s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.268724821s FAIL (2025-07-09 07:20:57 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2.268745501s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 774.293059ms target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-07-09 07:20:47 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 774.321073ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.940096791s FAIL (2025-07-09 07:20:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.940117682s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.263161758s FAIL (2025-07-09 07:20:23 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2.263185634s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.299273197s FAIL (2025-07-09 07:19:49 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2.299298826s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 794.760769ms target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-07-09 07:19:34 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 794.789295ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 7.001181866s FAIL (2025-07-09 07:19:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.001206214s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 814.690397ms target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-07-09 07:19:16 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 814.715555ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.297321804s FAIL (2025-07-09 07:19:10 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2.297371508s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 5.883138035s FAIL (2025-07-09 07:19:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.883154947s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 1.00118414s target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-07-09 07:18:54 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 1.001204769s edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.589910682s FAIL (2025-07-09 07:18:26 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2.589937564s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.622456699s FAIL (2025-07-09 07:18:09 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2.62248382s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 6.538584651s FAIL (2025-07-09 07:18:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.538621913s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.324670622s FAIL (2025-07-09 07:17:53 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2.324687814s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 847.07371ms target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-07-09 07:17:41 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 847.098026ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.446299531s FAIL (2025-07-09 07:17:29 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2.446326221s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 799.955466ms target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-07-09 07:17:13 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 799.983218ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 6.308281572s FAIL (2025-07-09 07:17:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.308303896s edge gateway us-select-1

1
...
8312
8313
8314
8315
8316
...
8609