Orbiter History

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 459.461946ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:51:56 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 459.496762ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............................................X.......XXX...] duration: 5.891836029s FAIL (2025-07-18 16:51:46 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== upload=485950]: Uploading piece... Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments... Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments... Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 5.891866858s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...............................................X.......XXX..] duration: 5.718351211s FAIL (2025-07-18 16:51:30 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== upload=485950]: Uploading piece... Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments... Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments... Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 5.718379967s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 457.811338ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:51:23 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 457.836897ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [X...............................................X.......XXX.] duration: 5.871842505s FAIL (2025-07-18 16:51:08 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== upload=485950]: Uploading piece... Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments... Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments... Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 5.871866521s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 466.807317ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:50:59 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 466.83012ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 480.365659ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:50:59 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 480.383094ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.X...............................................X.......XXX] duration: 30.245379376s FAIL (2025-07-18 16:50:41 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== upload=485950]: Uploading piece... Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece... Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments... Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil> Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments... Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 30.245401869s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 452.373903ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:50:38 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 452.392027ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 449.690128ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:50:23 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 449.714604ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 449.516275ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:50:16 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 449.56061ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X...............................................X.......XX] duration: 30.264959091s FAIL (2025-07-18 16:49:55 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== RAQQ, seg_pos={0 0}, upload=485939]: Uploading piece... Jul 18 16:49:25.832084524 (607h39m0.602725859s) [noise=true , address=104.36.82.5:4837 , piece_id=YTPEULPCB2G3NWLPYKB76JR6BUDPKCJNXIBWBKYWSPPAPW6SY7XA, seg_pos={0 0}, upload=485939]: Uploading piece... Jul 18 16:49:25.832423233 (607h39m0.603064568s) [noise=true , address=104.36.82.13:4186 , piece_id=4HCXL6XMHIOACAYUB4KYP2DQRRB3LVKRDV26DVAYRNTQC5IQ5HBA, seg_pos={0 0}, upload=485939]: Uploading piece... Jul 18 16:49:25.832812127 (607h39m0.603453462s) [noise=true , address=77.90.31.12:4590 , piece_id=THBQORFABU3TU2DKBUVX33LERKLZZUVVQJNQ4LKHICFUUDGGTRTQ, seg_pos={0 0}, upload=485939]: Uploading piece... Jul 18 16:49:25.833076874 (607h39m0.603718209s) [noise=true , address=77.90.31.17:4772 , piece_id=JDVMGT2AFIAALVNIIERCVNBZL54ZQJ4FUID7JHRKLJAZVVGOU7NA, seg_pos={0 0}, upload=485939]: Uploading piece... Jul 18 16:49:25.833188487 (607h39m0.603829822s) [noise=true , address=104.36.82.6:4874 , piece_id=XXCJULJHVDLQ6HE43P7T32IOWUHJY3RWDZUWSFM766USLSRBLIZQ, seg_pos={0 0}, upload=485939]: Uploading piece... Jul 18 16:49:25.833673124 (607h39m0.604314459s) [noise=true , address=45.91.116.11:4118 , piece_id=AG2KDEDYWBL5BLCC2I2MOWXQISTNCGVSSIIJK4QYUJGF7RVWVF7Q, seg_pos={0 0}, upload=485939]: Uploading piece... Jul 18 16:49:25.834052771 (607h39m0.604694096s) [noise=true , address=77.90.31.13:4626 , piece_id=FLRJD3ODKKFZTDNDYIE3B4W4I4JMKKSSUFLN2AINA2HCKLDF5JIQ, seg_pos={0 0}, upload=485939]: Uploading piece... Jul 18 16:49:25.834388974 (607h39m0.605030339s) [noise=true , address=104.36.82.6:4875 , piece_id=H6IM2OVCHJ6NZNR7KGDP3VDMI5THAOO23LAWTTHYV4UIOHQGPN2Q, seg_pos={0 0}, upload=485939]: Uploading piece... Jul 18 16:49:25.834887238 (607h39m0.605528573s) [noise=true , address=77.90.31.11:4555 , piece_id=NAMMNAOEUNRML4EHUDG7NQXUOB6TEJJPCUQ2BNBWVTJABTHPJGEQ, seg_pos={0 0}, upload=485939]: Uploading piece... Jul 18 16:49:25.835182642 (607h39m0.605823977s) [noise=true , address=77.90.31.17:4771 , piece_id=7OFZE5NP745NKSMPR5WMHGENAPSLYQFMCFMSPKID2WAS64BIASMQ, seg_pos={0 0}, upload=485939]: Uploading piece... Jul 18 16:49:25.835440697 (607h39m0.606082032s) [noise=true , address=77.90.31.12:4592 , piece_id=NZVHUTWPL2A3JVIUSQYNB6LBEUZGR7UVVFBMA4MECQURBVM4J2IA, seg_pos={0 0}, upload=485939]: Uploading piece... Jul 18 16:49:25.835685595 (607h39m0.60632693s) [noise=true , address=45.91.116.4:4939 , piece_id=W5SLCZJRIGDRDG53B6XATNRJJM2XUQZUNKOJBWCDLUVUZEFFTK2Q, seg_pos={0 0}, upload=485939]: Uploading piece... Jul 18 16:49:25.835952525 (607h39m0.60659386s) [noise=true , address=45.91.116.7:4010 , piece_id=2O55BJR6S5VH7E63OHNQCLAMREQA56ROUEER7KTYDCTPK474O2HQ, seg_pos={0 0}, upload=485939]: Uploading piece... Jul 18 16:49:25.836349395 (607h39m0.60699073s) [noise=true , address=77.90.31.14:4663 , piece_id=T6N25OYJIFE7EVKI4DTDUH6TYEC4TC7ZE76VOFLA22HKJV465XYQ, seg_pos={0 0}, upload=485939]: Uploading piece... Jul 18 16:49:27.593855492 (607h39m2.364496827s) [upload=485939]: Next returned nil segment Jul 18 16:49:27.593871343 (607h39m2.364512678s) [upload=485939]: Waiting for error group managing segments... Jul 18 16:49:27.876601100 (607h39m2.647242435s) [noise=true , address=104.36.82.6:4874 , piece_id=XXCJULJHVDLQ6HE43P7T32IOWUHJY3RWDZUWSFM766USLSRBLIZQ, seg_pos={0 0}, upload=485939]: Done uploading piece. err: <nil> Jul 18 16:49:27.891636548 (607h39m2.662277883s) [noise=true , address=45.91.116.5:4299 , piece_id=SC6HQRBMCW26YCQ24G2VZ7TFME7EJY67HCCDDF2LR3O2MSFORAQQ, seg_pos={0 0}, upload=485939]: Done uploading piece. err: <nil> Jul 18 16:49:27.981320624 (607h39m2.751961959s) [noise=true , address=104.36.82.13:4186 , piece_id=4HCXL6XMHIOACAYUB4KYP2DQRRB3LVKRDV26DVAYRNTQC5IQ5HBA, seg_pos={0 0}, upload=485939]: Done uploading piece. err: <nil> Jul 18 16:49:27.982583610 (607h39m2.753224945s) [noise=true , address=45.91.116.11:4118 , piece_id=AG2KDEDYWBL5BLCC2I2MOWXQISTNCGVSSIIJK4QYUJGF7RVWVF7Q, seg_pos={0 0}, upload=485939]: Done uploading piece. err: <nil> Jul 18 16:49:28.022229506 (607h39m2.792870841s) [noise=true , address=104.36.82.5:4837 , piece_id=YTPEULPCB2G3NWLPYKB76JR6BUDPKCJNXIBWBKYWSPPAPW6SY7XA, seg_pos={0 0}, upload=485939]: Done uploading piece. err: <nil> Jul 18 16:49:28.029692524 (607h39m2.800333859s) [noise=true , address=104.36.82.6:4875 , piece_id=H6IM2OVCHJ6NZNR7KGDP3VDMI5THAOO23LAWTTHYV4UIOHQGPN2Q, seg_pos={0 0}, upload=485939]: Done uploading piece. err: <nil> Jul 18 16:49:28.037395503 (607h39m2.808036838s) [noise=true , address=45.91.116.7:4010 , piece_id=2O55BJR6S5VH7E63OHNQCLAMREQA56ROUEER7KTYDCTPK474O2HQ, seg_pos={0 0}, upload=485939]: Done uploading piece. err: <nil> Jul 18 16:49:28.116581744 (607h39m2.887223079s) [noise=true , address=45.91.116.4:4939 , piece_id=W5SLCZJRIGDRDG53B6XATNRJJM2XUQZUNKOJBWCDLUVUZEFFTK2Q, seg_pos={0 0}, upload=485939]: Done uploading piece. err: <nil> Jul 18 16:49:54.941381378 (607h39m29.712022713s) [noise=true , address=77.90.31.17:4772 , piece_id=JDVMGT2AFIAALVNIIERCVNBZL54ZQJ4FUID7JHRKLJAZVVGOU7NA, seg_pos={0 0}, upload=485939]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: expected piece hash; context deadline exceeded; EOF Jul 18 16:49:54.941764562 (607h39m29.712405897s) [noise=true , address=77.90.31.12:4589 , piece_id=L7KSG7QPWQ3REYFQQJEVD2W5GV4IYDLJYNWTSM6VMV54HHA6B54Q, seg_pos={0 0}, upload=485939]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 188.166.225.170:34884->77.90.31.12:4589: use of closed network connection; write tcp 188.166.225.170:34884->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34884->77.90.31.12:4589: use of closed network connection Jul 18 16:49:54.941826610 (607h39m29.712467945s) [noise=true , address=77.90.31.13:4626 , piece_id=FLRJD3ODKKFZTDNDYIE3B4W4I4JMKKSSUFLN2AINA2HCKLDF5JIQ, seg_pos={0 0}, upload=485939]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:50232->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:50232->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50232->77.90.31.13:4626: use of closed network connection Jul 18 16:49:54.941880533 (607h39m29.712521868s) [noise=true , address=77.90.31.14:4663 , piece_id=T6N25OYJIFE7EVKI4DTDUH6TYEC4TC7ZE76VOFLA22HKJV465XYQ, seg_pos={0 0}, upload=485939]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:45796->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:45796->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45796->77.90.31.14:4663: use of closed network connection Jul 18 16:49:54.941887326 (607h39m29.712528661s) [noise=true , address=77.90.31.12:4592 , piece_id=NZVHUTWPL2A3JVIUSQYNB6LBEUZGR7UVVFBMA4MECQURBVM4J2IA, seg_pos={0 0}, upload=485939]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:36598->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:36598->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36598->77.90.31.12:4592: use of closed network connection Jul 18 16:49:54.941911793 (607h39m29.712553128s) [noise=true , address=77.90.31.11:4555 , piece_id=NAMMNAOEUNRML4EHUDG7NQXUOB6TEJJPCUQ2BNBWVTJABTHPJGEQ, seg_pos={0 0}, upload=485939]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 188.166.225.170:57626->77.90.31.11:4555: use of closed network connection; write tcp 188.166.225.170:57626->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57626->77.90.31.11:4555: use of closed network connection Jul 18 16:49:54.941916882 (607h39m29.712558217s) [noise=true , address=77.90.31.17:4771 , piece_id=7OFZE5NP745NKSMPR5WMHGENAPSLYQFMCFMSPKID2WAS64BIASMQ, seg_pos={0 0}, upload=485939]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:43026->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:43026->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43026->77.90.31.17:4771: use of closed network connection Jul 18 16:49:54.941935739 (607h39m29.712577074s) [noise=true , address=77.90.31.12:4590 , piece_id=THBQORFABU3TU2DKBUVX33LERKLZZUVVQJNQ4LKHICFUUDGGTRTQ, seg_pos={0 0}, upload=485939]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 188.166.225.170:50312->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:50312->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50312->77.90.31.12:4590: use of closed network connection Jul 18 16:49:54.941949294 (607h39m29.712590629s) [seg_pos={0 0}, upload=485939]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 18 16:49:55.205617119 (607h39m29.976258454s) [upload=485939]: Done uploading segments... Jul 18 16:49:55.205643219 (607h39m29.976284544s) [upload=485939]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 30.264978679s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 459.327137ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:49:53 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 459.34977ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 451.292974ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:49:26 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 451.309396ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [X..X...............................................X.......X] duration: 30.237241204s FAIL (2025-07-18 16:48:57 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== timal: 13 errs: <nil> Jul 18 16:47:27.457854660 (607h37m2.228495995s) [upload=485909]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:47:27.457859329 (607h37m2.228500654s) [upload=485909]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:47:27.926140369 (607h37m2.696781704s) [upload=485909]: Done uploading segments... Jul 18 16:47:27.926159124 (607h37m2.696800459s) [upload=485909]: Upload finished. err: <nil> Jul 18 16:48:27.507702784 (607h38m2.278344119s) [upload=485925]: Starting upload Jul 18 16:48:27.507768770 (607h38m2.278410135s) [upload=485925]: Done starting upload Jul 18 16:48:27.507849354 (607h38m2.278490689s) [upload=485925]: Uploading segments... Jul 18 16:48:27.508070848 (607h38m2.278712173s) [upload=485925]: Got next segment. Inline: false Jul 18 16:48:27.508106226 (607h38m2.278747561s) [upload=485925]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:48:27.508110725 (607h38m2.27875206s) [upload=485925]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:48:27.810487953 (607h38m2.581129288s) [seg_pos={0 0}, upload=485925]: Begin upload segment... Jul 18 16:48:27.810539572 (607h38m2.581180907s) [seg_pos={0 0}, upload=485925]: Done begin upload segment. Jul 18 16:48:27.810562406 (607h38m2.581203731s) [noise=true , address=104.36.82.16:4293 , piece_id=S4W6WBLHXOYQXR67BQHBKTAYJYE4ZJP3BZP3OLJ3SJOKLET2ZZBA, seg_pos={0 0}, upload=485925]: Uploading piece... Jul 18 16:48:27.810617461 (607h38m2.581258796s) [noise=true , address=45.91.116.9:4262 , piece_id=C3WLEWLH6X6PWGAZ7LTO62VP3UUGUURGGBTSJHDNXXS7XEOV2VAA, seg_pos={0 0}, upload=485925]: Uploading piece... Jul 18 16:48:27.811045329 (607h38m2.581686664s) [noise=true , address=104.36.82.2:4729 , piece_id=3G46BW55NHMENDHNWFLLQ27K72LT3X4EGOKGJFLQ5Z2TO5WYCVHA, seg_pos={0 0}, upload=485925]: Uploading piece... Jul 18 16:48:27.811194145 (607h38m2.58183551s) [noise=true , address=77.90.31.18:4806 , piece_id=WFGHWDD5SFNRWMGLJWBUGHE5UN6UTKGPFBTMWHI3NZSXB3ONQUQQ, seg_pos={0 0}, upload=485925]: Uploading piece... Jul 18 16:48:27.811346426 (607h38m2.581987761s) [noise=true , address=104.36.82.13:4187 , piece_id=IZV6SDX5HFERNRE7KBO5Q4EKDLFJZEKHSJS4WACXH7DAYGL2RZIQ, seg_pos={0 0}, upload=485925]: Uploading piece... Jul 18 16:48:27.811758855 (607h38m2.58240019s) [noise=true , address=104.36.82.15:4257 , piece_id=GVEGTFRXZYKBOUD7YLZFBTKLUPOL543E4QD5G57XFMALB4LB4IUA, seg_pos={0 0}, upload=485925]: Uploading piece... Jul 18 16:48:27.811951283 (607h38m2.582592618s) [noise=true , address=45.91.116.11:4119 , piece_id=UDVEQMY2IIILIJ2PRL2QYP62H3HUNA2EAWNDZX3ECSBEZIKZTEDA, seg_pos={0 0}, upload=485925]: Uploading piece... Jul 18 16:48:27.812204046 (607h38m2.582845381s) [noise=true , address=45.91.116.13:4155 , piece_id=ZZB7ITHHGM7ORNFWUVMZ7D5AGR3GHSEU5XNQF5H3ACKSDBHPNUQQ, seg_pos={0 0}, upload=485925]: Uploading piece... Jul 18 16:48:27.812217493 (607h38m2.582858828s) [noise=true , address=104.36.82.14:4222 , piece_id=MP3GLHCZPW2WRHIZMOGVR3R4DCSNIEULDBQMIKPVDH2A45DM3ZFQ, seg_pos={0 0}, upload=485925]: Uploading piece... Jul 18 16:48:27.812535031 (607h38m2.583176386s) [noise=true , address=77.90.31.11:4554 , piece_id=NLBEHZGD56TNSECGFAQWKS3QDLXKUFQCGBALS3CCYZE4QGLXPQ5Q, seg_pos={0 0}, upload=485925]: Uploading piece... Jul 18 16:48:27.812596177 (607h38m2.583237522s) [noise=true , address=45.91.116.10:4081 , piece_id=NIYPMSNWUUZA3NATXRCBQAIGDF553LZGFSDN4TIRIPSW5WVMBZQQ, seg_pos={0 0}, upload=485925]: Uploading piece... Jul 18 16:48:27.812817952 (607h38m2.583459277s) [noise=true , address=104.36.82.11:4114 , piece_id=5CAK3YDH5YV2ZQRT72RCYDEI4QIH7XNXHMAULMVJQZAGEKGEZK6A, seg_pos={0 0}, upload=485925]: Uploading piece... Jul 18 16:48:27.812831747 (607h38m2.583473082s) [noise=true , address=104.36.82.8:4969 , piece_id=XJIDVOXLZDGC5V2G2IVWWZGN2J46GYJYVDGGBIBAUWVBUNVMHR5Q, seg_pos={0 0}, upload=485925]: Uploading piece... Jul 18 16:48:27.813068871 (607h38m2.583710207s) [noise=true , address=77.90.31.13:4627 , piece_id=C2FNCLGRPQ3OWRLXEZUAYKGPP7T3DQBNJR72BF4FVXPAHXHAOH3Q, seg_pos={0 0}, upload=485925]: Uploading piece... Jul 18 16:48:27.813141351 (607h38m2.583782686s) [noise=true , address=45.91.116.5:4297 , piece_id=G3SPKCJGD6Y7HWT2HASTMYUZZZ7GTWG6YBI3WMJ3YQK3Y4WFPVQQ, seg_pos={0 0}, upload=485925]: Uploading piece... Jul 18 16:48:27.813425504 (607h38m2.584066839s) [noise=true , address=77.90.31.15:4698 , piece_id=JRDI5JFJZ4ZV2INC2UKJXJUUOAVJNVJBBNG5IYWJXPZ4SZ73LTNA, seg_pos={0 0}, upload=485925]: Uploading piece... Jul 18 16:48:29.532425177 (607h38m4.303066512s) [upload=485925]: Next returned nil segment Jul 18 16:48:29.532445566 (607h38m4.303086891s) [upload=485925]: Waiting for error group managing segments... Jul 18 16:48:29.850324595 (607h38m4.62096593s) [noise=true , address=104.36.82.13:4187 , piece_id=IZV6SDX5HFERNRE7KBO5Q4EKDLFJZEKHSJS4WACXH7DAYGL2RZIQ, seg_pos={0 0}, upload=485925]: Done uploading piece. err: <nil> Jul 18 16:48:29.863822962 (607h38m4.634464297s) [noise=true , address=104.36.82.8:4969 , piece_id=XJIDVOXLZDGC5V2G2IVWWZGN2J46GYJYVDGGBIBAUWVBUNVMHR5Q, seg_pos={0 0}, upload=485925]: Done uploading piece. err: <nil> Jul 18 16:48:29.865932168 (607h38m4.636573503s) [noise=true , address=45.91.116.9:4262 , piece_id=C3WLEWLH6X6PWGAZ7LTO62VP3UUGUURGGBTSJHDNXXS7XEOV2VAA, seg_pos={0 0}, upload=485925]: Done uploading piece. err: <nil> Jul 18 16:48:29.866292998 (607h38m4.636934333s) [noise=true , address=45.91.116.10:4081 , piece_id=NIYPMSNWUUZA3NATXRCBQAIGDF553LZGFSDN4TIRIPSW5WVMBZQQ, seg_pos={0 0}, upload=485925]: Done uploading piece. err: <nil> Jul 18 16:48:29.866472912 (607h38m4.637114247s) [noise=true , address=104.36.82.14:4222 , piece_id=MP3GLHCZPW2WRHIZMOGVR3R4DCSNIEULDBQMIKPVDH2A45DM3ZFQ, seg_pos={0 0}, upload=485925]: Done uploading piece. err: <nil> Jul 18 16:48:29.939097227 (607h38m4.709738562s) [noise=true , address=104.36.82.16:4293 , piece_id=S4W6WBLHXOYQXR67BQHBKTAYJYE4ZJP3BZP3OLJ3SJOKLET2ZZBA, seg_pos={0 0}, upload=485925]: Done uploading piece. err: <nil> Jul 18 16:48:29.941771884 (607h38m4.712413209s) [noise=true , address=104.36.82.15:4257 , piece_id=GVEGTFRXZYKBOUD7YLZFBTKLUPOL543E4QD5G57XFMALB4LB4IUA, seg_pos={0 0}, upload=485925]: Done uploading piece. err: <nil> Jul 18 16:48:29.945657058 (607h38m4.716298393s) [noise=true , address=45.91.116.5:4297 , piece_id=G3SPKCJGD6Y7HWT2HASTMYUZZZ7GTWG6YBI3WMJ3YQK3Y4WFPVQQ, seg_pos={0 0}, upload=485925]: Done uploading piece. err: <nil> Jul 18 16:48:29.956912534 (607h38m4.727553869s) [noise=true , address=45.91.116.11:4119 , piece_id=UDVEQMY2IIILIJ2PRL2QYP62H3HUNA2EAWNDZX3ECSBEZIKZTEDA, seg_pos={0 0}, upload=485925]: Done uploading piece. err: <nil> Jul 18 16:48:29.962513179 (607h38m4.733154514s) [noise=true , address=104.36.82.11:4114 , piece_id=5CAK3YDH5YV2ZQRT72RCYDEI4QIH7XNXHMAULMVJQZAGEKGEZK6A, seg_pos={0 0}, upload=485925]: Done uploading piece. err: <nil> Jul 18 16:48:29.964544186 (607h38m4.735185521s) [noise=true , address=104.36.82.2:4729 , piece_id=3G46BW55NHMENDHNWFLLQ27K72LT3X4EGOKGJFLQ5Z2TO5WYCVHA, seg_pos={0 0}, upload=485925]: Done uploading piece. err: <nil> Jul 18 16:48:30.154927672 (607h38m4.925569008s) [noise=true , address=45.91.116.13:4155 , piece_id=ZZB7ITHHGM7ORNFWUVMZ7D5AGR3GHSEU5XNQF5H3ACKSDBHPNUQQ, seg_pos={0 0}, upload=485925]: Done uploading piece. err: <nil> Jul 18 16:48:56.859259716 (607h38m31.629901051s) [noise=true , address=77.90.31.13:4627 , piece_id=C2FNCLGRPQ3OWRLXEZUAYKGPP7T3DQBNJR72BF4FVXPAHXHAOH3Q, seg_pos={0 0}, upload=485925]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 188.166.225.170:41588->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:41588->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41588->77.90.31.13:4627: use of closed network connection Jul 18 16:48:56.859308720 (607h38m31.629950055s) [noise=true , address=77.90.31.15:4698 , piece_id=JRDI5JFJZ4ZV2INC2UKJXJUUOAVJNVJBBNG5IYWJXPZ4SZ73LTNA, seg_pos={0 0}, upload=485925]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF Jul 18 16:48:56.859367953 (607h38m31.630009288s) [noise=true , address=77.90.31.18:4806 , piece_id=WFGHWDD5SFNRWMGLJWBUGHE5UN6UTKGPFBTMWHI3NZSXB3ONQUQQ, seg_pos={0 0}, upload=485925]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:48816->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:48816->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48816->77.90.31.18:4806: use of closed network connection Jul 18 16:48:56.859444880 (607h38m31.630086246s) [noise=true , address=77.90.31.11:4554 , piece_id=NLBEHZGD56TNSECGFAQWKS3QDLXKUFQCGBALS3CCYZE4QGLXPQ5Q, seg_pos={0 0}, upload=485925]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:42646->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:42646->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42646->77.90.31.11:4554: use of closed network connection Jul 18 16:48:56.859494395 (607h38m31.63013573s) [seg_pos={0 0}, upload=485925]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:48:57.094592107 (607h38m31.865233432s) [upload=485925]: Done uploading segments... Jul 18 16:48:57.094618106 (607h38m31.865259441s) [upload=485925]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.237266462s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 458.562533ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:48:51 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 458.610926ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 468.612793ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:48:48 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 468.63781ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 460.723008ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:48:28 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 460.74535ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 467.768608ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:48:14 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 467.799206ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [XX..X...............................................X.......] duration: 6.001077763s FAIL (2025-07-18 16:47:30 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 43943061 (607h30m56.014584396s) [upload=485824]: Done uploading segments... Jul 18 16:41:21.243960926 (607h30m56.014602261s) [upload=485824]: Upload finished. err: <nil> Jul 18 16:41:46.882293880 (607h31m21.652935215s) [upload=485834]: Starting upload Jul 18 16:41:46.882408149 (607h31m21.653049514s) [upload=485834]: Done starting upload Jul 18 16:41:46.882487250 (607h31m21.653128575s) [upload=485834]: Uploading segments... Jul 18 16:41:46.882712641 (607h31m21.653353976s) [upload=485834]: Got next segment. Inline: false Jul 18 16:41:46.882774189 (607h31m21.653415534s) [upload=485834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:41:46.882780781 (607h31m21.653422116s) [upload=485834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:41:47.119575499 (607h31m21.890216834s) [seg_pos={0 0}, upload=485834]: Begin upload segment... Jul 18 16:41:47.119620745 (607h31m21.890262081s) [seg_pos={0 0}, upload=485834]: Done begin upload segment. Jul 18 16:41:47.119648959 (607h31m21.890290294s) [noise=true , address=104.36.82.16:4294 , piece_id=AL5CBFM7G65APSHQ2VFLJ7ZNCTLG6FTEQW5KVQECJUF5GGW6L64A, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.119652606 (607h31m21.890293961s) [noise=true , address=45.91.116.9:4262 , piece_id=IH6HOZ6Z6OJB5KWUIC754YEVLX4QWSSF6M2SUCCU3DCVEJGENLPQ, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.119949835 (607h31m21.89059117s) [noise=true , address=45.91.116.10:4083 , piece_id=MDJSZ6B4DXTYL6HDNXTMCUAIQ5KLHCYLAGG3N3MCJIP2QNL5RW5Q, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120180456 (607h31m21.890821791s) [noise=true , address=45.91.116.8:4045 , piece_id=C74KAENMFPMGKUNZNAWBDBOW22H7P5XAMCGRMS4B3XDNVYEISDTA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120285036 (607h31m21.890926371s) [noise=true , address=77.90.31.13:4627 , piece_id=BK25LXSZA335BDKA7ECT276LAU4Q3DDMWOGYL3QRHQZGKSFO4OQA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120478577 (607h31m21.891119912s) [noise=true , address=45.91.116.5:4297 , piece_id=PUFJXKBYZAZOFCTME7XA6P4RHYGXVR3SUBOZHPVE7OARKCNLYJFQ, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120603516 (607h31m21.891244851s) [noise=true , address=104.36.82.4:4801 , piece_id=BD2IE6RBWE5P2ONS3YQUXRKVJBPRDYPOJTGHI3GU3WP5DLFI3DNA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120735118 (607h31m21.891376453s) [noise=true , address=77.90.31.14:4661 , piece_id=45ACE325BMANQNS2F7GT5UBORIQ2ALIKASO5ITNMRJ35AZMY4TUA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120849597 (607h31m21.891490932s) [noise=true , address=104.36.82.10:4077 , piece_id=JTSZYPFMLFPULXEYU6RVAWHZSXUIELBIIPFBXIDSIMWPEYY3RFWA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121005264 (607h31m21.891646589s) [noise=true , address=104.36.82.7:4910 , piece_id=MXPIVOGGXL2ZVXTI73SYUA6RS7FJYC7OIARDDFYTVAFBH7BEYNJA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121106829 (607h31m21.891748164s) [noise=true , address=45.91.116.4:4939 , piece_id=7CV6VPBN5RA5CRY565LUVSQY7YQYM3ALKSEC73RV5QSTD4VBBL4A, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121249542 (607h31m21.891890867s) [noise=true , address=77.90.31.11:4555 , piece_id=M3GAYWU63PDQSV5MHAVLGXV53GWYK33JRSXZLHJCWDO4EJ5ZXJZA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121592128 (607h31m21.892233463s) [noise=true , address=104.36.82.12:4150 , piece_id=AYI6UITIDNUR7RC5P7LM36PSNIYKBI2U2EBSKD4IRFRPVAKDGIYA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121878996 (607h31m21.892520331s) [noise=true , address=104.36.82.16:4295 , piece_id=KCENFMTJTOHVA5XGK5QYF6SW66TMSKW3TCQJKU5EWIJKMKBXFUYA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.122109017 (607h31m21.892750352s) [noise=true , address=45.91.116.14:4190 , piece_id=MOSOWA7NNLUJNTZAWNEYZMHJD7U6D4ALL4MCJBRM4FCM33TYRGJQ, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.127832217 (607h31m21.898473552s) [noise=true , address=77.90.31.12:4589 , piece_id=LYKG57L6G67IHMKFECMMOCL47FSO2D6A6KTTD6QDWL6D66ARG6KA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:48.840592792 (607h31m23.611234127s) [upload=485834]: Next returned nil segment Jul 18 16:41:48.840609223 (607h31m23.611250558s) [upload=485834]: Waiting for error group managing segments... Jul 18 16:41:49.162427890 (607h31m23.933069235s) [noise=true , address=104.36.82.10:4077 , piece_id=JTSZYPFMLFPULXEYU6RVAWHZSXUIELBIIPFBXIDSIMWPEYY3RFWA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.174349590 (607h31m23.944990915s) [noise=true , address=45.91.116.14:4190 , piece_id=MOSOWA7NNLUJNTZAWNEYZMHJD7U6D4ALL4MCJBRM4FCM33TYRGJQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.177597726 (607h31m23.948239091s) [noise=true , address=45.91.116.10:4083 , piece_id=MDJSZ6B4DXTYL6HDNXTMCUAIQ5KLHCYLAGG3N3MCJIP2QNL5RW5Q, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.178450397 (607h31m23.949091732s) [noise=true , address=45.91.116.5:4297 , piece_id=PUFJXKBYZAZOFCTME7XA6P4RHYGXVR3SUBOZHPVE7OARKCNLYJFQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.182076435 (607h31m23.95271777s) [noise=true , address=45.91.116.4:4939 , piece_id=7CV6VPBN5RA5CRY565LUVSQY7YQYM3ALKSEC73RV5QSTD4VBBL4A, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.249177562 (607h31m24.019818897s) [noise=true , address=104.36.82.12:4150 , piece_id=AYI6UITIDNUR7RC5P7LM36PSNIYKBI2U2EBSKD4IRFRPVAKDGIYA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.254394113 (607h31m24.025035448s) [noise=true , address=104.36.82.16:4294 , piece_id=AL5CBFM7G65APSHQ2VFLJ7ZNCTLG6FTEQW5KVQECJUF5GGW6L64A, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.263727842 (607h31m24.034369177s) [noise=true , address=104.36.82.7:4910 , piece_id=MXPIVOGGXL2ZVXTI73SYUA6RS7FJYC7OIARDDFYTVAFBH7BEYNJA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.266200353 (607h31m24.036841688s) [noise=true , address=45.91.116.9:4262 , piece_id=IH6HOZ6Z6OJB5KWUIC754YEVLX4QWSSF6M2SUCCU3DCVEJGENLPQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.283449276 (607h31m24.054090611s) [noise=true , address=45.91.116.8:4045 , piece_id=C74KAENMFPMGKUNZNAWBDBOW22H7P5XAMCGRMS4B3XDNVYEISDTA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.340968690 (607h31m24.111610025s) [noise=true , address=104.36.82.16:4295 , piece_id=KCENFMTJTOHVA5XGK5QYF6SW66TMSKW3TCQJKU5EWIJKMKBXFUYA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.360005013 (607h31m24.130646348s) [noise=true , address=104.36.82.4:4801 , piece_id=BD2IE6RBWE5P2ONS3YQUXRKVJBPRDYPOJTGHI3GU3WP5DLFI3DNA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:42:16.239473886 (607h31m51.010115221s) [noise=true , address=77.90.31.13:4627 , piece_id=BK25LXSZA335BDKA7ECT276LAU4Q3DDMWOGYL3QRHQZGKSFO4OQA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection Jul 18 16:42:16.239514102 (607h31m51.010155437s) [noise=true , address=77.90.31.14:4661 , piece_id=45ACE325BMANQNS2F7GT5UBORIQ2ALIKASO5ITNMRJ35AZMY4TUA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection; write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection Jul 18 16:42:16.239543529 (607h31m51.010184864s) [noise=true , address=77.90.31.12:4589 , piece_id=LYKG57L6G67IHMKFECMMOCL47FSO2D6A6KTTD6QDWL6D66ARG6KA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection; write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection Jul 18 16:42:16.239600097 (607h31m51.010241432s) [noise=true , address=77.90.31.11:4555 , piece_id=M3GAYWU63PDQSV5MHAVLGXV53GWYK33JRSXZLHJCWDO4EJ5ZXJZA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection; write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection Jul 18 16:42:16.239630144 (607h31m51.010271519s) [seg_pos={0 0}, upload=485834]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:42:16.479299342 (607h31m51.249940677s) [upload=485834]: Done uploading segments... Jul 18 16:42:16.479325091 (607h31m51.249966416s) [upload=485834]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.001101738s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 450.048484ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:47:18 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 450.065407ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 439.353581ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:47:07 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 439.377366ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 437.426232ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:46:57 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 437.452443ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.XX..X...............................................X......] duration: 5.896546789s FAIL (2025-07-18 16:46:47 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 43943061 (607h30m56.014584396s) [upload=485824]: Done uploading segments... Jul 18 16:41:21.243960926 (607h30m56.014602261s) [upload=485824]: Upload finished. err: <nil> Jul 18 16:41:46.882293880 (607h31m21.652935215s) [upload=485834]: Starting upload Jul 18 16:41:46.882408149 (607h31m21.653049514s) [upload=485834]: Done starting upload Jul 18 16:41:46.882487250 (607h31m21.653128575s) [upload=485834]: Uploading segments... Jul 18 16:41:46.882712641 (607h31m21.653353976s) [upload=485834]: Got next segment. Inline: false Jul 18 16:41:46.882774189 (607h31m21.653415534s) [upload=485834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:41:46.882780781 (607h31m21.653422116s) [upload=485834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:41:47.119575499 (607h31m21.890216834s) [seg_pos={0 0}, upload=485834]: Begin upload segment... Jul 18 16:41:47.119620745 (607h31m21.890262081s) [seg_pos={0 0}, upload=485834]: Done begin upload segment. Jul 18 16:41:47.119648959 (607h31m21.890290294s) [noise=true , address=104.36.82.16:4294 , piece_id=AL5CBFM7G65APSHQ2VFLJ7ZNCTLG6FTEQW5KVQECJUF5GGW6L64A, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.119652606 (607h31m21.890293961s) [noise=true , address=45.91.116.9:4262 , piece_id=IH6HOZ6Z6OJB5KWUIC754YEVLX4QWSSF6M2SUCCU3DCVEJGENLPQ, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.119949835 (607h31m21.89059117s) [noise=true , address=45.91.116.10:4083 , piece_id=MDJSZ6B4DXTYL6HDNXTMCUAIQ5KLHCYLAGG3N3MCJIP2QNL5RW5Q, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120180456 (607h31m21.890821791s) [noise=true , address=45.91.116.8:4045 , piece_id=C74KAENMFPMGKUNZNAWBDBOW22H7P5XAMCGRMS4B3XDNVYEISDTA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120285036 (607h31m21.890926371s) [noise=true , address=77.90.31.13:4627 , piece_id=BK25LXSZA335BDKA7ECT276LAU4Q3DDMWOGYL3QRHQZGKSFO4OQA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120478577 (607h31m21.891119912s) [noise=true , address=45.91.116.5:4297 , piece_id=PUFJXKBYZAZOFCTME7XA6P4RHYGXVR3SUBOZHPVE7OARKCNLYJFQ, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120603516 (607h31m21.891244851s) [noise=true , address=104.36.82.4:4801 , piece_id=BD2IE6RBWE5P2ONS3YQUXRKVJBPRDYPOJTGHI3GU3WP5DLFI3DNA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120735118 (607h31m21.891376453s) [noise=true , address=77.90.31.14:4661 , piece_id=45ACE325BMANQNS2F7GT5UBORIQ2ALIKASO5ITNMRJ35AZMY4TUA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120849597 (607h31m21.891490932s) [noise=true , address=104.36.82.10:4077 , piece_id=JTSZYPFMLFPULXEYU6RVAWHZSXUIELBIIPFBXIDSIMWPEYY3RFWA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121005264 (607h31m21.891646589s) [noise=true , address=104.36.82.7:4910 , piece_id=MXPIVOGGXL2ZVXTI73SYUA6RS7FJYC7OIARDDFYTVAFBH7BEYNJA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121106829 (607h31m21.891748164s) [noise=true , address=45.91.116.4:4939 , piece_id=7CV6VPBN5RA5CRY565LUVSQY7YQYM3ALKSEC73RV5QSTD4VBBL4A, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121249542 (607h31m21.891890867s) [noise=true , address=77.90.31.11:4555 , piece_id=M3GAYWU63PDQSV5MHAVLGXV53GWYK33JRSXZLHJCWDO4EJ5ZXJZA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121592128 (607h31m21.892233463s) [noise=true , address=104.36.82.12:4150 , piece_id=AYI6UITIDNUR7RC5P7LM36PSNIYKBI2U2EBSKD4IRFRPVAKDGIYA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121878996 (607h31m21.892520331s) [noise=true , address=104.36.82.16:4295 , piece_id=KCENFMTJTOHVA5XGK5QYF6SW66TMSKW3TCQJKU5EWIJKMKBXFUYA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.122109017 (607h31m21.892750352s) [noise=true , address=45.91.116.14:4190 , piece_id=MOSOWA7NNLUJNTZAWNEYZMHJD7U6D4ALL4MCJBRM4FCM33TYRGJQ, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.127832217 (607h31m21.898473552s) [noise=true , address=77.90.31.12:4589 , piece_id=LYKG57L6G67IHMKFECMMOCL47FSO2D6A6KTTD6QDWL6D66ARG6KA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:48.840592792 (607h31m23.611234127s) [upload=485834]: Next returned nil segment Jul 18 16:41:48.840609223 (607h31m23.611250558s) [upload=485834]: Waiting for error group managing segments... Jul 18 16:41:49.162427890 (607h31m23.933069235s) [noise=true , address=104.36.82.10:4077 , piece_id=JTSZYPFMLFPULXEYU6RVAWHZSXUIELBIIPFBXIDSIMWPEYY3RFWA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.174349590 (607h31m23.944990915s) [noise=true , address=45.91.116.14:4190 , piece_id=MOSOWA7NNLUJNTZAWNEYZMHJD7U6D4ALL4MCJBRM4FCM33TYRGJQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.177597726 (607h31m23.948239091s) [noise=true , address=45.91.116.10:4083 , piece_id=MDJSZ6B4DXTYL6HDNXTMCUAIQ5KLHCYLAGG3N3MCJIP2QNL5RW5Q, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.178450397 (607h31m23.949091732s) [noise=true , address=45.91.116.5:4297 , piece_id=PUFJXKBYZAZOFCTME7XA6P4RHYGXVR3SUBOZHPVE7OARKCNLYJFQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.182076435 (607h31m23.95271777s) [noise=true , address=45.91.116.4:4939 , piece_id=7CV6VPBN5RA5CRY565LUVSQY7YQYM3ALKSEC73RV5QSTD4VBBL4A, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.249177562 (607h31m24.019818897s) [noise=true , address=104.36.82.12:4150 , piece_id=AYI6UITIDNUR7RC5P7LM36PSNIYKBI2U2EBSKD4IRFRPVAKDGIYA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.254394113 (607h31m24.025035448s) [noise=true , address=104.36.82.16:4294 , piece_id=AL5CBFM7G65APSHQ2VFLJ7ZNCTLG6FTEQW5KVQECJUF5GGW6L64A, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.263727842 (607h31m24.034369177s) [noise=true , address=104.36.82.7:4910 , piece_id=MXPIVOGGXL2ZVXTI73SYUA6RS7FJYC7OIARDDFYTVAFBH7BEYNJA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.266200353 (607h31m24.036841688s) [noise=true , address=45.91.116.9:4262 , piece_id=IH6HOZ6Z6OJB5KWUIC754YEVLX4QWSSF6M2SUCCU3DCVEJGENLPQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.283449276 (607h31m24.054090611s) [noise=true , address=45.91.116.8:4045 , piece_id=C74KAENMFPMGKUNZNAWBDBOW22H7P5XAMCGRMS4B3XDNVYEISDTA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.340968690 (607h31m24.111610025s) [noise=true , address=104.36.82.16:4295 , piece_id=KCENFMTJTOHVA5XGK5QYF6SW66TMSKW3TCQJKU5EWIJKMKBXFUYA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.360005013 (607h31m24.130646348s) [noise=true , address=104.36.82.4:4801 , piece_id=BD2IE6RBWE5P2ONS3YQUXRKVJBPRDYPOJTGHI3GU3WP5DLFI3DNA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:42:16.239473886 (607h31m51.010115221s) [noise=true , address=77.90.31.13:4627 , piece_id=BK25LXSZA335BDKA7ECT276LAU4Q3DDMWOGYL3QRHQZGKSFO4OQA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection Jul 18 16:42:16.239514102 (607h31m51.010155437s) [noise=true , address=77.90.31.14:4661 , piece_id=45ACE325BMANQNS2F7GT5UBORIQ2ALIKASO5ITNMRJ35AZMY4TUA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection; write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection Jul 18 16:42:16.239543529 (607h31m51.010184864s) [noise=true , address=77.90.31.12:4589 , piece_id=LYKG57L6G67IHMKFECMMOCL47FSO2D6A6KTTD6QDWL6D66ARG6KA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection; write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection Jul 18 16:42:16.239600097 (607h31m51.010241432s) [noise=true , address=77.90.31.11:4555 , piece_id=M3GAYWU63PDQSV5MHAVLGXV53GWYK33JRSXZLHJCWDO4EJ5ZXJZA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection; write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection Jul 18 16:42:16.239630144 (607h31m51.010271519s) [seg_pos={0 0}, upload=485834]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:42:16.479299342 (607h31m51.249940677s) [upload=485834]: Done uploading segments... Jul 18 16:42:16.479325091 (607h31m51.249966416s) [upload=485834]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.896574472s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 438.967392ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:46:40 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 438.986458ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 480.696212ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:46:24 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 480.728103ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 459.601884ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:46:15 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 459.627011ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..XX..X...............................................X.....] duration: 5.739623027s FAIL (2025-07-18 16:45:41 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 43943061 (607h30m56.014584396s) [upload=485824]: Done uploading segments... Jul 18 16:41:21.243960926 (607h30m56.014602261s) [upload=485824]: Upload finished. err: <nil> Jul 18 16:41:46.882293880 (607h31m21.652935215s) [upload=485834]: Starting upload Jul 18 16:41:46.882408149 (607h31m21.653049514s) [upload=485834]: Done starting upload Jul 18 16:41:46.882487250 (607h31m21.653128575s) [upload=485834]: Uploading segments... Jul 18 16:41:46.882712641 (607h31m21.653353976s) [upload=485834]: Got next segment. Inline: false Jul 18 16:41:46.882774189 (607h31m21.653415534s) [upload=485834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:41:46.882780781 (607h31m21.653422116s) [upload=485834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:41:47.119575499 (607h31m21.890216834s) [seg_pos={0 0}, upload=485834]: Begin upload segment... Jul 18 16:41:47.119620745 (607h31m21.890262081s) [seg_pos={0 0}, upload=485834]: Done begin upload segment. Jul 18 16:41:47.119648959 (607h31m21.890290294s) [noise=true , address=104.36.82.16:4294 , piece_id=AL5CBFM7G65APSHQ2VFLJ7ZNCTLG6FTEQW5KVQECJUF5GGW6L64A, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.119652606 (607h31m21.890293961s) [noise=true , address=45.91.116.9:4262 , piece_id=IH6HOZ6Z6OJB5KWUIC754YEVLX4QWSSF6M2SUCCU3DCVEJGENLPQ, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.119949835 (607h31m21.89059117s) [noise=true , address=45.91.116.10:4083 , piece_id=MDJSZ6B4DXTYL6HDNXTMCUAIQ5KLHCYLAGG3N3MCJIP2QNL5RW5Q, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120180456 (607h31m21.890821791s) [noise=true , address=45.91.116.8:4045 , piece_id=C74KAENMFPMGKUNZNAWBDBOW22H7P5XAMCGRMS4B3XDNVYEISDTA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120285036 (607h31m21.890926371s) [noise=true , address=77.90.31.13:4627 , piece_id=BK25LXSZA335BDKA7ECT276LAU4Q3DDMWOGYL3QRHQZGKSFO4OQA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120478577 (607h31m21.891119912s) [noise=true , address=45.91.116.5:4297 , piece_id=PUFJXKBYZAZOFCTME7XA6P4RHYGXVR3SUBOZHPVE7OARKCNLYJFQ, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120603516 (607h31m21.891244851s) [noise=true , address=104.36.82.4:4801 , piece_id=BD2IE6RBWE5P2ONS3YQUXRKVJBPRDYPOJTGHI3GU3WP5DLFI3DNA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120735118 (607h31m21.891376453s) [noise=true , address=77.90.31.14:4661 , piece_id=45ACE325BMANQNS2F7GT5UBORIQ2ALIKASO5ITNMRJ35AZMY4TUA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120849597 (607h31m21.891490932s) [noise=true , address=104.36.82.10:4077 , piece_id=JTSZYPFMLFPULXEYU6RVAWHZSXUIELBIIPFBXIDSIMWPEYY3RFWA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121005264 (607h31m21.891646589s) [noise=true , address=104.36.82.7:4910 , piece_id=MXPIVOGGXL2ZVXTI73SYUA6RS7FJYC7OIARDDFYTVAFBH7BEYNJA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121106829 (607h31m21.891748164s) [noise=true , address=45.91.116.4:4939 , piece_id=7CV6VPBN5RA5CRY565LUVSQY7YQYM3ALKSEC73RV5QSTD4VBBL4A, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121249542 (607h31m21.891890867s) [noise=true , address=77.90.31.11:4555 , piece_id=M3GAYWU63PDQSV5MHAVLGXV53GWYK33JRSXZLHJCWDO4EJ5ZXJZA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121592128 (607h31m21.892233463s) [noise=true , address=104.36.82.12:4150 , piece_id=AYI6UITIDNUR7RC5P7LM36PSNIYKBI2U2EBSKD4IRFRPVAKDGIYA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121878996 (607h31m21.892520331s) [noise=true , address=104.36.82.16:4295 , piece_id=KCENFMTJTOHVA5XGK5QYF6SW66TMSKW3TCQJKU5EWIJKMKBXFUYA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.122109017 (607h31m21.892750352s) [noise=true , address=45.91.116.14:4190 , piece_id=MOSOWA7NNLUJNTZAWNEYZMHJD7U6D4ALL4MCJBRM4FCM33TYRGJQ, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.127832217 (607h31m21.898473552s) [noise=true , address=77.90.31.12:4589 , piece_id=LYKG57L6G67IHMKFECMMOCL47FSO2D6A6KTTD6QDWL6D66ARG6KA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:48.840592792 (607h31m23.611234127s) [upload=485834]: Next returned nil segment Jul 18 16:41:48.840609223 (607h31m23.611250558s) [upload=485834]: Waiting for error group managing segments... Jul 18 16:41:49.162427890 (607h31m23.933069235s) [noise=true , address=104.36.82.10:4077 , piece_id=JTSZYPFMLFPULXEYU6RVAWHZSXUIELBIIPFBXIDSIMWPEYY3RFWA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.174349590 (607h31m23.944990915s) [noise=true , address=45.91.116.14:4190 , piece_id=MOSOWA7NNLUJNTZAWNEYZMHJD7U6D4ALL4MCJBRM4FCM33TYRGJQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.177597726 (607h31m23.948239091s) [noise=true , address=45.91.116.10:4083 , piece_id=MDJSZ6B4DXTYL6HDNXTMCUAIQ5KLHCYLAGG3N3MCJIP2QNL5RW5Q, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.178450397 (607h31m23.949091732s) [noise=true , address=45.91.116.5:4297 , piece_id=PUFJXKBYZAZOFCTME7XA6P4RHYGXVR3SUBOZHPVE7OARKCNLYJFQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.182076435 (607h31m23.95271777s) [noise=true , address=45.91.116.4:4939 , piece_id=7CV6VPBN5RA5CRY565LUVSQY7YQYM3ALKSEC73RV5QSTD4VBBL4A, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.249177562 (607h31m24.019818897s) [noise=true , address=104.36.82.12:4150 , piece_id=AYI6UITIDNUR7RC5P7LM36PSNIYKBI2U2EBSKD4IRFRPVAKDGIYA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.254394113 (607h31m24.025035448s) [noise=true , address=104.36.82.16:4294 , piece_id=AL5CBFM7G65APSHQ2VFLJ7ZNCTLG6FTEQW5KVQECJUF5GGW6L64A, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.263727842 (607h31m24.034369177s) [noise=true , address=104.36.82.7:4910 , piece_id=MXPIVOGGXL2ZVXTI73SYUA6RS7FJYC7OIARDDFYTVAFBH7BEYNJA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.266200353 (607h31m24.036841688s) [noise=true , address=45.91.116.9:4262 , piece_id=IH6HOZ6Z6OJB5KWUIC754YEVLX4QWSSF6M2SUCCU3DCVEJGENLPQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.283449276 (607h31m24.054090611s) [noise=true , address=45.91.116.8:4045 , piece_id=C74KAENMFPMGKUNZNAWBDBOW22H7P5XAMCGRMS4B3XDNVYEISDTA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.340968690 (607h31m24.111610025s) [noise=true , address=104.36.82.16:4295 , piece_id=KCENFMTJTOHVA5XGK5QYF6SW66TMSKW3TCQJKU5EWIJKMKBXFUYA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.360005013 (607h31m24.130646348s) [noise=true , address=104.36.82.4:4801 , piece_id=BD2IE6RBWE5P2ONS3YQUXRKVJBPRDYPOJTGHI3GU3WP5DLFI3DNA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:42:16.239473886 (607h31m51.010115221s) [noise=true , address=77.90.31.13:4627 , piece_id=BK25LXSZA335BDKA7ECT276LAU4Q3DDMWOGYL3QRHQZGKSFO4OQA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection Jul 18 16:42:16.239514102 (607h31m51.010155437s) [noise=true , address=77.90.31.14:4661 , piece_id=45ACE325BMANQNS2F7GT5UBORIQ2ALIKASO5ITNMRJ35AZMY4TUA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection; write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection Jul 18 16:42:16.239543529 (607h31m51.010184864s) [noise=true , address=77.90.31.12:4589 , piece_id=LYKG57L6G67IHMKFECMMOCL47FSO2D6A6KTTD6QDWL6D66ARG6KA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection; write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection Jul 18 16:42:16.239600097 (607h31m51.010241432s) [noise=true , address=77.90.31.11:4555 , piece_id=M3GAYWU63PDQSV5MHAVLGXV53GWYK33JRSXZLHJCWDO4EJ5ZXJZA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection; write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection Jul 18 16:42:16.239630144 (607h31m51.010271519s) [seg_pos={0 0}, upload=485834]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:42:16.479299342 (607h31m51.249940677s) [upload=485834]: Done uploading segments... Jul 18 16:42:16.479325091 (607h31m51.249966416s) [upload=485834]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.739646383s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 458.46674ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:45:16 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 458.490085ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 446.254353ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:45:05 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 446.280281ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 470.503822ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:44:46 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 470.518931ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...XX..X...............................................X....] duration: 5.734928448s FAIL (2025-07-18 16:44:45 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 43943061 (607h30m56.014584396s) [upload=485824]: Done uploading segments... Jul 18 16:41:21.243960926 (607h30m56.014602261s) [upload=485824]: Upload finished. err: <nil> Jul 18 16:41:46.882293880 (607h31m21.652935215s) [upload=485834]: Starting upload Jul 18 16:41:46.882408149 (607h31m21.653049514s) [upload=485834]: Done starting upload Jul 18 16:41:46.882487250 (607h31m21.653128575s) [upload=485834]: Uploading segments... Jul 18 16:41:46.882712641 (607h31m21.653353976s) [upload=485834]: Got next segment. Inline: false Jul 18 16:41:46.882774189 (607h31m21.653415534s) [upload=485834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:41:46.882780781 (607h31m21.653422116s) [upload=485834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:41:47.119575499 (607h31m21.890216834s) [seg_pos={0 0}, upload=485834]: Begin upload segment... Jul 18 16:41:47.119620745 (607h31m21.890262081s) [seg_pos={0 0}, upload=485834]: Done begin upload segment. Jul 18 16:41:47.119648959 (607h31m21.890290294s) [noise=true , address=104.36.82.16:4294 , piece_id=AL5CBFM7G65APSHQ2VFLJ7ZNCTLG6FTEQW5KVQECJUF5GGW6L64A, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.119652606 (607h31m21.890293961s) [noise=true , address=45.91.116.9:4262 , piece_id=IH6HOZ6Z6OJB5KWUIC754YEVLX4QWSSF6M2SUCCU3DCVEJGENLPQ, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.119949835 (607h31m21.89059117s) [noise=true , address=45.91.116.10:4083 , piece_id=MDJSZ6B4DXTYL6HDNXTMCUAIQ5KLHCYLAGG3N3MCJIP2QNL5RW5Q, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120180456 (607h31m21.890821791s) [noise=true , address=45.91.116.8:4045 , piece_id=C74KAENMFPMGKUNZNAWBDBOW22H7P5XAMCGRMS4B3XDNVYEISDTA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120285036 (607h31m21.890926371s) [noise=true , address=77.90.31.13:4627 , piece_id=BK25LXSZA335BDKA7ECT276LAU4Q3DDMWOGYL3QRHQZGKSFO4OQA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120478577 (607h31m21.891119912s) [noise=true , address=45.91.116.5:4297 , piece_id=PUFJXKBYZAZOFCTME7XA6P4RHYGXVR3SUBOZHPVE7OARKCNLYJFQ, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120603516 (607h31m21.891244851s) [noise=true , address=104.36.82.4:4801 , piece_id=BD2IE6RBWE5P2ONS3YQUXRKVJBPRDYPOJTGHI3GU3WP5DLFI3DNA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120735118 (607h31m21.891376453s) [noise=true , address=77.90.31.14:4661 , piece_id=45ACE325BMANQNS2F7GT5UBORIQ2ALIKASO5ITNMRJ35AZMY4TUA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120849597 (607h31m21.891490932s) [noise=true , address=104.36.82.10:4077 , piece_id=JTSZYPFMLFPULXEYU6RVAWHZSXUIELBIIPFBXIDSIMWPEYY3RFWA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121005264 (607h31m21.891646589s) [noise=true , address=104.36.82.7:4910 , piece_id=MXPIVOGGXL2ZVXTI73SYUA6RS7FJYC7OIARDDFYTVAFBH7BEYNJA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121106829 (607h31m21.891748164s) [noise=true , address=45.91.116.4:4939 , piece_id=7CV6VPBN5RA5CRY565LUVSQY7YQYM3ALKSEC73RV5QSTD4VBBL4A, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121249542 (607h31m21.891890867s) [noise=true , address=77.90.31.11:4555 , piece_id=M3GAYWU63PDQSV5MHAVLGXV53GWYK33JRSXZLHJCWDO4EJ5ZXJZA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121592128 (607h31m21.892233463s) [noise=true , address=104.36.82.12:4150 , piece_id=AYI6UITIDNUR7RC5P7LM36PSNIYKBI2U2EBSKD4IRFRPVAKDGIYA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121878996 (607h31m21.892520331s) [noise=true , address=104.36.82.16:4295 , piece_id=KCENFMTJTOHVA5XGK5QYF6SW66TMSKW3TCQJKU5EWIJKMKBXFUYA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.122109017 (607h31m21.892750352s) [noise=true , address=45.91.116.14:4190 , piece_id=MOSOWA7NNLUJNTZAWNEYZMHJD7U6D4ALL4MCJBRM4FCM33TYRGJQ, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.127832217 (607h31m21.898473552s) [noise=true , address=77.90.31.12:4589 , piece_id=LYKG57L6G67IHMKFECMMOCL47FSO2D6A6KTTD6QDWL6D66ARG6KA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:48.840592792 (607h31m23.611234127s) [upload=485834]: Next returned nil segment Jul 18 16:41:48.840609223 (607h31m23.611250558s) [upload=485834]: Waiting for error group managing segments... Jul 18 16:41:49.162427890 (607h31m23.933069235s) [noise=true , address=104.36.82.10:4077 , piece_id=JTSZYPFMLFPULXEYU6RVAWHZSXUIELBIIPFBXIDSIMWPEYY3RFWA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.174349590 (607h31m23.944990915s) [noise=true , address=45.91.116.14:4190 , piece_id=MOSOWA7NNLUJNTZAWNEYZMHJD7U6D4ALL4MCJBRM4FCM33TYRGJQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.177597726 (607h31m23.948239091s) [noise=true , address=45.91.116.10:4083 , piece_id=MDJSZ6B4DXTYL6HDNXTMCUAIQ5KLHCYLAGG3N3MCJIP2QNL5RW5Q, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.178450397 (607h31m23.949091732s) [noise=true , address=45.91.116.5:4297 , piece_id=PUFJXKBYZAZOFCTME7XA6P4RHYGXVR3SUBOZHPVE7OARKCNLYJFQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.182076435 (607h31m23.95271777s) [noise=true , address=45.91.116.4:4939 , piece_id=7CV6VPBN5RA5CRY565LUVSQY7YQYM3ALKSEC73RV5QSTD4VBBL4A, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.249177562 (607h31m24.019818897s) [noise=true , address=104.36.82.12:4150 , piece_id=AYI6UITIDNUR7RC5P7LM36PSNIYKBI2U2EBSKD4IRFRPVAKDGIYA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.254394113 (607h31m24.025035448s) [noise=true , address=104.36.82.16:4294 , piece_id=AL5CBFM7G65APSHQ2VFLJ7ZNCTLG6FTEQW5KVQECJUF5GGW6L64A, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.263727842 (607h31m24.034369177s) [noise=true , address=104.36.82.7:4910 , piece_id=MXPIVOGGXL2ZVXTI73SYUA6RS7FJYC7OIARDDFYTVAFBH7BEYNJA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.266200353 (607h31m24.036841688s) [noise=true , address=45.91.116.9:4262 , piece_id=IH6HOZ6Z6OJB5KWUIC754YEVLX4QWSSF6M2SUCCU3DCVEJGENLPQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.283449276 (607h31m24.054090611s) [noise=true , address=45.91.116.8:4045 , piece_id=C74KAENMFPMGKUNZNAWBDBOW22H7P5XAMCGRMS4B3XDNVYEISDTA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.340968690 (607h31m24.111610025s) [noise=true , address=104.36.82.16:4295 , piece_id=KCENFMTJTOHVA5XGK5QYF6SW66TMSKW3TCQJKU5EWIJKMKBXFUYA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.360005013 (607h31m24.130646348s) [noise=true , address=104.36.82.4:4801 , piece_id=BD2IE6RBWE5P2ONS3YQUXRKVJBPRDYPOJTGHI3GU3WP5DLFI3DNA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:42:16.239473886 (607h31m51.010115221s) [noise=true , address=77.90.31.13:4627 , piece_id=BK25LXSZA335BDKA7ECT276LAU4Q3DDMWOGYL3QRHQZGKSFO4OQA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection Jul 18 16:42:16.239514102 (607h31m51.010155437s) [noise=true , address=77.90.31.14:4661 , piece_id=45ACE325BMANQNS2F7GT5UBORIQ2ALIKASO5ITNMRJ35AZMY4TUA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection; write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection Jul 18 16:42:16.239543529 (607h31m51.010184864s) [noise=true , address=77.90.31.12:4589 , piece_id=LYKG57L6G67IHMKFECMMOCL47FSO2D6A6KTTD6QDWL6D66ARG6KA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection; write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection Jul 18 16:42:16.239600097 (607h31m51.010241432s) [noise=true , address=77.90.31.11:4555 , piece_id=M3GAYWU63PDQSV5MHAVLGXV53GWYK33JRSXZLHJCWDO4EJ5ZXJZA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection; write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection Jul 18 16:42:16.239630144 (607h31m51.010271519s) [seg_pos={0 0}, upload=485834]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:42:16.479299342 (607h31m51.249940677s) [upload=485834]: Done uploading segments... Jul 18 16:42:16.479325091 (607h31m51.249966416s) [upload=485834]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.73495117s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [....XX..X...............................................X...] duration: 5.741203195s FAIL (2025-07-18 16:44:30 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 43943061 (607h30m56.014584396s) [upload=485824]: Done uploading segments... Jul 18 16:41:21.243960926 (607h30m56.014602261s) [upload=485824]: Upload finished. err: <nil> Jul 18 16:41:46.882293880 (607h31m21.652935215s) [upload=485834]: Starting upload Jul 18 16:41:46.882408149 (607h31m21.653049514s) [upload=485834]: Done starting upload Jul 18 16:41:46.882487250 (607h31m21.653128575s) [upload=485834]: Uploading segments... Jul 18 16:41:46.882712641 (607h31m21.653353976s) [upload=485834]: Got next segment. Inline: false Jul 18 16:41:46.882774189 (607h31m21.653415534s) [upload=485834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:41:46.882780781 (607h31m21.653422116s) [upload=485834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:41:47.119575499 (607h31m21.890216834s) [seg_pos={0 0}, upload=485834]: Begin upload segment... Jul 18 16:41:47.119620745 (607h31m21.890262081s) [seg_pos={0 0}, upload=485834]: Done begin upload segment. Jul 18 16:41:47.119648959 (607h31m21.890290294s) [noise=true , address=104.36.82.16:4294 , piece_id=AL5CBFM7G65APSHQ2VFLJ7ZNCTLG6FTEQW5KVQECJUF5GGW6L64A, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.119652606 (607h31m21.890293961s) [noise=true , address=45.91.116.9:4262 , piece_id=IH6HOZ6Z6OJB5KWUIC754YEVLX4QWSSF6M2SUCCU3DCVEJGENLPQ, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.119949835 (607h31m21.89059117s) [noise=true , address=45.91.116.10:4083 , piece_id=MDJSZ6B4DXTYL6HDNXTMCUAIQ5KLHCYLAGG3N3MCJIP2QNL5RW5Q, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120180456 (607h31m21.890821791s) [noise=true , address=45.91.116.8:4045 , piece_id=C74KAENMFPMGKUNZNAWBDBOW22H7P5XAMCGRMS4B3XDNVYEISDTA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120285036 (607h31m21.890926371s) [noise=true , address=77.90.31.13:4627 , piece_id=BK25LXSZA335BDKA7ECT276LAU4Q3DDMWOGYL3QRHQZGKSFO4OQA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120478577 (607h31m21.891119912s) [noise=true , address=45.91.116.5:4297 , piece_id=PUFJXKBYZAZOFCTME7XA6P4RHYGXVR3SUBOZHPVE7OARKCNLYJFQ, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120603516 (607h31m21.891244851s) [noise=true , address=104.36.82.4:4801 , piece_id=BD2IE6RBWE5P2ONS3YQUXRKVJBPRDYPOJTGHI3GU3WP5DLFI3DNA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120735118 (607h31m21.891376453s) [noise=true , address=77.90.31.14:4661 , piece_id=45ACE325BMANQNS2F7GT5UBORIQ2ALIKASO5ITNMRJ35AZMY4TUA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120849597 (607h31m21.891490932s) [noise=true , address=104.36.82.10:4077 , piece_id=JTSZYPFMLFPULXEYU6RVAWHZSXUIELBIIPFBXIDSIMWPEYY3RFWA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121005264 (607h31m21.891646589s) [noise=true , address=104.36.82.7:4910 , piece_id=MXPIVOGGXL2ZVXTI73SYUA6RS7FJYC7OIARDDFYTVAFBH7BEYNJA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121106829 (607h31m21.891748164s) [noise=true , address=45.91.116.4:4939 , piece_id=7CV6VPBN5RA5CRY565LUVSQY7YQYM3ALKSEC73RV5QSTD4VBBL4A, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121249542 (607h31m21.891890867s) [noise=true , address=77.90.31.11:4555 , piece_id=M3GAYWU63PDQSV5MHAVLGXV53GWYK33JRSXZLHJCWDO4EJ5ZXJZA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121592128 (607h31m21.892233463s) [noise=true , address=104.36.82.12:4150 , piece_id=AYI6UITIDNUR7RC5P7LM36PSNIYKBI2U2EBSKD4IRFRPVAKDGIYA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121878996 (607h31m21.892520331s) [noise=true , address=104.36.82.16:4295 , piece_id=KCENFMTJTOHVA5XGK5QYF6SW66TMSKW3TCQJKU5EWIJKMKBXFUYA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.122109017 (607h31m21.892750352s) [noise=true , address=45.91.116.14:4190 , piece_id=MOSOWA7NNLUJNTZAWNEYZMHJD7U6D4ALL4MCJBRM4FCM33TYRGJQ, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.127832217 (607h31m21.898473552s) [noise=true , address=77.90.31.12:4589 , piece_id=LYKG57L6G67IHMKFECMMOCL47FSO2D6A6KTTD6QDWL6D66ARG6KA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:48.840592792 (607h31m23.611234127s) [upload=485834]: Next returned nil segment Jul 18 16:41:48.840609223 (607h31m23.611250558s) [upload=485834]: Waiting for error group managing segments... Jul 18 16:41:49.162427890 (607h31m23.933069235s) [noise=true , address=104.36.82.10:4077 , piece_id=JTSZYPFMLFPULXEYU6RVAWHZSXUIELBIIPFBXIDSIMWPEYY3RFWA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.174349590 (607h31m23.944990915s) [noise=true , address=45.91.116.14:4190 , piece_id=MOSOWA7NNLUJNTZAWNEYZMHJD7U6D4ALL4MCJBRM4FCM33TYRGJQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.177597726 (607h31m23.948239091s) [noise=true , address=45.91.116.10:4083 , piece_id=MDJSZ6B4DXTYL6HDNXTMCUAIQ5KLHCYLAGG3N3MCJIP2QNL5RW5Q, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.178450397 (607h31m23.949091732s) [noise=true , address=45.91.116.5:4297 , piece_id=PUFJXKBYZAZOFCTME7XA6P4RHYGXVR3SUBOZHPVE7OARKCNLYJFQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.182076435 (607h31m23.95271777s) [noise=true , address=45.91.116.4:4939 , piece_id=7CV6VPBN5RA5CRY565LUVSQY7YQYM3ALKSEC73RV5QSTD4VBBL4A, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.249177562 (607h31m24.019818897s) [noise=true , address=104.36.82.12:4150 , piece_id=AYI6UITIDNUR7RC5P7LM36PSNIYKBI2U2EBSKD4IRFRPVAKDGIYA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.254394113 (607h31m24.025035448s) [noise=true , address=104.36.82.16:4294 , piece_id=AL5CBFM7G65APSHQ2VFLJ7ZNCTLG6FTEQW5KVQECJUF5GGW6L64A, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.263727842 (607h31m24.034369177s) [noise=true , address=104.36.82.7:4910 , piece_id=MXPIVOGGXL2ZVXTI73SYUA6RS7FJYC7OIARDDFYTVAFBH7BEYNJA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.266200353 (607h31m24.036841688s) [noise=true , address=45.91.116.9:4262 , piece_id=IH6HOZ6Z6OJB5KWUIC754YEVLX4QWSSF6M2SUCCU3DCVEJGENLPQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.283449276 (607h31m24.054090611s) [noise=true , address=45.91.116.8:4045 , piece_id=C74KAENMFPMGKUNZNAWBDBOW22H7P5XAMCGRMS4B3XDNVYEISDTA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.340968690 (607h31m24.111610025s) [noise=true , address=104.36.82.16:4295 , piece_id=KCENFMTJTOHVA5XGK5QYF6SW66TMSKW3TCQJKU5EWIJKMKBXFUYA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.360005013 (607h31m24.130646348s) [noise=true , address=104.36.82.4:4801 , piece_id=BD2IE6RBWE5P2ONS3YQUXRKVJBPRDYPOJTGHI3GU3WP5DLFI3DNA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:42:16.239473886 (607h31m51.010115221s) [noise=true , address=77.90.31.13:4627 , piece_id=BK25LXSZA335BDKA7ECT276LAU4Q3DDMWOGYL3QRHQZGKSFO4OQA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection Jul 18 16:42:16.239514102 (607h31m51.010155437s) [noise=true , address=77.90.31.14:4661 , piece_id=45ACE325BMANQNS2F7GT5UBORIQ2ALIKASO5ITNMRJ35AZMY4TUA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection; write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection Jul 18 16:42:16.239543529 (607h31m51.010184864s) [noise=true , address=77.90.31.12:4589 , piece_id=LYKG57L6G67IHMKFECMMOCL47FSO2D6A6KTTD6QDWL6D66ARG6KA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection; write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection Jul 18 16:42:16.239600097 (607h31m51.010241432s) [noise=true , address=77.90.31.11:4555 , piece_id=M3GAYWU63PDQSV5MHAVLGXV53GWYK33JRSXZLHJCWDO4EJ5ZXJZA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection; write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection Jul 18 16:42:16.239630144 (607h31m51.010271519s) [seg_pos={0 0}, upload=485834]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:42:16.479299342 (607h31m51.249940677s) [upload=485834]: Done uploading segments... Jul 18 16:42:16.479325091 (607h31m51.249966416s) [upload=485834]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.741230107s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 457.486476ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:44:16 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 457.512746ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 476.572233ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:44:16 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 476.592732ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....XX..X...............................................X..] duration: 5.811481442s FAIL (2025-07-18 16:43:43 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 43943061 (607h30m56.014584396s) [upload=485824]: Done uploading segments... Jul 18 16:41:21.243960926 (607h30m56.014602261s) [upload=485824]: Upload finished. err: <nil> Jul 18 16:41:46.882293880 (607h31m21.652935215s) [upload=485834]: Starting upload Jul 18 16:41:46.882408149 (607h31m21.653049514s) [upload=485834]: Done starting upload Jul 18 16:41:46.882487250 (607h31m21.653128575s) [upload=485834]: Uploading segments... Jul 18 16:41:46.882712641 (607h31m21.653353976s) [upload=485834]: Got next segment. Inline: false Jul 18 16:41:46.882774189 (607h31m21.653415534s) [upload=485834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:41:46.882780781 (607h31m21.653422116s) [upload=485834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:41:47.119575499 (607h31m21.890216834s) [seg_pos={0 0}, upload=485834]: Begin upload segment... Jul 18 16:41:47.119620745 (607h31m21.890262081s) [seg_pos={0 0}, upload=485834]: Done begin upload segment. Jul 18 16:41:47.119648959 (607h31m21.890290294s) [noise=true , address=104.36.82.16:4294 , piece_id=AL5CBFM7G65APSHQ2VFLJ7ZNCTLG6FTEQW5KVQECJUF5GGW6L64A, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.119652606 (607h31m21.890293961s) [noise=true , address=45.91.116.9:4262 , piece_id=IH6HOZ6Z6OJB5KWUIC754YEVLX4QWSSF6M2SUCCU3DCVEJGENLPQ, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.119949835 (607h31m21.89059117s) [noise=true , address=45.91.116.10:4083 , piece_id=MDJSZ6B4DXTYL6HDNXTMCUAIQ5KLHCYLAGG3N3MCJIP2QNL5RW5Q, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120180456 (607h31m21.890821791s) [noise=true , address=45.91.116.8:4045 , piece_id=C74KAENMFPMGKUNZNAWBDBOW22H7P5XAMCGRMS4B3XDNVYEISDTA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120285036 (607h31m21.890926371s) [noise=true , address=77.90.31.13:4627 , piece_id=BK25LXSZA335BDKA7ECT276LAU4Q3DDMWOGYL3QRHQZGKSFO4OQA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120478577 (607h31m21.891119912s) [noise=true , address=45.91.116.5:4297 , piece_id=PUFJXKBYZAZOFCTME7XA6P4RHYGXVR3SUBOZHPVE7OARKCNLYJFQ, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120603516 (607h31m21.891244851s) [noise=true , address=104.36.82.4:4801 , piece_id=BD2IE6RBWE5P2ONS3YQUXRKVJBPRDYPOJTGHI3GU3WP5DLFI3DNA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120735118 (607h31m21.891376453s) [noise=true , address=77.90.31.14:4661 , piece_id=45ACE325BMANQNS2F7GT5UBORIQ2ALIKASO5ITNMRJ35AZMY4TUA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120849597 (607h31m21.891490932s) [noise=true , address=104.36.82.10:4077 , piece_id=JTSZYPFMLFPULXEYU6RVAWHZSXUIELBIIPFBXIDSIMWPEYY3RFWA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121005264 (607h31m21.891646589s) [noise=true , address=104.36.82.7:4910 , piece_id=MXPIVOGGXL2ZVXTI73SYUA6RS7FJYC7OIARDDFYTVAFBH7BEYNJA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121106829 (607h31m21.891748164s) [noise=true , address=45.91.116.4:4939 , piece_id=7CV6VPBN5RA5CRY565LUVSQY7YQYM3ALKSEC73RV5QSTD4VBBL4A, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121249542 (607h31m21.891890867s) [noise=true , address=77.90.31.11:4555 , piece_id=M3GAYWU63PDQSV5MHAVLGXV53GWYK33JRSXZLHJCWDO4EJ5ZXJZA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121592128 (607h31m21.892233463s) [noise=true , address=104.36.82.12:4150 , piece_id=AYI6UITIDNUR7RC5P7LM36PSNIYKBI2U2EBSKD4IRFRPVAKDGIYA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121878996 (607h31m21.892520331s) [noise=true , address=104.36.82.16:4295 , piece_id=KCENFMTJTOHVA5XGK5QYF6SW66TMSKW3TCQJKU5EWIJKMKBXFUYA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.122109017 (607h31m21.892750352s) [noise=true , address=45.91.116.14:4190 , piece_id=MOSOWA7NNLUJNTZAWNEYZMHJD7U6D4ALL4MCJBRM4FCM33TYRGJQ, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.127832217 (607h31m21.898473552s) [noise=true , address=77.90.31.12:4589 , piece_id=LYKG57L6G67IHMKFECMMOCL47FSO2D6A6KTTD6QDWL6D66ARG6KA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:48.840592792 (607h31m23.611234127s) [upload=485834]: Next returned nil segment Jul 18 16:41:48.840609223 (607h31m23.611250558s) [upload=485834]: Waiting for error group managing segments... Jul 18 16:41:49.162427890 (607h31m23.933069235s) [noise=true , address=104.36.82.10:4077 , piece_id=JTSZYPFMLFPULXEYU6RVAWHZSXUIELBIIPFBXIDSIMWPEYY3RFWA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.174349590 (607h31m23.944990915s) [noise=true , address=45.91.116.14:4190 , piece_id=MOSOWA7NNLUJNTZAWNEYZMHJD7U6D4ALL4MCJBRM4FCM33TYRGJQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.177597726 (607h31m23.948239091s) [noise=true , address=45.91.116.10:4083 , piece_id=MDJSZ6B4DXTYL6HDNXTMCUAIQ5KLHCYLAGG3N3MCJIP2QNL5RW5Q, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.178450397 (607h31m23.949091732s) [noise=true , address=45.91.116.5:4297 , piece_id=PUFJXKBYZAZOFCTME7XA6P4RHYGXVR3SUBOZHPVE7OARKCNLYJFQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.182076435 (607h31m23.95271777s) [noise=true , address=45.91.116.4:4939 , piece_id=7CV6VPBN5RA5CRY565LUVSQY7YQYM3ALKSEC73RV5QSTD4VBBL4A, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.249177562 (607h31m24.019818897s) [noise=true , address=104.36.82.12:4150 , piece_id=AYI6UITIDNUR7RC5P7LM36PSNIYKBI2U2EBSKD4IRFRPVAKDGIYA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.254394113 (607h31m24.025035448s) [noise=true , address=104.36.82.16:4294 , piece_id=AL5CBFM7G65APSHQ2VFLJ7ZNCTLG6FTEQW5KVQECJUF5GGW6L64A, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.263727842 (607h31m24.034369177s) [noise=true , address=104.36.82.7:4910 , piece_id=MXPIVOGGXL2ZVXTI73SYUA6RS7FJYC7OIARDDFYTVAFBH7BEYNJA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.266200353 (607h31m24.036841688s) [noise=true , address=45.91.116.9:4262 , piece_id=IH6HOZ6Z6OJB5KWUIC754YEVLX4QWSSF6M2SUCCU3DCVEJGENLPQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.283449276 (607h31m24.054090611s) [noise=true , address=45.91.116.8:4045 , piece_id=C74KAENMFPMGKUNZNAWBDBOW22H7P5XAMCGRMS4B3XDNVYEISDTA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.340968690 (607h31m24.111610025s) [noise=true , address=104.36.82.16:4295 , piece_id=KCENFMTJTOHVA5XGK5QYF6SW66TMSKW3TCQJKU5EWIJKMKBXFUYA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.360005013 (607h31m24.130646348s) [noise=true , address=104.36.82.4:4801 , piece_id=BD2IE6RBWE5P2ONS3YQUXRKVJBPRDYPOJTGHI3GU3WP5DLFI3DNA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:42:16.239473886 (607h31m51.010115221s) [noise=true , address=77.90.31.13:4627 , piece_id=BK25LXSZA335BDKA7ECT276LAU4Q3DDMWOGYL3QRHQZGKSFO4OQA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection Jul 18 16:42:16.239514102 (607h31m51.010155437s) [noise=true , address=77.90.31.14:4661 , piece_id=45ACE325BMANQNS2F7GT5UBORIQ2ALIKASO5ITNMRJ35AZMY4TUA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection; write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection Jul 18 16:42:16.239543529 (607h31m51.010184864s) [noise=true , address=77.90.31.12:4589 , piece_id=LYKG57L6G67IHMKFECMMOCL47FSO2D6A6KTTD6QDWL6D66ARG6KA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection; write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection Jul 18 16:42:16.239600097 (607h31m51.010241432s) [noise=true , address=77.90.31.11:4555 , piece_id=M3GAYWU63PDQSV5MHAVLGXV53GWYK33JRSXZLHJCWDO4EJ5ZXJZA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection; write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection Jul 18 16:42:16.239630144 (607h31m51.010271519s) [seg_pos={0 0}, upload=485834]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:42:16.479299342 (607h31m51.249940677s) [upload=485834]: Done uploading segments... Jul 18 16:42:16.479325091 (607h31m51.249966416s) [upload=485834]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.811503244s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 468.280468ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:43:39 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 468.306579ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 436.047384ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:43:27 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 436.070999ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [......XX..X...............................................X.] duration: 5.784917186s FAIL (2025-07-18 16:42:45 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 43943061 (607h30m56.014584396s) [upload=485824]: Done uploading segments... Jul 18 16:41:21.243960926 (607h30m56.014602261s) [upload=485824]: Upload finished. err: <nil> Jul 18 16:41:46.882293880 (607h31m21.652935215s) [upload=485834]: Starting upload Jul 18 16:41:46.882408149 (607h31m21.653049514s) [upload=485834]: Done starting upload Jul 18 16:41:46.882487250 (607h31m21.653128575s) [upload=485834]: Uploading segments... Jul 18 16:41:46.882712641 (607h31m21.653353976s) [upload=485834]: Got next segment. Inline: false Jul 18 16:41:46.882774189 (607h31m21.653415534s) [upload=485834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:41:46.882780781 (607h31m21.653422116s) [upload=485834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:41:47.119575499 (607h31m21.890216834s) [seg_pos={0 0}, upload=485834]: Begin upload segment... Jul 18 16:41:47.119620745 (607h31m21.890262081s) [seg_pos={0 0}, upload=485834]: Done begin upload segment. Jul 18 16:41:47.119648959 (607h31m21.890290294s) [noise=true , address=104.36.82.16:4294 , piece_id=AL5CBFM7G65APSHQ2VFLJ7ZNCTLG6FTEQW5KVQECJUF5GGW6L64A, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.119652606 (607h31m21.890293961s) [noise=true , address=45.91.116.9:4262 , piece_id=IH6HOZ6Z6OJB5KWUIC754YEVLX4QWSSF6M2SUCCU3DCVEJGENLPQ, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.119949835 (607h31m21.89059117s) [noise=true , address=45.91.116.10:4083 , piece_id=MDJSZ6B4DXTYL6HDNXTMCUAIQ5KLHCYLAGG3N3MCJIP2QNL5RW5Q, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120180456 (607h31m21.890821791s) [noise=true , address=45.91.116.8:4045 , piece_id=C74KAENMFPMGKUNZNAWBDBOW22H7P5XAMCGRMS4B3XDNVYEISDTA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120285036 (607h31m21.890926371s) [noise=true , address=77.90.31.13:4627 , piece_id=BK25LXSZA335BDKA7ECT276LAU4Q3DDMWOGYL3QRHQZGKSFO4OQA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120478577 (607h31m21.891119912s) [noise=true , address=45.91.116.5:4297 , piece_id=PUFJXKBYZAZOFCTME7XA6P4RHYGXVR3SUBOZHPVE7OARKCNLYJFQ, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120603516 (607h31m21.891244851s) [noise=true , address=104.36.82.4:4801 , piece_id=BD2IE6RBWE5P2ONS3YQUXRKVJBPRDYPOJTGHI3GU3WP5DLFI3DNA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120735118 (607h31m21.891376453s) [noise=true , address=77.90.31.14:4661 , piece_id=45ACE325BMANQNS2F7GT5UBORIQ2ALIKASO5ITNMRJ35AZMY4TUA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120849597 (607h31m21.891490932s) [noise=true , address=104.36.82.10:4077 , piece_id=JTSZYPFMLFPULXEYU6RVAWHZSXUIELBIIPFBXIDSIMWPEYY3RFWA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121005264 (607h31m21.891646589s) [noise=true , address=104.36.82.7:4910 , piece_id=MXPIVOGGXL2ZVXTI73SYUA6RS7FJYC7OIARDDFYTVAFBH7BEYNJA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121106829 (607h31m21.891748164s) [noise=true , address=45.91.116.4:4939 , piece_id=7CV6VPBN5RA5CRY565LUVSQY7YQYM3ALKSEC73RV5QSTD4VBBL4A, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121249542 (607h31m21.891890867s) [noise=true , address=77.90.31.11:4555 , piece_id=M3GAYWU63PDQSV5MHAVLGXV53GWYK33JRSXZLHJCWDO4EJ5ZXJZA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121592128 (607h31m21.892233463s) [noise=true , address=104.36.82.12:4150 , piece_id=AYI6UITIDNUR7RC5P7LM36PSNIYKBI2U2EBSKD4IRFRPVAKDGIYA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121878996 (607h31m21.892520331s) [noise=true , address=104.36.82.16:4295 , piece_id=KCENFMTJTOHVA5XGK5QYF6SW66TMSKW3TCQJKU5EWIJKMKBXFUYA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.122109017 (607h31m21.892750352s) [noise=true , address=45.91.116.14:4190 , piece_id=MOSOWA7NNLUJNTZAWNEYZMHJD7U6D4ALL4MCJBRM4FCM33TYRGJQ, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.127832217 (607h31m21.898473552s) [noise=true , address=77.90.31.12:4589 , piece_id=LYKG57L6G67IHMKFECMMOCL47FSO2D6A6KTTD6QDWL6D66ARG6KA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:48.840592792 (607h31m23.611234127s) [upload=485834]: Next returned nil segment Jul 18 16:41:48.840609223 (607h31m23.611250558s) [upload=485834]: Waiting for error group managing segments... Jul 18 16:41:49.162427890 (607h31m23.933069235s) [noise=true , address=104.36.82.10:4077 , piece_id=JTSZYPFMLFPULXEYU6RVAWHZSXUIELBIIPFBXIDSIMWPEYY3RFWA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.174349590 (607h31m23.944990915s) [noise=true , address=45.91.116.14:4190 , piece_id=MOSOWA7NNLUJNTZAWNEYZMHJD7U6D4ALL4MCJBRM4FCM33TYRGJQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.177597726 (607h31m23.948239091s) [noise=true , address=45.91.116.10:4083 , piece_id=MDJSZ6B4DXTYL6HDNXTMCUAIQ5KLHCYLAGG3N3MCJIP2QNL5RW5Q, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.178450397 (607h31m23.949091732s) [noise=true , address=45.91.116.5:4297 , piece_id=PUFJXKBYZAZOFCTME7XA6P4RHYGXVR3SUBOZHPVE7OARKCNLYJFQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.182076435 (607h31m23.95271777s) [noise=true , address=45.91.116.4:4939 , piece_id=7CV6VPBN5RA5CRY565LUVSQY7YQYM3ALKSEC73RV5QSTD4VBBL4A, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.249177562 (607h31m24.019818897s) [noise=true , address=104.36.82.12:4150 , piece_id=AYI6UITIDNUR7RC5P7LM36PSNIYKBI2U2EBSKD4IRFRPVAKDGIYA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.254394113 (607h31m24.025035448s) [noise=true , address=104.36.82.16:4294 , piece_id=AL5CBFM7G65APSHQ2VFLJ7ZNCTLG6FTEQW5KVQECJUF5GGW6L64A, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.263727842 (607h31m24.034369177s) [noise=true , address=104.36.82.7:4910 , piece_id=MXPIVOGGXL2ZVXTI73SYUA6RS7FJYC7OIARDDFYTVAFBH7BEYNJA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.266200353 (607h31m24.036841688s) [noise=true , address=45.91.116.9:4262 , piece_id=IH6HOZ6Z6OJB5KWUIC754YEVLX4QWSSF6M2SUCCU3DCVEJGENLPQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.283449276 (607h31m24.054090611s) [noise=true , address=45.91.116.8:4045 , piece_id=C74KAENMFPMGKUNZNAWBDBOW22H7P5XAMCGRMS4B3XDNVYEISDTA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.340968690 (607h31m24.111610025s) [noise=true , address=104.36.82.16:4295 , piece_id=KCENFMTJTOHVA5XGK5QYF6SW66TMSKW3TCQJKU5EWIJKMKBXFUYA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.360005013 (607h31m24.130646348s) [noise=true , address=104.36.82.4:4801 , piece_id=BD2IE6RBWE5P2ONS3YQUXRKVJBPRDYPOJTGHI3GU3WP5DLFI3DNA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:42:16.239473886 (607h31m51.010115221s) [noise=true , address=77.90.31.13:4627 , piece_id=BK25LXSZA335BDKA7ECT276LAU4Q3DDMWOGYL3QRHQZGKSFO4OQA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection Jul 18 16:42:16.239514102 (607h31m51.010155437s) [noise=true , address=77.90.31.14:4661 , piece_id=45ACE325BMANQNS2F7GT5UBORIQ2ALIKASO5ITNMRJ35AZMY4TUA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection; write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection Jul 18 16:42:16.239543529 (607h31m51.010184864s) [noise=true , address=77.90.31.12:4589 , piece_id=LYKG57L6G67IHMKFECMMOCL47FSO2D6A6KTTD6QDWL6D66ARG6KA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection; write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection Jul 18 16:42:16.239600097 (607h31m51.010241432s) [noise=true , address=77.90.31.11:4555 , piece_id=M3GAYWU63PDQSV5MHAVLGXV53GWYK33JRSXZLHJCWDO4EJ5ZXJZA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection; write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection Jul 18 16:42:16.239630144 (607h31m51.010271519s) [seg_pos={0 0}, upload=485834]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:42:16.479299342 (607h31m51.249940677s) [upload=485834]: Done uploading segments... Jul 18 16:42:16.479325091 (607h31m51.249966416s) [upload=485834]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.784946513s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 448.402464ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:42:28 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 448.429014ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 479.609333ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:42:25 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 479.630102ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......XX..X...............................................X] duration: 30.24115165s FAIL (2025-07-18 16:42:16 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 43943061 (607h30m56.014584396s) [upload=485824]: Done uploading segments... Jul 18 16:41:21.243960926 (607h30m56.014602261s) [upload=485824]: Upload finished. err: <nil> Jul 18 16:41:46.882293880 (607h31m21.652935215s) [upload=485834]: Starting upload Jul 18 16:41:46.882408149 (607h31m21.653049514s) [upload=485834]: Done starting upload Jul 18 16:41:46.882487250 (607h31m21.653128575s) [upload=485834]: Uploading segments... Jul 18 16:41:46.882712641 (607h31m21.653353976s) [upload=485834]: Got next segment. Inline: false Jul 18 16:41:46.882774189 (607h31m21.653415534s) [upload=485834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:41:46.882780781 (607h31m21.653422116s) [upload=485834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:41:47.119575499 (607h31m21.890216834s) [seg_pos={0 0}, upload=485834]: Begin upload segment... Jul 18 16:41:47.119620745 (607h31m21.890262081s) [seg_pos={0 0}, upload=485834]: Done begin upload segment. Jul 18 16:41:47.119648959 (607h31m21.890290294s) [noise=true , address=104.36.82.16:4294 , piece_id=AL5CBFM7G65APSHQ2VFLJ7ZNCTLG6FTEQW5KVQECJUF5GGW6L64A, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.119652606 (607h31m21.890293961s) [noise=true , address=45.91.116.9:4262 , piece_id=IH6HOZ6Z6OJB5KWUIC754YEVLX4QWSSF6M2SUCCU3DCVEJGENLPQ, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.119949835 (607h31m21.89059117s) [noise=true , address=45.91.116.10:4083 , piece_id=MDJSZ6B4DXTYL6HDNXTMCUAIQ5KLHCYLAGG3N3MCJIP2QNL5RW5Q, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120180456 (607h31m21.890821791s) [noise=true , address=45.91.116.8:4045 , piece_id=C74KAENMFPMGKUNZNAWBDBOW22H7P5XAMCGRMS4B3XDNVYEISDTA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120285036 (607h31m21.890926371s) [noise=true , address=77.90.31.13:4627 , piece_id=BK25LXSZA335BDKA7ECT276LAU4Q3DDMWOGYL3QRHQZGKSFO4OQA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120478577 (607h31m21.891119912s) [noise=true , address=45.91.116.5:4297 , piece_id=PUFJXKBYZAZOFCTME7XA6P4RHYGXVR3SUBOZHPVE7OARKCNLYJFQ, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120603516 (607h31m21.891244851s) [noise=true , address=104.36.82.4:4801 , piece_id=BD2IE6RBWE5P2ONS3YQUXRKVJBPRDYPOJTGHI3GU3WP5DLFI3DNA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120735118 (607h31m21.891376453s) [noise=true , address=77.90.31.14:4661 , piece_id=45ACE325BMANQNS2F7GT5UBORIQ2ALIKASO5ITNMRJ35AZMY4TUA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.120849597 (607h31m21.891490932s) [noise=true , address=104.36.82.10:4077 , piece_id=JTSZYPFMLFPULXEYU6RVAWHZSXUIELBIIPFBXIDSIMWPEYY3RFWA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121005264 (607h31m21.891646589s) [noise=true , address=104.36.82.7:4910 , piece_id=MXPIVOGGXL2ZVXTI73SYUA6RS7FJYC7OIARDDFYTVAFBH7BEYNJA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121106829 (607h31m21.891748164s) [noise=true , address=45.91.116.4:4939 , piece_id=7CV6VPBN5RA5CRY565LUVSQY7YQYM3ALKSEC73RV5QSTD4VBBL4A, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121249542 (607h31m21.891890867s) [noise=true , address=77.90.31.11:4555 , piece_id=M3GAYWU63PDQSV5MHAVLGXV53GWYK33JRSXZLHJCWDO4EJ5ZXJZA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121592128 (607h31m21.892233463s) [noise=true , address=104.36.82.12:4150 , piece_id=AYI6UITIDNUR7RC5P7LM36PSNIYKBI2U2EBSKD4IRFRPVAKDGIYA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.121878996 (607h31m21.892520331s) [noise=true , address=104.36.82.16:4295 , piece_id=KCENFMTJTOHVA5XGK5QYF6SW66TMSKW3TCQJKU5EWIJKMKBXFUYA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.122109017 (607h31m21.892750352s) [noise=true , address=45.91.116.14:4190 , piece_id=MOSOWA7NNLUJNTZAWNEYZMHJD7U6D4ALL4MCJBRM4FCM33TYRGJQ, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:47.127832217 (607h31m21.898473552s) [noise=true , address=77.90.31.12:4589 , piece_id=LYKG57L6G67IHMKFECMMOCL47FSO2D6A6KTTD6QDWL6D66ARG6KA, seg_pos={0 0}, upload=485834]: Uploading piece... Jul 18 16:41:48.840592792 (607h31m23.611234127s) [upload=485834]: Next returned nil segment Jul 18 16:41:48.840609223 (607h31m23.611250558s) [upload=485834]: Waiting for error group managing segments... Jul 18 16:41:49.162427890 (607h31m23.933069235s) [noise=true , address=104.36.82.10:4077 , piece_id=JTSZYPFMLFPULXEYU6RVAWHZSXUIELBIIPFBXIDSIMWPEYY3RFWA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.174349590 (607h31m23.944990915s) [noise=true , address=45.91.116.14:4190 , piece_id=MOSOWA7NNLUJNTZAWNEYZMHJD7U6D4ALL4MCJBRM4FCM33TYRGJQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.177597726 (607h31m23.948239091s) [noise=true , address=45.91.116.10:4083 , piece_id=MDJSZ6B4DXTYL6HDNXTMCUAIQ5KLHCYLAGG3N3MCJIP2QNL5RW5Q, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.178450397 (607h31m23.949091732s) [noise=true , address=45.91.116.5:4297 , piece_id=PUFJXKBYZAZOFCTME7XA6P4RHYGXVR3SUBOZHPVE7OARKCNLYJFQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.182076435 (607h31m23.95271777s) [noise=true , address=45.91.116.4:4939 , piece_id=7CV6VPBN5RA5CRY565LUVSQY7YQYM3ALKSEC73RV5QSTD4VBBL4A, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.249177562 (607h31m24.019818897s) [noise=true , address=104.36.82.12:4150 , piece_id=AYI6UITIDNUR7RC5P7LM36PSNIYKBI2U2EBSKD4IRFRPVAKDGIYA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.254394113 (607h31m24.025035448s) [noise=true , address=104.36.82.16:4294 , piece_id=AL5CBFM7G65APSHQ2VFLJ7ZNCTLG6FTEQW5KVQECJUF5GGW6L64A, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.263727842 (607h31m24.034369177s) [noise=true , address=104.36.82.7:4910 , piece_id=MXPIVOGGXL2ZVXTI73SYUA6RS7FJYC7OIARDDFYTVAFBH7BEYNJA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.266200353 (607h31m24.036841688s) [noise=true , address=45.91.116.9:4262 , piece_id=IH6HOZ6Z6OJB5KWUIC754YEVLX4QWSSF6M2SUCCU3DCVEJGENLPQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.283449276 (607h31m24.054090611s) [noise=true , address=45.91.116.8:4045 , piece_id=C74KAENMFPMGKUNZNAWBDBOW22H7P5XAMCGRMS4B3XDNVYEISDTA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.340968690 (607h31m24.111610025s) [noise=true , address=104.36.82.16:4295 , piece_id=KCENFMTJTOHVA5XGK5QYF6SW66TMSKW3TCQJKU5EWIJKMKBXFUYA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:41:49.360005013 (607h31m24.130646348s) [noise=true , address=104.36.82.4:4801 , piece_id=BD2IE6RBWE5P2ONS3YQUXRKVJBPRDYPOJTGHI3GU3WP5DLFI3DNA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil> Jul 18 16:42:16.239473886 (607h31m51.010115221s) [noise=true , address=77.90.31.13:4627 , piece_id=BK25LXSZA335BDKA7ECT276LAU4Q3DDMWOGYL3QRHQZGKSFO4OQA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection Jul 18 16:42:16.239514102 (607h31m51.010155437s) [noise=true , address=77.90.31.14:4661 , piece_id=45ACE325BMANQNS2F7GT5UBORIQ2ALIKASO5ITNMRJ35AZMY4TUA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection; write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection Jul 18 16:42:16.239543529 (607h31m51.010184864s) [noise=true , address=77.90.31.12:4589 , piece_id=LYKG57L6G67IHMKFECMMOCL47FSO2D6A6KTTD6QDWL6D66ARG6KA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection; write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection Jul 18 16:42:16.239600097 (607h31m51.010241432s) [noise=true , address=77.90.31.11:4555 , piece_id=M3GAYWU63PDQSV5MHAVLGXV53GWYK33JRSXZLHJCWDO4EJ5ZXJZA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection; write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection Jul 18 16:42:16.239630144 (607h31m51.010271519s) [seg_pos={0 0}, upload=485834]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:42:16.479299342 (607h31m51.249940677s) [upload=485834]: Done uploading segments... Jul 18 16:42:16.479325091 (607h31m51.249966416s) [upload=485834]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.241170738s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 480.37978ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:42:06 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 480.399127ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 447.001855ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:41:49 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 447.022224ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 463.508257ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:41:32 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 463.524869ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [........XX..X...............................................] duration: 24.603096975s FAIL (2025-07-18 16:41:23 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== t. successful: 13 optimal: 13 errs: <nil> Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments... Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil> Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments... Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment... Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment. Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments... Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces. Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments... Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil> Duration: 24.603130177s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 446.516837ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:41:15 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 446.589346ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 473.559377ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:41:13 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 473.587982ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 450.288385ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:40:20 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 450.31178ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 484.918932ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:40:10 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 484.943801ms edge ipfs us1

Orbiter Check History

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)