Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [............................X.......XXX.....................] duration:
5.777716796s
FAIL (2025-07-18 17:04:49 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.777747303s
core
uplink
us-select-1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
487.516691ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 17:04:33 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 487.539114ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
456.149287ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 17:04:27 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 456.171829ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.............................X.......XXX....................] duration:
5.911209401s
FAIL (2025-07-18 17:04:18 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.911234729s
core
uplink
us-select-1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
441.735209ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 17:03:58 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 441.764013ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
454.725822ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 17:03:23 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 454.743276ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
472.424736ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 17:03:21 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 472.442811ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [..............................X.......XXX...................] duration:
5.831845289s
FAIL (2025-07-18 17:03:17 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.831873823s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [...............................X.......XXX..................] duration:
5.735131584s
FAIL (2025-07-18 17:02:58 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.735157884s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
460.496954ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 17:02:58 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 460.52082ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [................................X.......XXX.................] duration:
5.78710157s
FAIL (2025-07-18 17:02:42 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.787129514s
core
uplink
us-select-1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
453.390447ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 17:02:35 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 453.414133ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
453.474167ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 17:02:22 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 453.496259ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
469.518627ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 17:01:44 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 469.561018ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
452.258062ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 17:01:35 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 452.283699ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.................................X.......XXX................] duration:
5.905673506s
FAIL (2025-07-18 17:01:34 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.905702712s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [..................................X.......XXX...............] duration:
5.95795061s
FAIL (2025-07-18 17:01:16 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.957980278s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
445.67228ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 17:01:16 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 445.721695ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
509.636044ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 17:01:11 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 509.677502ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [...................................X.......XXX..............] duration:
6.067660195s
FAIL (2025-07-18 17:00:50 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.067688138s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
459.470249ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 17:00:48 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 459.514484ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
461.549768ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 17:00:33 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 461.597832ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
451.239723ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 17:00:25 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 451.258118ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [....................................X.......XXX.............] duration:
5.692425827s
FAIL (2025-07-18 16:59:49 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.692453318s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
454.857685ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:59:39 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 454.880167ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
484.872242ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:59:26 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 484.894263ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
449.103455ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:59:02 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 449.124645ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....................................X.......XXX............] duration:
6.031840043s
FAIL (2025-07-18 16:58:55 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.031875942s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
459.071517ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:58:39 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 459.102477ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
460.389909ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:58:31 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 460.415087ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
459.16038ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:58:06 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 459.182531ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [......................................X.......XXX...........] duration:
6.067144752s
FAIL (2025-07-18 16:57:56 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.067176602s
core
uplink
us-select-1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
456.855247ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:57:55 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 456.87745ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......................................X.......XXX..........] duration:
5.878067262s
FAIL (2025-07-18 16:57:32 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.878092841s
core
uplink
us-select-1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
444.590321ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:57:23 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 444.617644ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
447.468836ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:57:18 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 447.490759ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
441.713529ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:56:56 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 441.734228ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
468.643192ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:56:33 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 468.66356ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [........................................X.......XXX.........] duration:
5.999079811s
FAIL (2025-07-18 16:56:24 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.999104829s
core
uplink
us-select-1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
478.219674ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:56:22 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 478.242988ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........................................X.......XXX........] duration:
5.731172532s
FAIL (2025-07-18 16:55:41 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.731217829s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
454.328402ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:55:34 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 454.347489ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
480.174794ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:55:30 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 480.19873ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
455.913495ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:54:53 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 455.935316ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
472.912311ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:54:33 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 472.933201ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [..........................................X.......XXX.......] duration:
5.76532126s
FAIL (2025-07-18 16:54:30 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.765342571s
core
uplink
us-select-1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
446.839643ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:54:07 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 446.862527ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [...........................................X.......XXX......] duration:
5.651554628s
FAIL (2025-07-18 16:53:54 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.65163973s
core
uplink
us-select-1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
455.489234ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:53:41 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 455.516486ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
455.511818ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:53:23 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 455.543018ms
edge
ipfs
us1
|