Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [XXX.........................................................] duration:
5.858333384s
FAIL (2025-07-18 17:32:53 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.858360575s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
458.95101ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 17:32:43 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 458.970086ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
480.643855ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 17:32:40 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 480.670086ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.XXX........................................................] duration:
5.796442684s
FAIL (2025-07-18 17:32:21 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.79646658s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
461.93104ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 17:31:46 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 461.953272ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
462.670206ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 17:31:37 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 462.68753ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [..XXX.......................................................] duration:
6.032228244s
FAIL (2025-07-18 17:31:30 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 6.032253442s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [...XXX......................................................] duration:
5.746837713s
FAIL (2025-07-18 17:30:45 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.746863413s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
465.74087ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 17:30:38 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 465.755138ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
461.489445ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 17:30:31 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 461.528432ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
460.741154ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 17:30:03 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 460.79104ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
453.46335ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 17:29:48 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 453.483599ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
460.469403ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 17:29:44 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 460.492518ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [....XXX.....................................................] duration:
5.951978995s
FAIL (2025-07-18 17:29:40 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.952005115s
core
uplink
us-select-1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
459.558101ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 17:29:22 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 459.579301ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
460.364584ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 17:28:51 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 460.385473ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....XXX....................................................] duration:
5.850372738s
FAIL (2025-07-18 17:28:33 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.850389811s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
449.422247ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 17:28:33 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 449.451374ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
467.987969ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 17:27:55 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 468.011334ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
457.712631ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 17:27:45 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 457.735975ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [......XXX...................................................] duration:
5.726100127s
FAIL (2025-07-18 17:27:42 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.726127339s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......XXX..................................................] duration:
5.949244997s
FAIL (2025-07-18 17:27:26 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.949268101s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
459.602485ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 17:27:03 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 459.625469ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
476.454329ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 17:26:51 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 476.470249ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [X.......XXX.................................................] duration:
5.795154538s
FAIL (2025-07-18 17:26:34 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.795182039s
core
uplink
us-select-1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
443.001623ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 17:26:18 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 443.046269ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X.......XXX................................................] duration:
5.909007651s
FAIL (2025-07-18 17:26:13 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.909037467s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
435.086238ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 17:26:01 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 435.109783ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X.......XXX...............................................] duration:
5.939918385s
FAIL (2025-07-18 17:25:43 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.939937422s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
459.086969ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 17:25:39 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 459.141856ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
446.357787ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 17:25:18 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 446.383034ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
479.6162ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 17:25:09 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 479.638823ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X.......XXX..............................................] duration:
5.893882091s
FAIL (2025-07-18 17:24:47 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.893907409s
core
uplink
us-select-1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
448.210579ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 17:24:35 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 448.230258ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
451.002651ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 17:24:30 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 451.025947ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X.......XXX.............................................] duration:
5.986715413s
FAIL (2025-07-18 17:24:16 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.986747975s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X.......XXX............................................] duration:
5.925193114s
FAIL (2025-07-18 17:23:52 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.925221818s
core
uplink
us-select-1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
466.992225ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 17:23:20 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 467.014988ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
451.15969ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 17:23:16 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 451.185581ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X.......XXX...........................................] duration:
5.886454517s
FAIL (2025-07-18 17:23:09 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.886478953s
core
uplink
us-select-1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
465.078253ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 17:22:57 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 465.100357ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X.......XXX..........................................] duration:
5.912667422s
FAIL (2025-07-18 17:22:52 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.912697629s
core
uplink
us-select-1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
470.817663ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 17:22:31 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 470.851779ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
501.282805ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 17:22:20 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 501.315918ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
454.852287ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 17:22:09 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 454.877386ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [........X.......XXX.........................................] duration:
5.860872764s
FAIL (2025-07-18 17:22:07 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.860982163s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
462.242416ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 17:21:41 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 462.256202ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
478.501025ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 17:21:35 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 478.525743ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
444.604409ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 17:21:21 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 444.623586ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........X.......XXX........................................] duration:
5.876763899s
FAIL (2025-07-18 17:20:53 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
upload=485950]: Uploading piece...
Jul 18 16:50:12.615610543 (607h39m47.386251878s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615727387 (607h39m47.386368722s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.615869268 (607h39m47.386510603s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616003735 (607h39m47.38664507s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616120308 (607h39m47.386761643s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616309480 (607h39m47.386950815s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616411576 (607h39m47.387052911s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616541854 (607h39m47.387183189s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616626436 (607h39m47.387267771s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616760322 (607h39m47.387401658s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616835707 (607h39m47.387477042s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.616984763 (607h39m47.387626088s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617041601 (607h39m47.387682936s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:12.617255590 (607h39m47.387896925s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Uploading piece...
Jul 18 16:50:14.381438715 (607h39m49.15208005s) [upload=485950]: Next returned nil segment
Jul 18 16:50:14.381456488 (607h39m49.152097823s) [upload=485950]: Waiting for error group managing segments...
Jul 18 16:50:14.672566298 (607h39m49.443207633s) [noise=true , address=45.91.116.8:4047 , piece_id=DGQHESMROG2IFTFVW34WESD6VPRGWCVUIKCIZB6SYYNCQVB5BGUQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.673583455 (607h39m49.44422479s) [noise=true , address=45.91.116.5:4298 , piece_id=TSS7GJU3OZD43AZBX2DC2ALAS4HSGO5CG7QUQF7UJLJ454K7CU4A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.729780378 (607h39m49.500421703s) [noise=true , address=104.36.82.15:4257 , piece_id=KKX3ICL7BJNUIXHJVROWOSXFYA2FIRN2OYLJD737ZUMFLLQQQJBA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.746550595 (607h39m49.51719192s) [noise=true , address=45.91.116.14:4190 , piece_id=VV5IORAGMLW56GF2UWABX4WBBUHLHN43PTIVIFER7ZNE46KATGWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.754034995 (607h39m49.52467633s) [noise=true , address=45.91.116.4:4937 , piece_id=6WH3ZDYGYX54QUPQN2WJ5Z5HO5TCEPGYXL47B2L53AY4JIHZRXVQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.758627883 (607h39m49.529269228s) [noise=true , address=104.36.82.5:4840 , piece_id=KBSWFZDXYG5F7HFHTCW6WPC5MV7C6EV7BXRZTSDSCCYQGMPHVYAQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.769751075 (607h39m49.54039241s) [noise=true , address=45.91.116.13:4154 , piece_id=CXLIADWITH2AD33FTJMNUYNCWNWBXWFV5NCBYHJ34LRJ54DCNEIA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:14.777952488 (607h39m49.548593813s) [noise=true , address=104.36.82.4:4802 , piece_id=XMOXZR4444CTE2X5FQ3DQDHIW56KP2F3LFP7K6EV262KHUJE3RZQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: <nil>
Jul 18 16:50:41.724011967 (607h40m16.494653332s) [noise=true , address=77.90.31.16:4734 , piece_id=BESQAMPL54BXRLGJRZPA5NNGJJBWWTV7X4OUMHDH673GPMY4FQ7A, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: expected piece hash; context deadline exceeded; EOF
Jul 18 16:50:41.724299687 (607h40m16.494941022s) [noise=true , address=77.90.31.18:4806 , piece_id=DSUVORW42MJBHZFCVMUXJWHICHFO756G7BEFWT6ZZPYQXIQFSVEQ, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57254->77.90.31.18:4806: use of closed network connection
Jul 18 16:50:41.724366485 (607h40m16.49500781s) [noise=true , address=77.90.31.19:4841 , piece_id=Z74FL6BQQUXD4GP5BJTJPU3VVFEA34CZK5GXPBX7MDO4JOPKHEWA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52184->77.90.31.19:4841: use of closed network connection
Jul 18 16:50:41.724371244 (607h40m16.495012579s) [noise=true , address=77.90.31.15:4699 , piece_id=GAWMRG5OTL3GUKG72IDV3BPDLYFO4QTDVY5SZHY7VYIKNLKXF32Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38114->77.90.31.15:4699: use of closed network connection
Jul 18 16:50:41.724408215 (607h40m16.49504955s) [noise=true , address=77.90.31.11:4554 , piece_id=STVQTFYHKIWL7APIJQMDIHSQKW7WB7GNZFM4BHXUCCITANWALDFA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58716->77.90.31.11:4554: use of closed network connection
Jul 18 16:50:41.724445475 (607h40m16.495086811s) [noise=true , address=77.90.31.10:4520 , piece_id=CKZKACHI54XBS4SCB2RJDTHRTLEU4QKYINKVPKHZ3WUPRVBSVI2Q, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42374->77.90.31.10:4520: use of closed network connection
Jul 18 16:50:41.724478770 (607h40m16.495120095s) [noise=true , address=77.90.31.16:4733 , piece_id=XNHCN5T6VW554PULETU22BZQDNYXQZJ5YU4INK4MQWG4HST7VMSA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45646->77.90.31.16:4733: use of closed network connection
Jul 18 16:50:41.724484421 (607h40m16.495125756s) [noise=true , address=77.90.31.12:4592 , piece_id=CKTIROA5XCDFJ43HW3NZO4KQTQWUMNHHWKVVUBVPUVEFCONX3FRA, seg_pos={0 0}, upload=485950]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33800->77.90.31.12:4592: use of closed network connection
Jul 18 16:50:41.724501733 (607h40m16.495143058s) [seg_pos={0 0}, upload=485950]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Jul 18 16:50:41.967808161 (607h40m16.738449496s) [upload=485950]: Done uploading segments...
Jul 18 16:50:41.967837917 (607h40m16.738479262s) [upload=485950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 5.87679129s
core
uplink
us-select-1
|