Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..X.........X........X.X.................X........X.........] duration:
6.241720618s
FAIL (2025-08-22 21:47:09 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 79f172c9b8c76f0aba5a1d1dad493b5ca82189b0a953c28978db3fb7f5f479f4 != before 8695c5660617eaebe9f3d25c46dcafc9ffa9917945d42ca97bfce73ecb7c2053
======LOGS======
Aug 22 21:40:57.471627668 (340h14m51.902707799s) [upload=353958]: Starting upload
Aug 22 21:40:57.471674216 (340h14m51.902754347s) [upload=353958]: Done starting upload
Aug 22 21:40:57.471750412 (340h14m51.902830573s) [upload=353958]: Uploading segments...
Aug 22 21:40:57.471845574 (340h14m51.902925755s) [upload=353958]: Got next segment. Inline: false
Aug 22 21:40:57.471939815 (340h14m51.903019976s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:40:57.471948000 (340h14m51.903028141s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:40:58.043624244 (340h14m52.474704375s) [seg_pos={0 0}, upload=353958]: Begin upload segment...
Aug 22 21:40:58.043694919 (340h14m52.47477505s) [seg_pos={0 0}, upload=353958]: Done begin upload segment.
Aug 22 21:40:58.043720388 (340h14m52.474800519s) [noise=true , address=104.36.82.21:4505 , piece_id=SJR4LJT5WWT2X5AKERB6TUV4Z5X5HFCBDH6N3WRHUNRUUWTLOVCQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.043760294 (340h14m52.474840425s) [noise=true , address=79.127.219.48:4092 , piece_id=VDRZVEDSYMFGJES3DD4BUHIVEXT2UHDGGQDJNVLL7RSNQHU2NRZQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044229852 (340h14m52.475309983s) [noise=true , address=77.90.31.11:4577 , piece_id=6ANOLCMW35P7J4YGCOUPORHALYHPGCSXJ4AW5T3RRTJJ3R5POQKA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044250272 (340h14m52.475330403s) [noise=true , address=77.90.31.10:4543 , piece_id=TK7EHEFGS2LVB7FUZMRQRK7EILY37XY22652L7YAVUSP72SLMBKA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044539895 (340h14m52.475620026s) [noise=true , address=77.90.31.19:4876 , piece_id=X6MDUCCK75ZD56BG4TPRZQS7OAXTBERGST35U7G7EIG5UXM77LDQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044647060 (340h14m52.475727191s) [noise=true , address=104.36.82.7:4939 , piece_id=BLRDDZYCFVHPO4EBYNOZTMPW4WASKIUWBQBK2LIK5IR3T4RCJEGQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044820292 (340h14m52.475900423s) [noise=true , address=104.36.82.8:4984 , piece_id=ON2U74FBBAI3DEGSWETVGQNKRHRYPA6U2D5PW3WXJCGSIHFDWFSQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044951944 (340h14m52.476032075s) [noise=true , address=77.90.31.12:4603 , piece_id=P22ARZVBEJIL223J7BINBWQY7BSYWITGJKI5I243PFDQHK34CYRA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045101089 (340h14m52.47618122s) [noise=true , address=104.36.82.22:4519 , piece_id=CV2SBRZSJSV5B7SZFOMPTVVXIAG5QIPBSYGEDQWXTYQHIPZPVZHQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045284019 (340h14m52.47636415s) [noise=true , address=104.36.82.45:4922 , piece_id=AKF26ERPUMLP547SJFU4RTBZ47P54FO55KDAINYVE5I2ADJTBETQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045646873 (340h14m52.476727004s) [noise=true , address=104.36.82.46:4503 , piece_id=Z3O3USZR6GHLGL7W7Z5QMOTMMY4ARTEHE5FGJWSWFOUS5XYLSE2Q, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045914616 (340h14m52.476994747s) [noise=true , address=104.36.82.34:4575 , piece_id=G6FNUHAELP6FQA7HIFOF3RDY4CJHV5K3DGVAQG5MXAOCJ3QUMEVA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050135038 (340h14m52.481215169s) [noise=true , address=104.36.82.5:4865 , piece_id=GUJE4YYEX6DV7MX4HAOJQDP46HS3ZJBLSKDKAVS4CGIRPZ4FFDSQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050486409 (340h14m52.481566541s) [noise=true , address=104.36.82.51:4081 , piece_id=U4CE27RP4ZRXGZDJK4D2FOUFVA7SLOSUSJAEEOQQL2N5W63NMXBQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050776936 (340h14m52.481857067s) [noise=true , address=77.90.31.16:4754 , piece_id=D65OAODYYHYWEABO5ZYT6U5DARUPYFIHLLKKLSCYPBG5U5NORVGA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051068393 (340h14m52.482148524s) [noise=true , address=104.36.82.4:4834 , piece_id=WYY3X2XXGF6W4QPD36OBB2K6WY4GNTCZBG2WRKOWTZYGJSAROUDQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051562658 (340h14m52.48264278s) [noise=true , address=45.91.116.12:4231 , piece_id=NVCS3ZC337QLCSHACKQDM7UBQR6GKSY3JRIBETWBCGB76YUKB35A, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051902568 (340h14m52.4829827s) [noise=true , address=45.91.116.10:4086 , piece_id=VIZUCI32JRYZIFEQ4ATNYTPZ4KSJT75JMMVXGDCI5IZD4OI2X2YQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:59.565685289 (340h14m53.99676542s) [upload=353958]: Next returned nil segment
Aug 22 21:40:59.565707271 (340h14m53.996787392s) [upload=353958]: Waiting for error group managing segments...
Aug 22 21:40:59.946483725 (340h14m54.377563856s) [noise=true , address=79.127.219.48:4092 , piece_id=VDRZVEDSYMFGJES3DD4BUHIVEXT2UHDGGQDJNVLL7RSNQHU2NRZQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.060120898 (340h14m54.491201029s) [noise=true , address=104.36.82.22:4519 , piece_id=CV2SBRZSJSV5B7SZFOMPTVVXIAG5QIPBSYGEDQWXTYQHIPZPVZHQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.080700483 (340h14m54.511780614s) [noise=true , address=45.91.116.10:4086 , piece_id=VIZUCI32JRYZIFEQ4ATNYTPZ4KSJT75JMMVXGDCI5IZD4OI2X2YQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.092428286 (340h14m54.523508417s) [noise=true , address=104.36.82.8:4984 , piece_id=ON2U74FBBAI3DEGSWETVGQNKRHRYPA6U2D5PW3WXJCGSIHFDWFSQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.138566839 (340h14m54.56964698s) [noise=true , address=104.36.82.4:4834 , piece_id=WYY3X2XXGF6W4QPD36OBB2K6WY4GNTCZBG2WRKOWTZYGJSAROUDQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.139660360 (340h14m54.570740492s) [noise=true , address=77.90.31.16:4754 , piece_id=D65OAODYYHYWEABO5ZYT6U5DARUPYFIHLLKKLSCYPBG5U5NORVGA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.158444390 (340h14m54.589524521s) [noise=true , address=104.36.82.21:4505 , piece_id=SJR4LJT5WWT2X5AKERB6TUV4Z5X5HFCBDH6N3WRHUNRUUWTLOVCQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.170355914 (340h14m54.601436045s) [noise=true , address=104.36.82.45:4922 , piece_id=AKF26ERPUMLP547SJFU4RTBZ47P54FO55KDAINYVE5I2ADJTBETQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.186411595 (340h14m54.617491726s) [noise=true , address=104.36.82.7:4939 , piece_id=BLRDDZYCFVHPO4EBYNOZTMPW4WASKIUWBQBK2LIK5IR3T4RCJEGQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.199800225 (340h14m54.630880356s) [noise=true , address=104.36.82.34:4575 , piece_id=G6FNUHAELP6FQA7HIFOF3RDY4CJHV5K3DGVAQG5MXAOCJ3QUMEVA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.220242326 (340h14m54.651322457s) [noise=true , address=104.36.82.46:4503 , piece_id=Z3O3USZR6GHLGL7W7Z5QMOTMMY4ARTEHE5FGJWSWFOUS5XYLSE2Q, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.374724247 (340h14m54.805804379s) [noise=true , address=77.90.31.10:4543 , piece_id=TK7EHEFGS2LVB7FUZMRQRK7EILY37XY22652L7YAVUSP72SLMBKA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.393724993 (340h14m54.824805124s) [noise=true , address=77.90.31.19:4876 , piece_id=X6MDUCCK75ZD56BG4TPRZQS7OAXTBERGST35U7G7EIG5UXM77LDQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.431278654 (340h14m54.862358785s) [noise=true , address=104.36.82.5:4865 , piece_id=GUJE4YYEX6DV7MX4HAOJQDP46HS3ZJBLSKDKAVS4CGIRPZ4FFDSQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.431306538 (340h14m54.862386669s) [seg_pos={0 0}, upload=353958]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:41:00.431400357 (340h14m54.862480488s) [noise=true , address=104.36.82.51:4081 , piece_id=U4CE27RP4ZRXGZDJK4D2FOUFVA7SLOSUSJAEEOQQL2N5W63NMXBQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121Gj3trM89mKpTffMYkrV9PrwkPqQU2LauCiG1v3J91Mej9KWF): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431499537 (340h14m54.862579668s) [noise=true , address=77.90.31.12:4603 , piece_id=P22ARZVBEJIL223J7BINBWQY7BSYWITGJKI5I243PFDQHK34CYRA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431547257 (340h14m54.862627388s) [noise=true , address=77.90.31.11:4577 , piece_id=6ANOLCMW35P7J4YGCOUPORHALYHPGCSXJ4AW5T3RRTJJ3R5POQKA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rKdimacehmW1Tp5Zp4DJFxafLhcEeNh61cfw8Bfefr9pRG2ei): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431593586 (340h14m54.862673717s) [noise=true , address=45.91.116.12:4231 , piece_id=NVCS3ZC337QLCSHACKQDM7UBQR6GKSY3JRIBETWBCGB76YUKB35A, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431631108 (340h14m54.862711239s) [seg_pos={0 0}, upload=353958]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:41:00.431741830 (340h14m54.862821961s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:41:00.431771327 (340h14m54.862851458s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:41:00.923112146 (340h14m55.354192278s) [upload=353958]: Done uploading segments...
Aug 22 21:41:00.923131634 (340h14m55.354211755s) [upload=353958]: Upload finished. err: <nil>
Duration: 6.241763229s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
8 out of 60 is failed (threshold=3) [X........XX.....X..X.X...........X........................X.] duration:
2.152356582s
FAIL (2025-08-22 21:46:41 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 22 21:45:51.331041082 (340h19m45.762121213s) [upload=354036]: Starting upload Aug 22 21:45:51.331091077 (340h19m45.762171208s) [upload=354036]: Done starting upload Aug 22 21:45:51.331145221 (340h19m45.762225352s) [upload=354036]: Uploading segments... Aug 22 21:45:51.331183164 (340h19m45.762263295s) [upload=354036]: Got next segment. Inline: true Aug 22 21:45:51.331186751 (340h19m45.762266882s) [upload=354036]: Waiting for error group managing segments... Aug 22 21:45:51.331219062 (340h19m45.762299193s) [upload=354036]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:45:51.331223100 (340h19m45.762303231s) [upload=354036]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:45:51.331225695 (340h19m45.762305826s) [upload=354036]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:45:51.644351888 (340h19m46.075432019s) [upload=354036]: Done uploading segments... Aug 22 21:45:51.644369922 (340h19m46.075450053s) [upload=354036]: Upload finished. err: <nil>
Duration: 2.15238632s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...X.........X........X.X.................X........X........] duration:
6.28526954s
FAIL (2025-08-22 21:46:32 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 79f172c9b8c76f0aba5a1d1dad493b5ca82189b0a953c28978db3fb7f5f479f4 != before 8695c5660617eaebe9f3d25c46dcafc9ffa9917945d42ca97bfce73ecb7c2053
======LOGS======
Aug 22 21:40:57.471627668 (340h14m51.902707799s) [upload=353958]: Starting upload
Aug 22 21:40:57.471674216 (340h14m51.902754347s) [upload=353958]: Done starting upload
Aug 22 21:40:57.471750412 (340h14m51.902830573s) [upload=353958]: Uploading segments...
Aug 22 21:40:57.471845574 (340h14m51.902925755s) [upload=353958]: Got next segment. Inline: false
Aug 22 21:40:57.471939815 (340h14m51.903019976s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:40:57.471948000 (340h14m51.903028141s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:40:58.043624244 (340h14m52.474704375s) [seg_pos={0 0}, upload=353958]: Begin upload segment...
Aug 22 21:40:58.043694919 (340h14m52.47477505s) [seg_pos={0 0}, upload=353958]: Done begin upload segment.
Aug 22 21:40:58.043720388 (340h14m52.474800519s) [noise=true , address=104.36.82.21:4505 , piece_id=SJR4LJT5WWT2X5AKERB6TUV4Z5X5HFCBDH6N3WRHUNRUUWTLOVCQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.043760294 (340h14m52.474840425s) [noise=true , address=79.127.219.48:4092 , piece_id=VDRZVEDSYMFGJES3DD4BUHIVEXT2UHDGGQDJNVLL7RSNQHU2NRZQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044229852 (340h14m52.475309983s) [noise=true , address=77.90.31.11:4577 , piece_id=6ANOLCMW35P7J4YGCOUPORHALYHPGCSXJ4AW5T3RRTJJ3R5POQKA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044250272 (340h14m52.475330403s) [noise=true , address=77.90.31.10:4543 , piece_id=TK7EHEFGS2LVB7FUZMRQRK7EILY37XY22652L7YAVUSP72SLMBKA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044539895 (340h14m52.475620026s) [noise=true , address=77.90.31.19:4876 , piece_id=X6MDUCCK75ZD56BG4TPRZQS7OAXTBERGST35U7G7EIG5UXM77LDQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044647060 (340h14m52.475727191s) [noise=true , address=104.36.82.7:4939 , piece_id=BLRDDZYCFVHPO4EBYNOZTMPW4WASKIUWBQBK2LIK5IR3T4RCJEGQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044820292 (340h14m52.475900423s) [noise=true , address=104.36.82.8:4984 , piece_id=ON2U74FBBAI3DEGSWETVGQNKRHRYPA6U2D5PW3WXJCGSIHFDWFSQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044951944 (340h14m52.476032075s) [noise=true , address=77.90.31.12:4603 , piece_id=P22ARZVBEJIL223J7BINBWQY7BSYWITGJKI5I243PFDQHK34CYRA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045101089 (340h14m52.47618122s) [noise=true , address=104.36.82.22:4519 , piece_id=CV2SBRZSJSV5B7SZFOMPTVVXIAG5QIPBSYGEDQWXTYQHIPZPVZHQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045284019 (340h14m52.47636415s) [noise=true , address=104.36.82.45:4922 , piece_id=AKF26ERPUMLP547SJFU4RTBZ47P54FO55KDAINYVE5I2ADJTBETQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045646873 (340h14m52.476727004s) [noise=true , address=104.36.82.46:4503 , piece_id=Z3O3USZR6GHLGL7W7Z5QMOTMMY4ARTEHE5FGJWSWFOUS5XYLSE2Q, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045914616 (340h14m52.476994747s) [noise=true , address=104.36.82.34:4575 , piece_id=G6FNUHAELP6FQA7HIFOF3RDY4CJHV5K3DGVAQG5MXAOCJ3QUMEVA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050135038 (340h14m52.481215169s) [noise=true , address=104.36.82.5:4865 , piece_id=GUJE4YYEX6DV7MX4HAOJQDP46HS3ZJBLSKDKAVS4CGIRPZ4FFDSQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050486409 (340h14m52.481566541s) [noise=true , address=104.36.82.51:4081 , piece_id=U4CE27RP4ZRXGZDJK4D2FOUFVA7SLOSUSJAEEOQQL2N5W63NMXBQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050776936 (340h14m52.481857067s) [noise=true , address=77.90.31.16:4754 , piece_id=D65OAODYYHYWEABO5ZYT6U5DARUPYFIHLLKKLSCYPBG5U5NORVGA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051068393 (340h14m52.482148524s) [noise=true , address=104.36.82.4:4834 , piece_id=WYY3X2XXGF6W4QPD36OBB2K6WY4GNTCZBG2WRKOWTZYGJSAROUDQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051562658 (340h14m52.48264278s) [noise=true , address=45.91.116.12:4231 , piece_id=NVCS3ZC337QLCSHACKQDM7UBQR6GKSY3JRIBETWBCGB76YUKB35A, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051902568 (340h14m52.4829827s) [noise=true , address=45.91.116.10:4086 , piece_id=VIZUCI32JRYZIFEQ4ATNYTPZ4KSJT75JMMVXGDCI5IZD4OI2X2YQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:59.565685289 (340h14m53.99676542s) [upload=353958]: Next returned nil segment
Aug 22 21:40:59.565707271 (340h14m53.996787392s) [upload=353958]: Waiting for error group managing segments...
Aug 22 21:40:59.946483725 (340h14m54.377563856s) [noise=true , address=79.127.219.48:4092 , piece_id=VDRZVEDSYMFGJES3DD4BUHIVEXT2UHDGGQDJNVLL7RSNQHU2NRZQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.060120898 (340h14m54.491201029s) [noise=true , address=104.36.82.22:4519 , piece_id=CV2SBRZSJSV5B7SZFOMPTVVXIAG5QIPBSYGEDQWXTYQHIPZPVZHQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.080700483 (340h14m54.511780614s) [noise=true , address=45.91.116.10:4086 , piece_id=VIZUCI32JRYZIFEQ4ATNYTPZ4KSJT75JMMVXGDCI5IZD4OI2X2YQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.092428286 (340h14m54.523508417s) [noise=true , address=104.36.82.8:4984 , piece_id=ON2U74FBBAI3DEGSWETVGQNKRHRYPA6U2D5PW3WXJCGSIHFDWFSQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.138566839 (340h14m54.56964698s) [noise=true , address=104.36.82.4:4834 , piece_id=WYY3X2XXGF6W4QPD36OBB2K6WY4GNTCZBG2WRKOWTZYGJSAROUDQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.139660360 (340h14m54.570740492s) [noise=true , address=77.90.31.16:4754 , piece_id=D65OAODYYHYWEABO5ZYT6U5DARUPYFIHLLKKLSCYPBG5U5NORVGA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.158444390 (340h14m54.589524521s) [noise=true , address=104.36.82.21:4505 , piece_id=SJR4LJT5WWT2X5AKERB6TUV4Z5X5HFCBDH6N3WRHUNRUUWTLOVCQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.170355914 (340h14m54.601436045s) [noise=true , address=104.36.82.45:4922 , piece_id=AKF26ERPUMLP547SJFU4RTBZ47P54FO55KDAINYVE5I2ADJTBETQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.186411595 (340h14m54.617491726s) [noise=true , address=104.36.82.7:4939 , piece_id=BLRDDZYCFVHPO4EBYNOZTMPW4WASKIUWBQBK2LIK5IR3T4RCJEGQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.199800225 (340h14m54.630880356s) [noise=true , address=104.36.82.34:4575 , piece_id=G6FNUHAELP6FQA7HIFOF3RDY4CJHV5K3DGVAQG5MXAOCJ3QUMEVA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.220242326 (340h14m54.651322457s) [noise=true , address=104.36.82.46:4503 , piece_id=Z3O3USZR6GHLGL7W7Z5QMOTMMY4ARTEHE5FGJWSWFOUS5XYLSE2Q, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.374724247 (340h14m54.805804379s) [noise=true , address=77.90.31.10:4543 , piece_id=TK7EHEFGS2LVB7FUZMRQRK7EILY37XY22652L7YAVUSP72SLMBKA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.393724993 (340h14m54.824805124s) [noise=true , address=77.90.31.19:4876 , piece_id=X6MDUCCK75ZD56BG4TPRZQS7OAXTBERGST35U7G7EIG5UXM77LDQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.431278654 (340h14m54.862358785s) [noise=true , address=104.36.82.5:4865 , piece_id=GUJE4YYEX6DV7MX4HAOJQDP46HS3ZJBLSKDKAVS4CGIRPZ4FFDSQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.431306538 (340h14m54.862386669s) [seg_pos={0 0}, upload=353958]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:41:00.431400357 (340h14m54.862480488s) [noise=true , address=104.36.82.51:4081 , piece_id=U4CE27RP4ZRXGZDJK4D2FOUFVA7SLOSUSJAEEOQQL2N5W63NMXBQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121Gj3trM89mKpTffMYkrV9PrwkPqQU2LauCiG1v3J91Mej9KWF): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431499537 (340h14m54.862579668s) [noise=true , address=77.90.31.12:4603 , piece_id=P22ARZVBEJIL223J7BINBWQY7BSYWITGJKI5I243PFDQHK34CYRA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431547257 (340h14m54.862627388s) [noise=true , address=77.90.31.11:4577 , piece_id=6ANOLCMW35P7J4YGCOUPORHALYHPGCSXJ4AW5T3RRTJJ3R5POQKA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rKdimacehmW1Tp5Zp4DJFxafLhcEeNh61cfw8Bfefr9pRG2ei): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431593586 (340h14m54.862673717s) [noise=true , address=45.91.116.12:4231 , piece_id=NVCS3ZC337QLCSHACKQDM7UBQR6GKSY3JRIBETWBCGB76YUKB35A, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431631108 (340h14m54.862711239s) [seg_pos={0 0}, upload=353958]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:41:00.431741830 (340h14m54.862821961s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:41:00.431771327 (340h14m54.862851458s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:41:00.923112146 (340h14m55.354192278s) [upload=353958]: Done uploading segments...
Aug 22 21:41:00.923131634 (340h14m55.354211755s) [upload=353958]: Upload finished. err: <nil>
Duration: 6.285287484s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [....X.........X........X.X.................X........X.......] duration:
5.964102808s
FAIL (2025-08-22 21:45:52 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 79f172c9b8c76f0aba5a1d1dad493b5ca82189b0a953c28978db3fb7f5f479f4 != before 8695c5660617eaebe9f3d25c46dcafc9ffa9917945d42ca97bfce73ecb7c2053
======LOGS======
Aug 22 21:40:57.471627668 (340h14m51.902707799s) [upload=353958]: Starting upload
Aug 22 21:40:57.471674216 (340h14m51.902754347s) [upload=353958]: Done starting upload
Aug 22 21:40:57.471750412 (340h14m51.902830573s) [upload=353958]: Uploading segments...
Aug 22 21:40:57.471845574 (340h14m51.902925755s) [upload=353958]: Got next segment. Inline: false
Aug 22 21:40:57.471939815 (340h14m51.903019976s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:40:57.471948000 (340h14m51.903028141s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:40:58.043624244 (340h14m52.474704375s) [seg_pos={0 0}, upload=353958]: Begin upload segment...
Aug 22 21:40:58.043694919 (340h14m52.47477505s) [seg_pos={0 0}, upload=353958]: Done begin upload segment.
Aug 22 21:40:58.043720388 (340h14m52.474800519s) [noise=true , address=104.36.82.21:4505 , piece_id=SJR4LJT5WWT2X5AKERB6TUV4Z5X5HFCBDH6N3WRHUNRUUWTLOVCQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.043760294 (340h14m52.474840425s) [noise=true , address=79.127.219.48:4092 , piece_id=VDRZVEDSYMFGJES3DD4BUHIVEXT2UHDGGQDJNVLL7RSNQHU2NRZQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044229852 (340h14m52.475309983s) [noise=true , address=77.90.31.11:4577 , piece_id=6ANOLCMW35P7J4YGCOUPORHALYHPGCSXJ4AW5T3RRTJJ3R5POQKA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044250272 (340h14m52.475330403s) [noise=true , address=77.90.31.10:4543 , piece_id=TK7EHEFGS2LVB7FUZMRQRK7EILY37XY22652L7YAVUSP72SLMBKA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044539895 (340h14m52.475620026s) [noise=true , address=77.90.31.19:4876 , piece_id=X6MDUCCK75ZD56BG4TPRZQS7OAXTBERGST35U7G7EIG5UXM77LDQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044647060 (340h14m52.475727191s) [noise=true , address=104.36.82.7:4939 , piece_id=BLRDDZYCFVHPO4EBYNOZTMPW4WASKIUWBQBK2LIK5IR3T4RCJEGQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044820292 (340h14m52.475900423s) [noise=true , address=104.36.82.8:4984 , piece_id=ON2U74FBBAI3DEGSWETVGQNKRHRYPA6U2D5PW3WXJCGSIHFDWFSQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044951944 (340h14m52.476032075s) [noise=true , address=77.90.31.12:4603 , piece_id=P22ARZVBEJIL223J7BINBWQY7BSYWITGJKI5I243PFDQHK34CYRA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045101089 (340h14m52.47618122s) [noise=true , address=104.36.82.22:4519 , piece_id=CV2SBRZSJSV5B7SZFOMPTVVXIAG5QIPBSYGEDQWXTYQHIPZPVZHQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045284019 (340h14m52.47636415s) [noise=true , address=104.36.82.45:4922 , piece_id=AKF26ERPUMLP547SJFU4RTBZ47P54FO55KDAINYVE5I2ADJTBETQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045646873 (340h14m52.476727004s) [noise=true , address=104.36.82.46:4503 , piece_id=Z3O3USZR6GHLGL7W7Z5QMOTMMY4ARTEHE5FGJWSWFOUS5XYLSE2Q, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045914616 (340h14m52.476994747s) [noise=true , address=104.36.82.34:4575 , piece_id=G6FNUHAELP6FQA7HIFOF3RDY4CJHV5K3DGVAQG5MXAOCJ3QUMEVA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050135038 (340h14m52.481215169s) [noise=true , address=104.36.82.5:4865 , piece_id=GUJE4YYEX6DV7MX4HAOJQDP46HS3ZJBLSKDKAVS4CGIRPZ4FFDSQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050486409 (340h14m52.481566541s) [noise=true , address=104.36.82.51:4081 , piece_id=U4CE27RP4ZRXGZDJK4D2FOUFVA7SLOSUSJAEEOQQL2N5W63NMXBQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050776936 (340h14m52.481857067s) [noise=true , address=77.90.31.16:4754 , piece_id=D65OAODYYHYWEABO5ZYT6U5DARUPYFIHLLKKLSCYPBG5U5NORVGA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051068393 (340h14m52.482148524s) [noise=true , address=104.36.82.4:4834 , piece_id=WYY3X2XXGF6W4QPD36OBB2K6WY4GNTCZBG2WRKOWTZYGJSAROUDQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051562658 (340h14m52.48264278s) [noise=true , address=45.91.116.12:4231 , piece_id=NVCS3ZC337QLCSHACKQDM7UBQR6GKSY3JRIBETWBCGB76YUKB35A, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051902568 (340h14m52.4829827s) [noise=true , address=45.91.116.10:4086 , piece_id=VIZUCI32JRYZIFEQ4ATNYTPZ4KSJT75JMMVXGDCI5IZD4OI2X2YQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:59.565685289 (340h14m53.99676542s) [upload=353958]: Next returned nil segment
Aug 22 21:40:59.565707271 (340h14m53.996787392s) [upload=353958]: Waiting for error group managing segments...
Aug 22 21:40:59.946483725 (340h14m54.377563856s) [noise=true , address=79.127.219.48:4092 , piece_id=VDRZVEDSYMFGJES3DD4BUHIVEXT2UHDGGQDJNVLL7RSNQHU2NRZQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.060120898 (340h14m54.491201029s) [noise=true , address=104.36.82.22:4519 , piece_id=CV2SBRZSJSV5B7SZFOMPTVVXIAG5QIPBSYGEDQWXTYQHIPZPVZHQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.080700483 (340h14m54.511780614s) [noise=true , address=45.91.116.10:4086 , piece_id=VIZUCI32JRYZIFEQ4ATNYTPZ4KSJT75JMMVXGDCI5IZD4OI2X2YQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.092428286 (340h14m54.523508417s) [noise=true , address=104.36.82.8:4984 , piece_id=ON2U74FBBAI3DEGSWETVGQNKRHRYPA6U2D5PW3WXJCGSIHFDWFSQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.138566839 (340h14m54.56964698s) [noise=true , address=104.36.82.4:4834 , piece_id=WYY3X2XXGF6W4QPD36OBB2K6WY4GNTCZBG2WRKOWTZYGJSAROUDQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.139660360 (340h14m54.570740492s) [noise=true , address=77.90.31.16:4754 , piece_id=D65OAODYYHYWEABO5ZYT6U5DARUPYFIHLLKKLSCYPBG5U5NORVGA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.158444390 (340h14m54.589524521s) [noise=true , address=104.36.82.21:4505 , piece_id=SJR4LJT5WWT2X5AKERB6TUV4Z5X5HFCBDH6N3WRHUNRUUWTLOVCQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.170355914 (340h14m54.601436045s) [noise=true , address=104.36.82.45:4922 , piece_id=AKF26ERPUMLP547SJFU4RTBZ47P54FO55KDAINYVE5I2ADJTBETQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.186411595 (340h14m54.617491726s) [noise=true , address=104.36.82.7:4939 , piece_id=BLRDDZYCFVHPO4EBYNOZTMPW4WASKIUWBQBK2LIK5IR3T4RCJEGQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.199800225 (340h14m54.630880356s) [noise=true , address=104.36.82.34:4575 , piece_id=G6FNUHAELP6FQA7HIFOF3RDY4CJHV5K3DGVAQG5MXAOCJ3QUMEVA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.220242326 (340h14m54.651322457s) [noise=true , address=104.36.82.46:4503 , piece_id=Z3O3USZR6GHLGL7W7Z5QMOTMMY4ARTEHE5FGJWSWFOUS5XYLSE2Q, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.374724247 (340h14m54.805804379s) [noise=true , address=77.90.31.10:4543 , piece_id=TK7EHEFGS2LVB7FUZMRQRK7EILY37XY22652L7YAVUSP72SLMBKA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.393724993 (340h14m54.824805124s) [noise=true , address=77.90.31.19:4876 , piece_id=X6MDUCCK75ZD56BG4TPRZQS7OAXTBERGST35U7G7EIG5UXM77LDQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.431278654 (340h14m54.862358785s) [noise=true , address=104.36.82.5:4865 , piece_id=GUJE4YYEX6DV7MX4HAOJQDP46HS3ZJBLSKDKAVS4CGIRPZ4FFDSQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.431306538 (340h14m54.862386669s) [seg_pos={0 0}, upload=353958]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:41:00.431400357 (340h14m54.862480488s) [noise=true , address=104.36.82.51:4081 , piece_id=U4CE27RP4ZRXGZDJK4D2FOUFVA7SLOSUSJAEEOQQL2N5W63NMXBQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121Gj3trM89mKpTffMYkrV9PrwkPqQU2LauCiG1v3J91Mej9KWF): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431499537 (340h14m54.862579668s) [noise=true , address=77.90.31.12:4603 , piece_id=P22ARZVBEJIL223J7BINBWQY7BSYWITGJKI5I243PFDQHK34CYRA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431547257 (340h14m54.862627388s) [noise=true , address=77.90.31.11:4577 , piece_id=6ANOLCMW35P7J4YGCOUPORHALYHPGCSXJ4AW5T3RRTJJ3R5POQKA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rKdimacehmW1Tp5Zp4DJFxafLhcEeNh61cfw8Bfefr9pRG2ei): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431593586 (340h14m54.862673717s) [noise=true , address=45.91.116.12:4231 , piece_id=NVCS3ZC337QLCSHACKQDM7UBQR6GKSY3JRIBETWBCGB76YUKB35A, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431631108 (340h14m54.862711239s) [seg_pos={0 0}, upload=353958]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:41:00.431741830 (340h14m54.862821961s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:41:00.431771327 (340h14m54.862851458s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:41:00.923112146 (340h14m55.354192278s) [upload=353958]: Done uploading segments...
Aug 22 21:41:00.923131634 (340h14m55.354211755s) [upload=353958]: Upload finished. err: <nil>
Duration: 5.964132705s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
8 out of 60 is failed (threshold=3) [.X........XX.....X..X.X...........X........................X] duration:
1.458727891s
FAIL (2025-08-22 21:45:52 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 22 21:45:51.331041082 (340h19m45.762121213s) [upload=354036]: Starting upload Aug 22 21:45:51.331091077 (340h19m45.762171208s) [upload=354036]: Done starting upload Aug 22 21:45:51.331145221 (340h19m45.762225352s) [upload=354036]: Uploading segments... Aug 22 21:45:51.331183164 (340h19m45.762263295s) [upload=354036]: Got next segment. Inline: true Aug 22 21:45:51.331186751 (340h19m45.762266882s) [upload=354036]: Waiting for error group managing segments... Aug 22 21:45:51.331219062 (340h19m45.762299193s) [upload=354036]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:45:51.331223100 (340h19m45.762303231s) [upload=354036]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:45:51.331225695 (340h19m45.762305826s) [upload=354036]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:45:51.644351888 (340h19m46.075432019s) [upload=354036]: Done uploading segments... Aug 22 21:45:51.644369922 (340h19m46.075450053s) [upload=354036]: Upload finished. err: <nil>
Duration: 1.458756625s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.....X.........X........X.X.................X........X......] duration:
6.044542884s
FAIL (2025-08-22 21:45:26 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 79f172c9b8c76f0aba5a1d1dad493b5ca82189b0a953c28978db3fb7f5f479f4 != before 8695c5660617eaebe9f3d25c46dcafc9ffa9917945d42ca97bfce73ecb7c2053
======LOGS======
Aug 22 21:40:57.471627668 (340h14m51.902707799s) [upload=353958]: Starting upload
Aug 22 21:40:57.471674216 (340h14m51.902754347s) [upload=353958]: Done starting upload
Aug 22 21:40:57.471750412 (340h14m51.902830573s) [upload=353958]: Uploading segments...
Aug 22 21:40:57.471845574 (340h14m51.902925755s) [upload=353958]: Got next segment. Inline: false
Aug 22 21:40:57.471939815 (340h14m51.903019976s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:40:57.471948000 (340h14m51.903028141s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:40:58.043624244 (340h14m52.474704375s) [seg_pos={0 0}, upload=353958]: Begin upload segment...
Aug 22 21:40:58.043694919 (340h14m52.47477505s) [seg_pos={0 0}, upload=353958]: Done begin upload segment.
Aug 22 21:40:58.043720388 (340h14m52.474800519s) [noise=true , address=104.36.82.21:4505 , piece_id=SJR4LJT5WWT2X5AKERB6TUV4Z5X5HFCBDH6N3WRHUNRUUWTLOVCQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.043760294 (340h14m52.474840425s) [noise=true , address=79.127.219.48:4092 , piece_id=VDRZVEDSYMFGJES3DD4BUHIVEXT2UHDGGQDJNVLL7RSNQHU2NRZQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044229852 (340h14m52.475309983s) [noise=true , address=77.90.31.11:4577 , piece_id=6ANOLCMW35P7J4YGCOUPORHALYHPGCSXJ4AW5T3RRTJJ3R5POQKA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044250272 (340h14m52.475330403s) [noise=true , address=77.90.31.10:4543 , piece_id=TK7EHEFGS2LVB7FUZMRQRK7EILY37XY22652L7YAVUSP72SLMBKA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044539895 (340h14m52.475620026s) [noise=true , address=77.90.31.19:4876 , piece_id=X6MDUCCK75ZD56BG4TPRZQS7OAXTBERGST35U7G7EIG5UXM77LDQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044647060 (340h14m52.475727191s) [noise=true , address=104.36.82.7:4939 , piece_id=BLRDDZYCFVHPO4EBYNOZTMPW4WASKIUWBQBK2LIK5IR3T4RCJEGQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044820292 (340h14m52.475900423s) [noise=true , address=104.36.82.8:4984 , piece_id=ON2U74FBBAI3DEGSWETVGQNKRHRYPA6U2D5PW3WXJCGSIHFDWFSQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044951944 (340h14m52.476032075s) [noise=true , address=77.90.31.12:4603 , piece_id=P22ARZVBEJIL223J7BINBWQY7BSYWITGJKI5I243PFDQHK34CYRA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045101089 (340h14m52.47618122s) [noise=true , address=104.36.82.22:4519 , piece_id=CV2SBRZSJSV5B7SZFOMPTVVXIAG5QIPBSYGEDQWXTYQHIPZPVZHQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045284019 (340h14m52.47636415s) [noise=true , address=104.36.82.45:4922 , piece_id=AKF26ERPUMLP547SJFU4RTBZ47P54FO55KDAINYVE5I2ADJTBETQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045646873 (340h14m52.476727004s) [noise=true , address=104.36.82.46:4503 , piece_id=Z3O3USZR6GHLGL7W7Z5QMOTMMY4ARTEHE5FGJWSWFOUS5XYLSE2Q, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045914616 (340h14m52.476994747s) [noise=true , address=104.36.82.34:4575 , piece_id=G6FNUHAELP6FQA7HIFOF3RDY4CJHV5K3DGVAQG5MXAOCJ3QUMEVA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050135038 (340h14m52.481215169s) [noise=true , address=104.36.82.5:4865 , piece_id=GUJE4YYEX6DV7MX4HAOJQDP46HS3ZJBLSKDKAVS4CGIRPZ4FFDSQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050486409 (340h14m52.481566541s) [noise=true , address=104.36.82.51:4081 , piece_id=U4CE27RP4ZRXGZDJK4D2FOUFVA7SLOSUSJAEEOQQL2N5W63NMXBQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050776936 (340h14m52.481857067s) [noise=true , address=77.90.31.16:4754 , piece_id=D65OAODYYHYWEABO5ZYT6U5DARUPYFIHLLKKLSCYPBG5U5NORVGA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051068393 (340h14m52.482148524s) [noise=true , address=104.36.82.4:4834 , piece_id=WYY3X2XXGF6W4QPD36OBB2K6WY4GNTCZBG2WRKOWTZYGJSAROUDQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051562658 (340h14m52.48264278s) [noise=true , address=45.91.116.12:4231 , piece_id=NVCS3ZC337QLCSHACKQDM7UBQR6GKSY3JRIBETWBCGB76YUKB35A, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051902568 (340h14m52.4829827s) [noise=true , address=45.91.116.10:4086 , piece_id=VIZUCI32JRYZIFEQ4ATNYTPZ4KSJT75JMMVXGDCI5IZD4OI2X2YQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:59.565685289 (340h14m53.99676542s) [upload=353958]: Next returned nil segment
Aug 22 21:40:59.565707271 (340h14m53.996787392s) [upload=353958]: Waiting for error group managing segments...
Aug 22 21:40:59.946483725 (340h14m54.377563856s) [noise=true , address=79.127.219.48:4092 , piece_id=VDRZVEDSYMFGJES3DD4BUHIVEXT2UHDGGQDJNVLL7RSNQHU2NRZQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.060120898 (340h14m54.491201029s) [noise=true , address=104.36.82.22:4519 , piece_id=CV2SBRZSJSV5B7SZFOMPTVVXIAG5QIPBSYGEDQWXTYQHIPZPVZHQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.080700483 (340h14m54.511780614s) [noise=true , address=45.91.116.10:4086 , piece_id=VIZUCI32JRYZIFEQ4ATNYTPZ4KSJT75JMMVXGDCI5IZD4OI2X2YQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.092428286 (340h14m54.523508417s) [noise=true , address=104.36.82.8:4984 , piece_id=ON2U74FBBAI3DEGSWETVGQNKRHRYPA6U2D5PW3WXJCGSIHFDWFSQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.138566839 (340h14m54.56964698s) [noise=true , address=104.36.82.4:4834 , piece_id=WYY3X2XXGF6W4QPD36OBB2K6WY4GNTCZBG2WRKOWTZYGJSAROUDQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.139660360 (340h14m54.570740492s) [noise=true , address=77.90.31.16:4754 , piece_id=D65OAODYYHYWEABO5ZYT6U5DARUPYFIHLLKKLSCYPBG5U5NORVGA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.158444390 (340h14m54.589524521s) [noise=true , address=104.36.82.21:4505 , piece_id=SJR4LJT5WWT2X5AKERB6TUV4Z5X5HFCBDH6N3WRHUNRUUWTLOVCQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.170355914 (340h14m54.601436045s) [noise=true , address=104.36.82.45:4922 , piece_id=AKF26ERPUMLP547SJFU4RTBZ47P54FO55KDAINYVE5I2ADJTBETQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.186411595 (340h14m54.617491726s) [noise=true , address=104.36.82.7:4939 , piece_id=BLRDDZYCFVHPO4EBYNOZTMPW4WASKIUWBQBK2LIK5IR3T4RCJEGQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.199800225 (340h14m54.630880356s) [noise=true , address=104.36.82.34:4575 , piece_id=G6FNUHAELP6FQA7HIFOF3RDY4CJHV5K3DGVAQG5MXAOCJ3QUMEVA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.220242326 (340h14m54.651322457s) [noise=true , address=104.36.82.46:4503 , piece_id=Z3O3USZR6GHLGL7W7Z5QMOTMMY4ARTEHE5FGJWSWFOUS5XYLSE2Q, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.374724247 (340h14m54.805804379s) [noise=true , address=77.90.31.10:4543 , piece_id=TK7EHEFGS2LVB7FUZMRQRK7EILY37XY22652L7YAVUSP72SLMBKA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.393724993 (340h14m54.824805124s) [noise=true , address=77.90.31.19:4876 , piece_id=X6MDUCCK75ZD56BG4TPRZQS7OAXTBERGST35U7G7EIG5UXM77LDQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.431278654 (340h14m54.862358785s) [noise=true , address=104.36.82.5:4865 , piece_id=GUJE4YYEX6DV7MX4HAOJQDP46HS3ZJBLSKDKAVS4CGIRPZ4FFDSQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.431306538 (340h14m54.862386669s) [seg_pos={0 0}, upload=353958]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:41:00.431400357 (340h14m54.862480488s) [noise=true , address=104.36.82.51:4081 , piece_id=U4CE27RP4ZRXGZDJK4D2FOUFVA7SLOSUSJAEEOQQL2N5W63NMXBQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121Gj3trM89mKpTffMYkrV9PrwkPqQU2LauCiG1v3J91Mej9KWF): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431499537 (340h14m54.862579668s) [noise=true , address=77.90.31.12:4603 , piece_id=P22ARZVBEJIL223J7BINBWQY7BSYWITGJKI5I243PFDQHK34CYRA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431547257 (340h14m54.862627388s) [noise=true , address=77.90.31.11:4577 , piece_id=6ANOLCMW35P7J4YGCOUPORHALYHPGCSXJ4AW5T3RRTJJ3R5POQKA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rKdimacehmW1Tp5Zp4DJFxafLhcEeNh61cfw8Bfefr9pRG2ei): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431593586 (340h14m54.862673717s) [noise=true , address=45.91.116.12:4231 , piece_id=NVCS3ZC337QLCSHACKQDM7UBQR6GKSY3JRIBETWBCGB76YUKB35A, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431631108 (340h14m54.862711239s) [seg_pos={0 0}, upload=353958]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:41:00.431741830 (340h14m54.862821961s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:41:00.431771327 (340h14m54.862851458s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:41:00.923112146 (340h14m55.354192278s) [upload=353958]: Done uploading segments...
Aug 22 21:41:00.923131634 (340h14m55.354211755s) [upload=353958]: Upload finished. err: <nil>
Duration: 6.044581127s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [......X.........X........X.X.................X........X.....] duration:
6.209721868s
FAIL (2025-08-22 21:45:11 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 79f172c9b8c76f0aba5a1d1dad493b5ca82189b0a953c28978db3fb7f5f479f4 != before 8695c5660617eaebe9f3d25c46dcafc9ffa9917945d42ca97bfce73ecb7c2053
======LOGS======
Aug 22 21:40:57.471627668 (340h14m51.902707799s) [upload=353958]: Starting upload
Aug 22 21:40:57.471674216 (340h14m51.902754347s) [upload=353958]: Done starting upload
Aug 22 21:40:57.471750412 (340h14m51.902830573s) [upload=353958]: Uploading segments...
Aug 22 21:40:57.471845574 (340h14m51.902925755s) [upload=353958]: Got next segment. Inline: false
Aug 22 21:40:57.471939815 (340h14m51.903019976s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:40:57.471948000 (340h14m51.903028141s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:40:58.043624244 (340h14m52.474704375s) [seg_pos={0 0}, upload=353958]: Begin upload segment...
Aug 22 21:40:58.043694919 (340h14m52.47477505s) [seg_pos={0 0}, upload=353958]: Done begin upload segment.
Aug 22 21:40:58.043720388 (340h14m52.474800519s) [noise=true , address=104.36.82.21:4505 , piece_id=SJR4LJT5WWT2X5AKERB6TUV4Z5X5HFCBDH6N3WRHUNRUUWTLOVCQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.043760294 (340h14m52.474840425s) [noise=true , address=79.127.219.48:4092 , piece_id=VDRZVEDSYMFGJES3DD4BUHIVEXT2UHDGGQDJNVLL7RSNQHU2NRZQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044229852 (340h14m52.475309983s) [noise=true , address=77.90.31.11:4577 , piece_id=6ANOLCMW35P7J4YGCOUPORHALYHPGCSXJ4AW5T3RRTJJ3R5POQKA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044250272 (340h14m52.475330403s) [noise=true , address=77.90.31.10:4543 , piece_id=TK7EHEFGS2LVB7FUZMRQRK7EILY37XY22652L7YAVUSP72SLMBKA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044539895 (340h14m52.475620026s) [noise=true , address=77.90.31.19:4876 , piece_id=X6MDUCCK75ZD56BG4TPRZQS7OAXTBERGST35U7G7EIG5UXM77LDQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044647060 (340h14m52.475727191s) [noise=true , address=104.36.82.7:4939 , piece_id=BLRDDZYCFVHPO4EBYNOZTMPW4WASKIUWBQBK2LIK5IR3T4RCJEGQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044820292 (340h14m52.475900423s) [noise=true , address=104.36.82.8:4984 , piece_id=ON2U74FBBAI3DEGSWETVGQNKRHRYPA6U2D5PW3WXJCGSIHFDWFSQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044951944 (340h14m52.476032075s) [noise=true , address=77.90.31.12:4603 , piece_id=P22ARZVBEJIL223J7BINBWQY7BSYWITGJKI5I243PFDQHK34CYRA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045101089 (340h14m52.47618122s) [noise=true , address=104.36.82.22:4519 , piece_id=CV2SBRZSJSV5B7SZFOMPTVVXIAG5QIPBSYGEDQWXTYQHIPZPVZHQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045284019 (340h14m52.47636415s) [noise=true , address=104.36.82.45:4922 , piece_id=AKF26ERPUMLP547SJFU4RTBZ47P54FO55KDAINYVE5I2ADJTBETQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045646873 (340h14m52.476727004s) [noise=true , address=104.36.82.46:4503 , piece_id=Z3O3USZR6GHLGL7W7Z5QMOTMMY4ARTEHE5FGJWSWFOUS5XYLSE2Q, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045914616 (340h14m52.476994747s) [noise=true , address=104.36.82.34:4575 , piece_id=G6FNUHAELP6FQA7HIFOF3RDY4CJHV5K3DGVAQG5MXAOCJ3QUMEVA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050135038 (340h14m52.481215169s) [noise=true , address=104.36.82.5:4865 , piece_id=GUJE4YYEX6DV7MX4HAOJQDP46HS3ZJBLSKDKAVS4CGIRPZ4FFDSQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050486409 (340h14m52.481566541s) [noise=true , address=104.36.82.51:4081 , piece_id=U4CE27RP4ZRXGZDJK4D2FOUFVA7SLOSUSJAEEOQQL2N5W63NMXBQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050776936 (340h14m52.481857067s) [noise=true , address=77.90.31.16:4754 , piece_id=D65OAODYYHYWEABO5ZYT6U5DARUPYFIHLLKKLSCYPBG5U5NORVGA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051068393 (340h14m52.482148524s) [noise=true , address=104.36.82.4:4834 , piece_id=WYY3X2XXGF6W4QPD36OBB2K6WY4GNTCZBG2WRKOWTZYGJSAROUDQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051562658 (340h14m52.48264278s) [noise=true , address=45.91.116.12:4231 , piece_id=NVCS3ZC337QLCSHACKQDM7UBQR6GKSY3JRIBETWBCGB76YUKB35A, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051902568 (340h14m52.4829827s) [noise=true , address=45.91.116.10:4086 , piece_id=VIZUCI32JRYZIFEQ4ATNYTPZ4KSJT75JMMVXGDCI5IZD4OI2X2YQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:59.565685289 (340h14m53.99676542s) [upload=353958]: Next returned nil segment
Aug 22 21:40:59.565707271 (340h14m53.996787392s) [upload=353958]: Waiting for error group managing segments...
Aug 22 21:40:59.946483725 (340h14m54.377563856s) [noise=true , address=79.127.219.48:4092 , piece_id=VDRZVEDSYMFGJES3DD4BUHIVEXT2UHDGGQDJNVLL7RSNQHU2NRZQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.060120898 (340h14m54.491201029s) [noise=true , address=104.36.82.22:4519 , piece_id=CV2SBRZSJSV5B7SZFOMPTVVXIAG5QIPBSYGEDQWXTYQHIPZPVZHQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.080700483 (340h14m54.511780614s) [noise=true , address=45.91.116.10:4086 , piece_id=VIZUCI32JRYZIFEQ4ATNYTPZ4KSJT75JMMVXGDCI5IZD4OI2X2YQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.092428286 (340h14m54.523508417s) [noise=true , address=104.36.82.8:4984 , piece_id=ON2U74FBBAI3DEGSWETVGQNKRHRYPA6U2D5PW3WXJCGSIHFDWFSQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.138566839 (340h14m54.56964698s) [noise=true , address=104.36.82.4:4834 , piece_id=WYY3X2XXGF6W4QPD36OBB2K6WY4GNTCZBG2WRKOWTZYGJSAROUDQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.139660360 (340h14m54.570740492s) [noise=true , address=77.90.31.16:4754 , piece_id=D65OAODYYHYWEABO5ZYT6U5DARUPYFIHLLKKLSCYPBG5U5NORVGA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.158444390 (340h14m54.589524521s) [noise=true , address=104.36.82.21:4505 , piece_id=SJR4LJT5WWT2X5AKERB6TUV4Z5X5HFCBDH6N3WRHUNRUUWTLOVCQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.170355914 (340h14m54.601436045s) [noise=true , address=104.36.82.45:4922 , piece_id=AKF26ERPUMLP547SJFU4RTBZ47P54FO55KDAINYVE5I2ADJTBETQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.186411595 (340h14m54.617491726s) [noise=true , address=104.36.82.7:4939 , piece_id=BLRDDZYCFVHPO4EBYNOZTMPW4WASKIUWBQBK2LIK5IR3T4RCJEGQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.199800225 (340h14m54.630880356s) [noise=true , address=104.36.82.34:4575 , piece_id=G6FNUHAELP6FQA7HIFOF3RDY4CJHV5K3DGVAQG5MXAOCJ3QUMEVA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.220242326 (340h14m54.651322457s) [noise=true , address=104.36.82.46:4503 , piece_id=Z3O3USZR6GHLGL7W7Z5QMOTMMY4ARTEHE5FGJWSWFOUS5XYLSE2Q, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.374724247 (340h14m54.805804379s) [noise=true , address=77.90.31.10:4543 , piece_id=TK7EHEFGS2LVB7FUZMRQRK7EILY37XY22652L7YAVUSP72SLMBKA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.393724993 (340h14m54.824805124s) [noise=true , address=77.90.31.19:4876 , piece_id=X6MDUCCK75ZD56BG4TPRZQS7OAXTBERGST35U7G7EIG5UXM77LDQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.431278654 (340h14m54.862358785s) [noise=true , address=104.36.82.5:4865 , piece_id=GUJE4YYEX6DV7MX4HAOJQDP46HS3ZJBLSKDKAVS4CGIRPZ4FFDSQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.431306538 (340h14m54.862386669s) [seg_pos={0 0}, upload=353958]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:41:00.431400357 (340h14m54.862480488s) [noise=true , address=104.36.82.51:4081 , piece_id=U4CE27RP4ZRXGZDJK4D2FOUFVA7SLOSUSJAEEOQQL2N5W63NMXBQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121Gj3trM89mKpTffMYkrV9PrwkPqQU2LauCiG1v3J91Mej9KWF): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431499537 (340h14m54.862579668s) [noise=true , address=77.90.31.12:4603 , piece_id=P22ARZVBEJIL223J7BINBWQY7BSYWITGJKI5I243PFDQHK34CYRA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431547257 (340h14m54.862627388s) [noise=true , address=77.90.31.11:4577 , piece_id=6ANOLCMW35P7J4YGCOUPORHALYHPGCSXJ4AW5T3RRTJJ3R5POQKA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rKdimacehmW1Tp5Zp4DJFxafLhcEeNh61cfw8Bfefr9pRG2ei): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431593586 (340h14m54.862673717s) [noise=true , address=45.91.116.12:4231 , piece_id=NVCS3ZC337QLCSHACKQDM7UBQR6GKSY3JRIBETWBCGB76YUKB35A, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431631108 (340h14m54.862711239s) [seg_pos={0 0}, upload=353958]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:41:00.431741830 (340h14m54.862821961s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:41:00.431771327 (340h14m54.862851458s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:41:00.923112146 (340h14m55.354192278s) [upload=353958]: Done uploading segments...
Aug 22 21:41:00.923131634 (340h14m55.354211755s) [upload=353958]: Upload finished. err: <nil>
Duration: 6.209752036s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [..X........XX.....X..X.X...........X........................] duration:
1.871991128s
FAIL (2025-08-22 21:44:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:27:24.505293131 (340h1m18.936373252s) [upload=353721]: Starting upload Aug 22 21:27:24.505339489 (340h1m18.93641962s) [upload=353721]: Done starting upload Aug 22 21:27:24.505385868 (340h1m18.936465989s) [upload=353721]: Uploading segments... Aug 22 21:27:24.505419953 (340h1m18.936500084s) [upload=353721]: Got next segment. Inline: true Aug 22 21:27:24.505423720 (340h1m18.936503851s) [upload=353721]: Waiting for error group managing segments... Aug 22 21:27:24.505457025 (340h1m18.936537146s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:27:24.505461413 (340h1m18.936541544s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:27:24.505463928 (340h1m18.936544059s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:27:24.720733208 (340h1m19.151813339s) [upload=353721]: Done uploading segments... Aug 22 21:27:24.720749881 (340h1m19.151830012s) [upload=353721]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.872020865s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.......X.........X........X.X.................X........X....] duration:
6.039547518s
FAIL (2025-08-22 21:44:25 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 79f172c9b8c76f0aba5a1d1dad493b5ca82189b0a953c28978db3fb7f5f479f4 != before 8695c5660617eaebe9f3d25c46dcafc9ffa9917945d42ca97bfce73ecb7c2053
======LOGS======
Aug 22 21:40:57.471627668 (340h14m51.902707799s) [upload=353958]: Starting upload
Aug 22 21:40:57.471674216 (340h14m51.902754347s) [upload=353958]: Done starting upload
Aug 22 21:40:57.471750412 (340h14m51.902830573s) [upload=353958]: Uploading segments...
Aug 22 21:40:57.471845574 (340h14m51.902925755s) [upload=353958]: Got next segment. Inline: false
Aug 22 21:40:57.471939815 (340h14m51.903019976s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:40:57.471948000 (340h14m51.903028141s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:40:58.043624244 (340h14m52.474704375s) [seg_pos={0 0}, upload=353958]: Begin upload segment...
Aug 22 21:40:58.043694919 (340h14m52.47477505s) [seg_pos={0 0}, upload=353958]: Done begin upload segment.
Aug 22 21:40:58.043720388 (340h14m52.474800519s) [noise=true , address=104.36.82.21:4505 , piece_id=SJR4LJT5WWT2X5AKERB6TUV4Z5X5HFCBDH6N3WRHUNRUUWTLOVCQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.043760294 (340h14m52.474840425s) [noise=true , address=79.127.219.48:4092 , piece_id=VDRZVEDSYMFGJES3DD4BUHIVEXT2UHDGGQDJNVLL7RSNQHU2NRZQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044229852 (340h14m52.475309983s) [noise=true , address=77.90.31.11:4577 , piece_id=6ANOLCMW35P7J4YGCOUPORHALYHPGCSXJ4AW5T3RRTJJ3R5POQKA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044250272 (340h14m52.475330403s) [noise=true , address=77.90.31.10:4543 , piece_id=TK7EHEFGS2LVB7FUZMRQRK7EILY37XY22652L7YAVUSP72SLMBKA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044539895 (340h14m52.475620026s) [noise=true , address=77.90.31.19:4876 , piece_id=X6MDUCCK75ZD56BG4TPRZQS7OAXTBERGST35U7G7EIG5UXM77LDQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044647060 (340h14m52.475727191s) [noise=true , address=104.36.82.7:4939 , piece_id=BLRDDZYCFVHPO4EBYNOZTMPW4WASKIUWBQBK2LIK5IR3T4RCJEGQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044820292 (340h14m52.475900423s) [noise=true , address=104.36.82.8:4984 , piece_id=ON2U74FBBAI3DEGSWETVGQNKRHRYPA6U2D5PW3WXJCGSIHFDWFSQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044951944 (340h14m52.476032075s) [noise=true , address=77.90.31.12:4603 , piece_id=P22ARZVBEJIL223J7BINBWQY7BSYWITGJKI5I243PFDQHK34CYRA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045101089 (340h14m52.47618122s) [noise=true , address=104.36.82.22:4519 , piece_id=CV2SBRZSJSV5B7SZFOMPTVVXIAG5QIPBSYGEDQWXTYQHIPZPVZHQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045284019 (340h14m52.47636415s) [noise=true , address=104.36.82.45:4922 , piece_id=AKF26ERPUMLP547SJFU4RTBZ47P54FO55KDAINYVE5I2ADJTBETQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045646873 (340h14m52.476727004s) [noise=true , address=104.36.82.46:4503 , piece_id=Z3O3USZR6GHLGL7W7Z5QMOTMMY4ARTEHE5FGJWSWFOUS5XYLSE2Q, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045914616 (340h14m52.476994747s) [noise=true , address=104.36.82.34:4575 , piece_id=G6FNUHAELP6FQA7HIFOF3RDY4CJHV5K3DGVAQG5MXAOCJ3QUMEVA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050135038 (340h14m52.481215169s) [noise=true , address=104.36.82.5:4865 , piece_id=GUJE4YYEX6DV7MX4HAOJQDP46HS3ZJBLSKDKAVS4CGIRPZ4FFDSQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050486409 (340h14m52.481566541s) [noise=true , address=104.36.82.51:4081 , piece_id=U4CE27RP4ZRXGZDJK4D2FOUFVA7SLOSUSJAEEOQQL2N5W63NMXBQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050776936 (340h14m52.481857067s) [noise=true , address=77.90.31.16:4754 , piece_id=D65OAODYYHYWEABO5ZYT6U5DARUPYFIHLLKKLSCYPBG5U5NORVGA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051068393 (340h14m52.482148524s) [noise=true , address=104.36.82.4:4834 , piece_id=WYY3X2XXGF6W4QPD36OBB2K6WY4GNTCZBG2WRKOWTZYGJSAROUDQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051562658 (340h14m52.48264278s) [noise=true , address=45.91.116.12:4231 , piece_id=NVCS3ZC337QLCSHACKQDM7UBQR6GKSY3JRIBETWBCGB76YUKB35A, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051902568 (340h14m52.4829827s) [noise=true , address=45.91.116.10:4086 , piece_id=VIZUCI32JRYZIFEQ4ATNYTPZ4KSJT75JMMVXGDCI5IZD4OI2X2YQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:59.565685289 (340h14m53.99676542s) [upload=353958]: Next returned nil segment
Aug 22 21:40:59.565707271 (340h14m53.996787392s) [upload=353958]: Waiting for error group managing segments...
Aug 22 21:40:59.946483725 (340h14m54.377563856s) [noise=true , address=79.127.219.48:4092 , piece_id=VDRZVEDSYMFGJES3DD4BUHIVEXT2UHDGGQDJNVLL7RSNQHU2NRZQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.060120898 (340h14m54.491201029s) [noise=true , address=104.36.82.22:4519 , piece_id=CV2SBRZSJSV5B7SZFOMPTVVXIAG5QIPBSYGEDQWXTYQHIPZPVZHQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.080700483 (340h14m54.511780614s) [noise=true , address=45.91.116.10:4086 , piece_id=VIZUCI32JRYZIFEQ4ATNYTPZ4KSJT75JMMVXGDCI5IZD4OI2X2YQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.092428286 (340h14m54.523508417s) [noise=true , address=104.36.82.8:4984 , piece_id=ON2U74FBBAI3DEGSWETVGQNKRHRYPA6U2D5PW3WXJCGSIHFDWFSQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.138566839 (340h14m54.56964698s) [noise=true , address=104.36.82.4:4834 , piece_id=WYY3X2XXGF6W4QPD36OBB2K6WY4GNTCZBG2WRKOWTZYGJSAROUDQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.139660360 (340h14m54.570740492s) [noise=true , address=77.90.31.16:4754 , piece_id=D65OAODYYHYWEABO5ZYT6U5DARUPYFIHLLKKLSCYPBG5U5NORVGA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.158444390 (340h14m54.589524521s) [noise=true , address=104.36.82.21:4505 , piece_id=SJR4LJT5WWT2X5AKERB6TUV4Z5X5HFCBDH6N3WRHUNRUUWTLOVCQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.170355914 (340h14m54.601436045s) [noise=true , address=104.36.82.45:4922 , piece_id=AKF26ERPUMLP547SJFU4RTBZ47P54FO55KDAINYVE5I2ADJTBETQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.186411595 (340h14m54.617491726s) [noise=true , address=104.36.82.7:4939 , piece_id=BLRDDZYCFVHPO4EBYNOZTMPW4WASKIUWBQBK2LIK5IR3T4RCJEGQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.199800225 (340h14m54.630880356s) [noise=true , address=104.36.82.34:4575 , piece_id=G6FNUHAELP6FQA7HIFOF3RDY4CJHV5K3DGVAQG5MXAOCJ3QUMEVA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.220242326 (340h14m54.651322457s) [noise=true , address=104.36.82.46:4503 , piece_id=Z3O3USZR6GHLGL7W7Z5QMOTMMY4ARTEHE5FGJWSWFOUS5XYLSE2Q, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.374724247 (340h14m54.805804379s) [noise=true , address=77.90.31.10:4543 , piece_id=TK7EHEFGS2LVB7FUZMRQRK7EILY37XY22652L7YAVUSP72SLMBKA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.393724993 (340h14m54.824805124s) [noise=true , address=77.90.31.19:4876 , piece_id=X6MDUCCK75ZD56BG4TPRZQS7OAXTBERGST35U7G7EIG5UXM77LDQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.431278654 (340h14m54.862358785s) [noise=true , address=104.36.82.5:4865 , piece_id=GUJE4YYEX6DV7MX4HAOJQDP46HS3ZJBLSKDKAVS4CGIRPZ4FFDSQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.431306538 (340h14m54.862386669s) [seg_pos={0 0}, upload=353958]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:41:00.431400357 (340h14m54.862480488s) [noise=true , address=104.36.82.51:4081 , piece_id=U4CE27RP4ZRXGZDJK4D2FOUFVA7SLOSUSJAEEOQQL2N5W63NMXBQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121Gj3trM89mKpTffMYkrV9PrwkPqQU2LauCiG1v3J91Mej9KWF): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431499537 (340h14m54.862579668s) [noise=true , address=77.90.31.12:4603 , piece_id=P22ARZVBEJIL223J7BINBWQY7BSYWITGJKI5I243PFDQHK34CYRA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431547257 (340h14m54.862627388s) [noise=true , address=77.90.31.11:4577 , piece_id=6ANOLCMW35P7J4YGCOUPORHALYHPGCSXJ4AW5T3RRTJJ3R5POQKA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rKdimacehmW1Tp5Zp4DJFxafLhcEeNh61cfw8Bfefr9pRG2ei): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431593586 (340h14m54.862673717s) [noise=true , address=45.91.116.12:4231 , piece_id=NVCS3ZC337QLCSHACKQDM7UBQR6GKSY3JRIBETWBCGB76YUKB35A, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431631108 (340h14m54.862711239s) [seg_pos={0 0}, upload=353958]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:41:00.431741830 (340h14m54.862821961s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:41:00.431771327 (340h14m54.862851458s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:41:00.923112146 (340h14m55.354192278s) [upload=353958]: Done uploading segments...
Aug 22 21:41:00.923131634 (340h14m55.354211755s) [upload=353958]: Upload finished. err: <nil>
Duration: 6.039570993s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [...X........XX.....X..X.X...........X.......................] duration:
1.904643182s
FAIL (2025-08-22 21:43:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:27:24.505293131 (340h1m18.936373252s) [upload=353721]: Starting upload Aug 22 21:27:24.505339489 (340h1m18.93641962s) [upload=353721]: Done starting upload Aug 22 21:27:24.505385868 (340h1m18.936465989s) [upload=353721]: Uploading segments... Aug 22 21:27:24.505419953 (340h1m18.936500084s) [upload=353721]: Got next segment. Inline: true Aug 22 21:27:24.505423720 (340h1m18.936503851s) [upload=353721]: Waiting for error group managing segments... Aug 22 21:27:24.505457025 (340h1m18.936537146s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:27:24.505461413 (340h1m18.936541544s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:27:24.505463928 (340h1m18.936544059s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:27:24.720733208 (340h1m19.151813339s) [upload=353721]: Done uploading segments... Aug 22 21:27:24.720749881 (340h1m19.151830012s) [upload=353721]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.904664443s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [....X........XX.....X..X.X...........X......................] duration:
1.977870854s
FAIL (2025-08-22 21:43:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:27:24.505293131 (340h1m18.936373252s) [upload=353721]: Starting upload Aug 22 21:27:24.505339489 (340h1m18.93641962s) [upload=353721]: Done starting upload Aug 22 21:27:24.505385868 (340h1m18.936465989s) [upload=353721]: Uploading segments... Aug 22 21:27:24.505419953 (340h1m18.936500084s) [upload=353721]: Got next segment. Inline: true Aug 22 21:27:24.505423720 (340h1m18.936503851s) [upload=353721]: Waiting for error group managing segments... Aug 22 21:27:24.505457025 (340h1m18.936537146s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:27:24.505461413 (340h1m18.936541544s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:27:24.505463928 (340h1m18.936544059s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:27:24.720733208 (340h1m19.151813339s) [upload=353721]: Done uploading segments... Aug 22 21:27:24.720749881 (340h1m19.151830012s) [upload=353721]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.977896763s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [........X.........X........X.X.................X........X...] duration:
6.110784532s
FAIL (2025-08-22 21:43:28 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 79f172c9b8c76f0aba5a1d1dad493b5ca82189b0a953c28978db3fb7f5f479f4 != before 8695c5660617eaebe9f3d25c46dcafc9ffa9917945d42ca97bfce73ecb7c2053
======LOGS======
Aug 22 21:40:57.471627668 (340h14m51.902707799s) [upload=353958]: Starting upload
Aug 22 21:40:57.471674216 (340h14m51.902754347s) [upload=353958]: Done starting upload
Aug 22 21:40:57.471750412 (340h14m51.902830573s) [upload=353958]: Uploading segments...
Aug 22 21:40:57.471845574 (340h14m51.902925755s) [upload=353958]: Got next segment. Inline: false
Aug 22 21:40:57.471939815 (340h14m51.903019976s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:40:57.471948000 (340h14m51.903028141s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:40:58.043624244 (340h14m52.474704375s) [seg_pos={0 0}, upload=353958]: Begin upload segment...
Aug 22 21:40:58.043694919 (340h14m52.47477505s) [seg_pos={0 0}, upload=353958]: Done begin upload segment.
Aug 22 21:40:58.043720388 (340h14m52.474800519s) [noise=true , address=104.36.82.21:4505 , piece_id=SJR4LJT5WWT2X5AKERB6TUV4Z5X5HFCBDH6N3WRHUNRUUWTLOVCQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.043760294 (340h14m52.474840425s) [noise=true , address=79.127.219.48:4092 , piece_id=VDRZVEDSYMFGJES3DD4BUHIVEXT2UHDGGQDJNVLL7RSNQHU2NRZQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044229852 (340h14m52.475309983s) [noise=true , address=77.90.31.11:4577 , piece_id=6ANOLCMW35P7J4YGCOUPORHALYHPGCSXJ4AW5T3RRTJJ3R5POQKA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044250272 (340h14m52.475330403s) [noise=true , address=77.90.31.10:4543 , piece_id=TK7EHEFGS2LVB7FUZMRQRK7EILY37XY22652L7YAVUSP72SLMBKA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044539895 (340h14m52.475620026s) [noise=true , address=77.90.31.19:4876 , piece_id=X6MDUCCK75ZD56BG4TPRZQS7OAXTBERGST35U7G7EIG5UXM77LDQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044647060 (340h14m52.475727191s) [noise=true , address=104.36.82.7:4939 , piece_id=BLRDDZYCFVHPO4EBYNOZTMPW4WASKIUWBQBK2LIK5IR3T4RCJEGQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044820292 (340h14m52.475900423s) [noise=true , address=104.36.82.8:4984 , piece_id=ON2U74FBBAI3DEGSWETVGQNKRHRYPA6U2D5PW3WXJCGSIHFDWFSQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044951944 (340h14m52.476032075s) [noise=true , address=77.90.31.12:4603 , piece_id=P22ARZVBEJIL223J7BINBWQY7BSYWITGJKI5I243PFDQHK34CYRA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045101089 (340h14m52.47618122s) [noise=true , address=104.36.82.22:4519 , piece_id=CV2SBRZSJSV5B7SZFOMPTVVXIAG5QIPBSYGEDQWXTYQHIPZPVZHQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045284019 (340h14m52.47636415s) [noise=true , address=104.36.82.45:4922 , piece_id=AKF26ERPUMLP547SJFU4RTBZ47P54FO55KDAINYVE5I2ADJTBETQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045646873 (340h14m52.476727004s) [noise=true , address=104.36.82.46:4503 , piece_id=Z3O3USZR6GHLGL7W7Z5QMOTMMY4ARTEHE5FGJWSWFOUS5XYLSE2Q, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045914616 (340h14m52.476994747s) [noise=true , address=104.36.82.34:4575 , piece_id=G6FNUHAELP6FQA7HIFOF3RDY4CJHV5K3DGVAQG5MXAOCJ3QUMEVA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050135038 (340h14m52.481215169s) [noise=true , address=104.36.82.5:4865 , piece_id=GUJE4YYEX6DV7MX4HAOJQDP46HS3ZJBLSKDKAVS4CGIRPZ4FFDSQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050486409 (340h14m52.481566541s) [noise=true , address=104.36.82.51:4081 , piece_id=U4CE27RP4ZRXGZDJK4D2FOUFVA7SLOSUSJAEEOQQL2N5W63NMXBQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050776936 (340h14m52.481857067s) [noise=true , address=77.90.31.16:4754 , piece_id=D65OAODYYHYWEABO5ZYT6U5DARUPYFIHLLKKLSCYPBG5U5NORVGA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051068393 (340h14m52.482148524s) [noise=true , address=104.36.82.4:4834 , piece_id=WYY3X2XXGF6W4QPD36OBB2K6WY4GNTCZBG2WRKOWTZYGJSAROUDQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051562658 (340h14m52.48264278s) [noise=true , address=45.91.116.12:4231 , piece_id=NVCS3ZC337QLCSHACKQDM7UBQR6GKSY3JRIBETWBCGB76YUKB35A, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051902568 (340h14m52.4829827s) [noise=true , address=45.91.116.10:4086 , piece_id=VIZUCI32JRYZIFEQ4ATNYTPZ4KSJT75JMMVXGDCI5IZD4OI2X2YQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:59.565685289 (340h14m53.99676542s) [upload=353958]: Next returned nil segment
Aug 22 21:40:59.565707271 (340h14m53.996787392s) [upload=353958]: Waiting for error group managing segments...
Aug 22 21:40:59.946483725 (340h14m54.377563856s) [noise=true , address=79.127.219.48:4092 , piece_id=VDRZVEDSYMFGJES3DD4BUHIVEXT2UHDGGQDJNVLL7RSNQHU2NRZQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.060120898 (340h14m54.491201029s) [noise=true , address=104.36.82.22:4519 , piece_id=CV2SBRZSJSV5B7SZFOMPTVVXIAG5QIPBSYGEDQWXTYQHIPZPVZHQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.080700483 (340h14m54.511780614s) [noise=true , address=45.91.116.10:4086 , piece_id=VIZUCI32JRYZIFEQ4ATNYTPZ4KSJT75JMMVXGDCI5IZD4OI2X2YQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.092428286 (340h14m54.523508417s) [noise=true , address=104.36.82.8:4984 , piece_id=ON2U74FBBAI3DEGSWETVGQNKRHRYPA6U2D5PW3WXJCGSIHFDWFSQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.138566839 (340h14m54.56964698s) [noise=true , address=104.36.82.4:4834 , piece_id=WYY3X2XXGF6W4QPD36OBB2K6WY4GNTCZBG2WRKOWTZYGJSAROUDQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.139660360 (340h14m54.570740492s) [noise=true , address=77.90.31.16:4754 , piece_id=D65OAODYYHYWEABO5ZYT6U5DARUPYFIHLLKKLSCYPBG5U5NORVGA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.158444390 (340h14m54.589524521s) [noise=true , address=104.36.82.21:4505 , piece_id=SJR4LJT5WWT2X5AKERB6TUV4Z5X5HFCBDH6N3WRHUNRUUWTLOVCQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.170355914 (340h14m54.601436045s) [noise=true , address=104.36.82.45:4922 , piece_id=AKF26ERPUMLP547SJFU4RTBZ47P54FO55KDAINYVE5I2ADJTBETQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.186411595 (340h14m54.617491726s) [noise=true , address=104.36.82.7:4939 , piece_id=BLRDDZYCFVHPO4EBYNOZTMPW4WASKIUWBQBK2LIK5IR3T4RCJEGQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.199800225 (340h14m54.630880356s) [noise=true , address=104.36.82.34:4575 , piece_id=G6FNUHAELP6FQA7HIFOF3RDY4CJHV5K3DGVAQG5MXAOCJ3QUMEVA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.220242326 (340h14m54.651322457s) [noise=true , address=104.36.82.46:4503 , piece_id=Z3O3USZR6GHLGL7W7Z5QMOTMMY4ARTEHE5FGJWSWFOUS5XYLSE2Q, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.374724247 (340h14m54.805804379s) [noise=true , address=77.90.31.10:4543 , piece_id=TK7EHEFGS2LVB7FUZMRQRK7EILY37XY22652L7YAVUSP72SLMBKA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.393724993 (340h14m54.824805124s) [noise=true , address=77.90.31.19:4876 , piece_id=X6MDUCCK75ZD56BG4TPRZQS7OAXTBERGST35U7G7EIG5UXM77LDQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.431278654 (340h14m54.862358785s) [noise=true , address=104.36.82.5:4865 , piece_id=GUJE4YYEX6DV7MX4HAOJQDP46HS3ZJBLSKDKAVS4CGIRPZ4FFDSQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.431306538 (340h14m54.862386669s) [seg_pos={0 0}, upload=353958]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:41:00.431400357 (340h14m54.862480488s) [noise=true , address=104.36.82.51:4081 , piece_id=U4CE27RP4ZRXGZDJK4D2FOUFVA7SLOSUSJAEEOQQL2N5W63NMXBQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121Gj3trM89mKpTffMYkrV9PrwkPqQU2LauCiG1v3J91Mej9KWF): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431499537 (340h14m54.862579668s) [noise=true , address=77.90.31.12:4603 , piece_id=P22ARZVBEJIL223J7BINBWQY7BSYWITGJKI5I243PFDQHK34CYRA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431547257 (340h14m54.862627388s) [noise=true , address=77.90.31.11:4577 , piece_id=6ANOLCMW35P7J4YGCOUPORHALYHPGCSXJ4AW5T3RRTJJ3R5POQKA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rKdimacehmW1Tp5Zp4DJFxafLhcEeNh61cfw8Bfefr9pRG2ei): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431593586 (340h14m54.862673717s) [noise=true , address=45.91.116.12:4231 , piece_id=NVCS3ZC337QLCSHACKQDM7UBQR6GKSY3JRIBETWBCGB76YUKB35A, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431631108 (340h14m54.862711239s) [seg_pos={0 0}, upload=353958]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:41:00.431741830 (340h14m54.862821961s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:41:00.431771327 (340h14m54.862851458s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:41:00.923112146 (340h14m55.354192278s) [upload=353958]: Done uploading segments...
Aug 22 21:41:00.923131634 (340h14m55.354211755s) [upload=353958]: Upload finished. err: <nil>
Duration: 6.110812064s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.....X........XX.....X..X.X...........X.....................] duration:
2.053871245s
FAIL (2025-08-22 21:42:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:27:24.505293131 (340h1m18.936373252s) [upload=353721]: Starting upload Aug 22 21:27:24.505339489 (340h1m18.93641962s) [upload=353721]: Done starting upload Aug 22 21:27:24.505385868 (340h1m18.936465989s) [upload=353721]: Uploading segments... Aug 22 21:27:24.505419953 (340h1m18.936500084s) [upload=353721]: Got next segment. Inline: true Aug 22 21:27:24.505423720 (340h1m18.936503851s) [upload=353721]: Waiting for error group managing segments... Aug 22 21:27:24.505457025 (340h1m18.936537146s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:27:24.505461413 (340h1m18.936541544s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:27:24.505463928 (340h1m18.936544059s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:27:24.720733208 (340h1m19.151813339s) [upload=353721]: Done uploading segments... Aug 22 21:27:24.720749881 (340h1m19.151830012s) [upload=353721]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.053903666s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.........X.........X........X.X.................X........X..] duration:
5.875344743s
FAIL (2025-08-22 21:42:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 79f172c9b8c76f0aba5a1d1dad493b5ca82189b0a953c28978db3fb7f5f479f4 != before 8695c5660617eaebe9f3d25c46dcafc9ffa9917945d42ca97bfce73ecb7c2053
======LOGS======
Aug 22 21:40:57.471627668 (340h14m51.902707799s) [upload=353958]: Starting upload
Aug 22 21:40:57.471674216 (340h14m51.902754347s) [upload=353958]: Done starting upload
Aug 22 21:40:57.471750412 (340h14m51.902830573s) [upload=353958]: Uploading segments...
Aug 22 21:40:57.471845574 (340h14m51.902925755s) [upload=353958]: Got next segment. Inline: false
Aug 22 21:40:57.471939815 (340h14m51.903019976s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:40:57.471948000 (340h14m51.903028141s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:40:58.043624244 (340h14m52.474704375s) [seg_pos={0 0}, upload=353958]: Begin upload segment...
Aug 22 21:40:58.043694919 (340h14m52.47477505s) [seg_pos={0 0}, upload=353958]: Done begin upload segment.
Aug 22 21:40:58.043720388 (340h14m52.474800519s) [noise=true , address=104.36.82.21:4505 , piece_id=SJR4LJT5WWT2X5AKERB6TUV4Z5X5HFCBDH6N3WRHUNRUUWTLOVCQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.043760294 (340h14m52.474840425s) [noise=true , address=79.127.219.48:4092 , piece_id=VDRZVEDSYMFGJES3DD4BUHIVEXT2UHDGGQDJNVLL7RSNQHU2NRZQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044229852 (340h14m52.475309983s) [noise=true , address=77.90.31.11:4577 , piece_id=6ANOLCMW35P7J4YGCOUPORHALYHPGCSXJ4AW5T3RRTJJ3R5POQKA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044250272 (340h14m52.475330403s) [noise=true , address=77.90.31.10:4543 , piece_id=TK7EHEFGS2LVB7FUZMRQRK7EILY37XY22652L7YAVUSP72SLMBKA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044539895 (340h14m52.475620026s) [noise=true , address=77.90.31.19:4876 , piece_id=X6MDUCCK75ZD56BG4TPRZQS7OAXTBERGST35U7G7EIG5UXM77LDQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044647060 (340h14m52.475727191s) [noise=true , address=104.36.82.7:4939 , piece_id=BLRDDZYCFVHPO4EBYNOZTMPW4WASKIUWBQBK2LIK5IR3T4RCJEGQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044820292 (340h14m52.475900423s) [noise=true , address=104.36.82.8:4984 , piece_id=ON2U74FBBAI3DEGSWETVGQNKRHRYPA6U2D5PW3WXJCGSIHFDWFSQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044951944 (340h14m52.476032075s) [noise=true , address=77.90.31.12:4603 , piece_id=P22ARZVBEJIL223J7BINBWQY7BSYWITGJKI5I243PFDQHK34CYRA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045101089 (340h14m52.47618122s) [noise=true , address=104.36.82.22:4519 , piece_id=CV2SBRZSJSV5B7SZFOMPTVVXIAG5QIPBSYGEDQWXTYQHIPZPVZHQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045284019 (340h14m52.47636415s) [noise=true , address=104.36.82.45:4922 , piece_id=AKF26ERPUMLP547SJFU4RTBZ47P54FO55KDAINYVE5I2ADJTBETQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045646873 (340h14m52.476727004s) [noise=true , address=104.36.82.46:4503 , piece_id=Z3O3USZR6GHLGL7W7Z5QMOTMMY4ARTEHE5FGJWSWFOUS5XYLSE2Q, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045914616 (340h14m52.476994747s) [noise=true , address=104.36.82.34:4575 , piece_id=G6FNUHAELP6FQA7HIFOF3RDY4CJHV5K3DGVAQG5MXAOCJ3QUMEVA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050135038 (340h14m52.481215169s) [noise=true , address=104.36.82.5:4865 , piece_id=GUJE4YYEX6DV7MX4HAOJQDP46HS3ZJBLSKDKAVS4CGIRPZ4FFDSQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050486409 (340h14m52.481566541s) [noise=true , address=104.36.82.51:4081 , piece_id=U4CE27RP4ZRXGZDJK4D2FOUFVA7SLOSUSJAEEOQQL2N5W63NMXBQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050776936 (340h14m52.481857067s) [noise=true , address=77.90.31.16:4754 , piece_id=D65OAODYYHYWEABO5ZYT6U5DARUPYFIHLLKKLSCYPBG5U5NORVGA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051068393 (340h14m52.482148524s) [noise=true , address=104.36.82.4:4834 , piece_id=WYY3X2XXGF6W4QPD36OBB2K6WY4GNTCZBG2WRKOWTZYGJSAROUDQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051562658 (340h14m52.48264278s) [noise=true , address=45.91.116.12:4231 , piece_id=NVCS3ZC337QLCSHACKQDM7UBQR6GKSY3JRIBETWBCGB76YUKB35A, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051902568 (340h14m52.4829827s) [noise=true , address=45.91.116.10:4086 , piece_id=VIZUCI32JRYZIFEQ4ATNYTPZ4KSJT75JMMVXGDCI5IZD4OI2X2YQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:59.565685289 (340h14m53.99676542s) [upload=353958]: Next returned nil segment
Aug 22 21:40:59.565707271 (340h14m53.996787392s) [upload=353958]: Waiting for error group managing segments...
Aug 22 21:40:59.946483725 (340h14m54.377563856s) [noise=true , address=79.127.219.48:4092 , piece_id=VDRZVEDSYMFGJES3DD4BUHIVEXT2UHDGGQDJNVLL7RSNQHU2NRZQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.060120898 (340h14m54.491201029s) [noise=true , address=104.36.82.22:4519 , piece_id=CV2SBRZSJSV5B7SZFOMPTVVXIAG5QIPBSYGEDQWXTYQHIPZPVZHQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.080700483 (340h14m54.511780614s) [noise=true , address=45.91.116.10:4086 , piece_id=VIZUCI32JRYZIFEQ4ATNYTPZ4KSJT75JMMVXGDCI5IZD4OI2X2YQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.092428286 (340h14m54.523508417s) [noise=true , address=104.36.82.8:4984 , piece_id=ON2U74FBBAI3DEGSWETVGQNKRHRYPA6U2D5PW3WXJCGSIHFDWFSQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.138566839 (340h14m54.56964698s) [noise=true , address=104.36.82.4:4834 , piece_id=WYY3X2XXGF6W4QPD36OBB2K6WY4GNTCZBG2WRKOWTZYGJSAROUDQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.139660360 (340h14m54.570740492s) [noise=true , address=77.90.31.16:4754 , piece_id=D65OAODYYHYWEABO5ZYT6U5DARUPYFIHLLKKLSCYPBG5U5NORVGA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.158444390 (340h14m54.589524521s) [noise=true , address=104.36.82.21:4505 , piece_id=SJR4LJT5WWT2X5AKERB6TUV4Z5X5HFCBDH6N3WRHUNRUUWTLOVCQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.170355914 (340h14m54.601436045s) [noise=true , address=104.36.82.45:4922 , piece_id=AKF26ERPUMLP547SJFU4RTBZ47P54FO55KDAINYVE5I2ADJTBETQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.186411595 (340h14m54.617491726s) [noise=true , address=104.36.82.7:4939 , piece_id=BLRDDZYCFVHPO4EBYNOZTMPW4WASKIUWBQBK2LIK5IR3T4RCJEGQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.199800225 (340h14m54.630880356s) [noise=true , address=104.36.82.34:4575 , piece_id=G6FNUHAELP6FQA7HIFOF3RDY4CJHV5K3DGVAQG5MXAOCJ3QUMEVA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.220242326 (340h14m54.651322457s) [noise=true , address=104.36.82.46:4503 , piece_id=Z3O3USZR6GHLGL7W7Z5QMOTMMY4ARTEHE5FGJWSWFOUS5XYLSE2Q, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.374724247 (340h14m54.805804379s) [noise=true , address=77.90.31.10:4543 , piece_id=TK7EHEFGS2LVB7FUZMRQRK7EILY37XY22652L7YAVUSP72SLMBKA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.393724993 (340h14m54.824805124s) [noise=true , address=77.90.31.19:4876 , piece_id=X6MDUCCK75ZD56BG4TPRZQS7OAXTBERGST35U7G7EIG5UXM77LDQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.431278654 (340h14m54.862358785s) [noise=true , address=104.36.82.5:4865 , piece_id=GUJE4YYEX6DV7MX4HAOJQDP46HS3ZJBLSKDKAVS4CGIRPZ4FFDSQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.431306538 (340h14m54.862386669s) [seg_pos={0 0}, upload=353958]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:41:00.431400357 (340h14m54.862480488s) [noise=true , address=104.36.82.51:4081 , piece_id=U4CE27RP4ZRXGZDJK4D2FOUFVA7SLOSUSJAEEOQQL2N5W63NMXBQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121Gj3trM89mKpTffMYkrV9PrwkPqQU2LauCiG1v3J91Mej9KWF): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431499537 (340h14m54.862579668s) [noise=true , address=77.90.31.12:4603 , piece_id=P22ARZVBEJIL223J7BINBWQY7BSYWITGJKI5I243PFDQHK34CYRA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431547257 (340h14m54.862627388s) [noise=true , address=77.90.31.11:4577 , piece_id=6ANOLCMW35P7J4YGCOUPORHALYHPGCSXJ4AW5T3RRTJJ3R5POQKA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rKdimacehmW1Tp5Zp4DJFxafLhcEeNh61cfw8Bfefr9pRG2ei): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431593586 (340h14m54.862673717s) [noise=true , address=45.91.116.12:4231 , piece_id=NVCS3ZC337QLCSHACKQDM7UBQR6GKSY3JRIBETWBCGB76YUKB35A, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431631108 (340h14m54.862711239s) [seg_pos={0 0}, upload=353958]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:41:00.431741830 (340h14m54.862821961s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:41:00.431771327 (340h14m54.862851458s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:41:00.923112146 (340h14m55.354192278s) [upload=353958]: Done uploading segments...
Aug 22 21:41:00.923131634 (340h14m55.354211755s) [upload=353958]: Upload finished. err: <nil>
Duration: 5.875375692s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [......X........XX.....X..X.X...........X....................] duration:
1.926802359s
FAIL (2025-08-22 21:42:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:27:24.505293131 (340h1m18.936373252s) [upload=353721]: Starting upload Aug 22 21:27:24.505339489 (340h1m18.93641962s) [upload=353721]: Done starting upload Aug 22 21:27:24.505385868 (340h1m18.936465989s) [upload=353721]: Uploading segments... Aug 22 21:27:24.505419953 (340h1m18.936500084s) [upload=353721]: Got next segment. Inline: true Aug 22 21:27:24.505423720 (340h1m18.936503851s) [upload=353721]: Waiting for error group managing segments... Aug 22 21:27:24.505457025 (340h1m18.936537146s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:27:24.505461413 (340h1m18.936541544s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:27:24.505463928 (340h1m18.936544059s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:27:24.720733208 (340h1m19.151813339s) [upload=353721]: Done uploading segments... Aug 22 21:27:24.720749881 (340h1m19.151830012s) [upload=353721]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.926825843s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.......X........XX.....X..X.X...........X...................] duration:
2.026890618s
FAIL (2025-08-22 21:41:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:27:24.505293131 (340h1m18.936373252s) [upload=353721]: Starting upload Aug 22 21:27:24.505339489 (340h1m18.93641962s) [upload=353721]: Done starting upload Aug 22 21:27:24.505385868 (340h1m18.936465989s) [upload=353721]: Uploading segments... Aug 22 21:27:24.505419953 (340h1m18.936500084s) [upload=353721]: Got next segment. Inline: true Aug 22 21:27:24.505423720 (340h1m18.936503851s) [upload=353721]: Waiting for error group managing segments... Aug 22 21:27:24.505457025 (340h1m18.936537146s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:27:24.505461413 (340h1m18.936541544s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:27:24.505463928 (340h1m18.936544059s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:27:24.720733208 (340h1m19.151813339s) [upload=353721]: Done uploading segments... Aug 22 21:27:24.720749881 (340h1m19.151830012s) [upload=353721]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.026922469s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..........X.........X........X.X.................X........X.] duration:
6.453754199s
FAIL (2025-08-22 21:41:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 79f172c9b8c76f0aba5a1d1dad493b5ca82189b0a953c28978db3fb7f5f479f4 != before 8695c5660617eaebe9f3d25c46dcafc9ffa9917945d42ca97bfce73ecb7c2053
======LOGS======
Aug 22 21:40:57.471627668 (340h14m51.902707799s) [upload=353958]: Starting upload
Aug 22 21:40:57.471674216 (340h14m51.902754347s) [upload=353958]: Done starting upload
Aug 22 21:40:57.471750412 (340h14m51.902830573s) [upload=353958]: Uploading segments...
Aug 22 21:40:57.471845574 (340h14m51.902925755s) [upload=353958]: Got next segment. Inline: false
Aug 22 21:40:57.471939815 (340h14m51.903019976s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:40:57.471948000 (340h14m51.903028141s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:40:58.043624244 (340h14m52.474704375s) [seg_pos={0 0}, upload=353958]: Begin upload segment...
Aug 22 21:40:58.043694919 (340h14m52.47477505s) [seg_pos={0 0}, upload=353958]: Done begin upload segment.
Aug 22 21:40:58.043720388 (340h14m52.474800519s) [noise=true , address=104.36.82.21:4505 , piece_id=SJR4LJT5WWT2X5AKERB6TUV4Z5X5HFCBDH6N3WRHUNRUUWTLOVCQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.043760294 (340h14m52.474840425s) [noise=true , address=79.127.219.48:4092 , piece_id=VDRZVEDSYMFGJES3DD4BUHIVEXT2UHDGGQDJNVLL7RSNQHU2NRZQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044229852 (340h14m52.475309983s) [noise=true , address=77.90.31.11:4577 , piece_id=6ANOLCMW35P7J4YGCOUPORHALYHPGCSXJ4AW5T3RRTJJ3R5POQKA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044250272 (340h14m52.475330403s) [noise=true , address=77.90.31.10:4543 , piece_id=TK7EHEFGS2LVB7FUZMRQRK7EILY37XY22652L7YAVUSP72SLMBKA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044539895 (340h14m52.475620026s) [noise=true , address=77.90.31.19:4876 , piece_id=X6MDUCCK75ZD56BG4TPRZQS7OAXTBERGST35U7G7EIG5UXM77LDQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044647060 (340h14m52.475727191s) [noise=true , address=104.36.82.7:4939 , piece_id=BLRDDZYCFVHPO4EBYNOZTMPW4WASKIUWBQBK2LIK5IR3T4RCJEGQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044820292 (340h14m52.475900423s) [noise=true , address=104.36.82.8:4984 , piece_id=ON2U74FBBAI3DEGSWETVGQNKRHRYPA6U2D5PW3WXJCGSIHFDWFSQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044951944 (340h14m52.476032075s) [noise=true , address=77.90.31.12:4603 , piece_id=P22ARZVBEJIL223J7BINBWQY7BSYWITGJKI5I243PFDQHK34CYRA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045101089 (340h14m52.47618122s) [noise=true , address=104.36.82.22:4519 , piece_id=CV2SBRZSJSV5B7SZFOMPTVVXIAG5QIPBSYGEDQWXTYQHIPZPVZHQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045284019 (340h14m52.47636415s) [noise=true , address=104.36.82.45:4922 , piece_id=AKF26ERPUMLP547SJFU4RTBZ47P54FO55KDAINYVE5I2ADJTBETQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045646873 (340h14m52.476727004s) [noise=true , address=104.36.82.46:4503 , piece_id=Z3O3USZR6GHLGL7W7Z5QMOTMMY4ARTEHE5FGJWSWFOUS5XYLSE2Q, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045914616 (340h14m52.476994747s) [noise=true , address=104.36.82.34:4575 , piece_id=G6FNUHAELP6FQA7HIFOF3RDY4CJHV5K3DGVAQG5MXAOCJ3QUMEVA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050135038 (340h14m52.481215169s) [noise=true , address=104.36.82.5:4865 , piece_id=GUJE4YYEX6DV7MX4HAOJQDP46HS3ZJBLSKDKAVS4CGIRPZ4FFDSQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050486409 (340h14m52.481566541s) [noise=true , address=104.36.82.51:4081 , piece_id=U4CE27RP4ZRXGZDJK4D2FOUFVA7SLOSUSJAEEOQQL2N5W63NMXBQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050776936 (340h14m52.481857067s) [noise=true , address=77.90.31.16:4754 , piece_id=D65OAODYYHYWEABO5ZYT6U5DARUPYFIHLLKKLSCYPBG5U5NORVGA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051068393 (340h14m52.482148524s) [noise=true , address=104.36.82.4:4834 , piece_id=WYY3X2XXGF6W4QPD36OBB2K6WY4GNTCZBG2WRKOWTZYGJSAROUDQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051562658 (340h14m52.48264278s) [noise=true , address=45.91.116.12:4231 , piece_id=NVCS3ZC337QLCSHACKQDM7UBQR6GKSY3JRIBETWBCGB76YUKB35A, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051902568 (340h14m52.4829827s) [noise=true , address=45.91.116.10:4086 , piece_id=VIZUCI32JRYZIFEQ4ATNYTPZ4KSJT75JMMVXGDCI5IZD4OI2X2YQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:59.565685289 (340h14m53.99676542s) [upload=353958]: Next returned nil segment
Aug 22 21:40:59.565707271 (340h14m53.996787392s) [upload=353958]: Waiting for error group managing segments...
Aug 22 21:40:59.946483725 (340h14m54.377563856s) [noise=true , address=79.127.219.48:4092 , piece_id=VDRZVEDSYMFGJES3DD4BUHIVEXT2UHDGGQDJNVLL7RSNQHU2NRZQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.060120898 (340h14m54.491201029s) [noise=true , address=104.36.82.22:4519 , piece_id=CV2SBRZSJSV5B7SZFOMPTVVXIAG5QIPBSYGEDQWXTYQHIPZPVZHQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.080700483 (340h14m54.511780614s) [noise=true , address=45.91.116.10:4086 , piece_id=VIZUCI32JRYZIFEQ4ATNYTPZ4KSJT75JMMVXGDCI5IZD4OI2X2YQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.092428286 (340h14m54.523508417s) [noise=true , address=104.36.82.8:4984 , piece_id=ON2U74FBBAI3DEGSWETVGQNKRHRYPA6U2D5PW3WXJCGSIHFDWFSQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.138566839 (340h14m54.56964698s) [noise=true , address=104.36.82.4:4834 , piece_id=WYY3X2XXGF6W4QPD36OBB2K6WY4GNTCZBG2WRKOWTZYGJSAROUDQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.139660360 (340h14m54.570740492s) [noise=true , address=77.90.31.16:4754 , piece_id=D65OAODYYHYWEABO5ZYT6U5DARUPYFIHLLKKLSCYPBG5U5NORVGA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.158444390 (340h14m54.589524521s) [noise=true , address=104.36.82.21:4505 , piece_id=SJR4LJT5WWT2X5AKERB6TUV4Z5X5HFCBDH6N3WRHUNRUUWTLOVCQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.170355914 (340h14m54.601436045s) [noise=true , address=104.36.82.45:4922 , piece_id=AKF26ERPUMLP547SJFU4RTBZ47P54FO55KDAINYVE5I2ADJTBETQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.186411595 (340h14m54.617491726s) [noise=true , address=104.36.82.7:4939 , piece_id=BLRDDZYCFVHPO4EBYNOZTMPW4WASKIUWBQBK2LIK5IR3T4RCJEGQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.199800225 (340h14m54.630880356s) [noise=true , address=104.36.82.34:4575 , piece_id=G6FNUHAELP6FQA7HIFOF3RDY4CJHV5K3DGVAQG5MXAOCJ3QUMEVA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.220242326 (340h14m54.651322457s) [noise=true , address=104.36.82.46:4503 , piece_id=Z3O3USZR6GHLGL7W7Z5QMOTMMY4ARTEHE5FGJWSWFOUS5XYLSE2Q, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.374724247 (340h14m54.805804379s) [noise=true , address=77.90.31.10:4543 , piece_id=TK7EHEFGS2LVB7FUZMRQRK7EILY37XY22652L7YAVUSP72SLMBKA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.393724993 (340h14m54.824805124s) [noise=true , address=77.90.31.19:4876 , piece_id=X6MDUCCK75ZD56BG4TPRZQS7OAXTBERGST35U7G7EIG5UXM77LDQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.431278654 (340h14m54.862358785s) [noise=true , address=104.36.82.5:4865 , piece_id=GUJE4YYEX6DV7MX4HAOJQDP46HS3ZJBLSKDKAVS4CGIRPZ4FFDSQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.431306538 (340h14m54.862386669s) [seg_pos={0 0}, upload=353958]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:41:00.431400357 (340h14m54.862480488s) [noise=true , address=104.36.82.51:4081 , piece_id=U4CE27RP4ZRXGZDJK4D2FOUFVA7SLOSUSJAEEOQQL2N5W63NMXBQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121Gj3trM89mKpTffMYkrV9PrwkPqQU2LauCiG1v3J91Mej9KWF): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431499537 (340h14m54.862579668s) [noise=true , address=77.90.31.12:4603 , piece_id=P22ARZVBEJIL223J7BINBWQY7BSYWITGJKI5I243PFDQHK34CYRA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431547257 (340h14m54.862627388s) [noise=true , address=77.90.31.11:4577 , piece_id=6ANOLCMW35P7J4YGCOUPORHALYHPGCSXJ4AW5T3RRTJJ3R5POQKA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rKdimacehmW1Tp5Zp4DJFxafLhcEeNh61cfw8Bfefr9pRG2ei): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431593586 (340h14m54.862673717s) [noise=true , address=45.91.116.12:4231 , piece_id=NVCS3ZC337QLCSHACKQDM7UBQR6GKSY3JRIBETWBCGB76YUKB35A, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431631108 (340h14m54.862711239s) [seg_pos={0 0}, upload=353958]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:41:00.431741830 (340h14m54.862821961s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:41:00.431771327 (340h14m54.862851458s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:41:00.923112146 (340h14m55.354192278s) [upload=353958]: Done uploading segments...
Aug 22 21:41:00.923131634 (340h14m55.354211755s) [upload=353958]: Upload finished. err: <nil>
Duration: 6.453781551s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...........X.........X........X.X.................X........X] duration:
6.46964937s
FAIL (2025-08-22 21:41:03 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 79f172c9b8c76f0aba5a1d1dad493b5ca82189b0a953c28978db3fb7f5f479f4 != before 8695c5660617eaebe9f3d25c46dcafc9ffa9917945d42ca97bfce73ecb7c2053
======LOGS======
Aug 22 21:40:57.471627668 (340h14m51.902707799s) [upload=353958]: Starting upload
Aug 22 21:40:57.471674216 (340h14m51.902754347s) [upload=353958]: Done starting upload
Aug 22 21:40:57.471750412 (340h14m51.902830573s) [upload=353958]: Uploading segments...
Aug 22 21:40:57.471845574 (340h14m51.902925755s) [upload=353958]: Got next segment. Inline: false
Aug 22 21:40:57.471939815 (340h14m51.903019976s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:40:57.471948000 (340h14m51.903028141s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:40:58.043624244 (340h14m52.474704375s) [seg_pos={0 0}, upload=353958]: Begin upload segment...
Aug 22 21:40:58.043694919 (340h14m52.47477505s) [seg_pos={0 0}, upload=353958]: Done begin upload segment.
Aug 22 21:40:58.043720388 (340h14m52.474800519s) [noise=true , address=104.36.82.21:4505 , piece_id=SJR4LJT5WWT2X5AKERB6TUV4Z5X5HFCBDH6N3WRHUNRUUWTLOVCQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.043760294 (340h14m52.474840425s) [noise=true , address=79.127.219.48:4092 , piece_id=VDRZVEDSYMFGJES3DD4BUHIVEXT2UHDGGQDJNVLL7RSNQHU2NRZQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044229852 (340h14m52.475309983s) [noise=true , address=77.90.31.11:4577 , piece_id=6ANOLCMW35P7J4YGCOUPORHALYHPGCSXJ4AW5T3RRTJJ3R5POQKA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044250272 (340h14m52.475330403s) [noise=true , address=77.90.31.10:4543 , piece_id=TK7EHEFGS2LVB7FUZMRQRK7EILY37XY22652L7YAVUSP72SLMBKA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044539895 (340h14m52.475620026s) [noise=true , address=77.90.31.19:4876 , piece_id=X6MDUCCK75ZD56BG4TPRZQS7OAXTBERGST35U7G7EIG5UXM77LDQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044647060 (340h14m52.475727191s) [noise=true , address=104.36.82.7:4939 , piece_id=BLRDDZYCFVHPO4EBYNOZTMPW4WASKIUWBQBK2LIK5IR3T4RCJEGQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044820292 (340h14m52.475900423s) [noise=true , address=104.36.82.8:4984 , piece_id=ON2U74FBBAI3DEGSWETVGQNKRHRYPA6U2D5PW3WXJCGSIHFDWFSQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.044951944 (340h14m52.476032075s) [noise=true , address=77.90.31.12:4603 , piece_id=P22ARZVBEJIL223J7BINBWQY7BSYWITGJKI5I243PFDQHK34CYRA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045101089 (340h14m52.47618122s) [noise=true , address=104.36.82.22:4519 , piece_id=CV2SBRZSJSV5B7SZFOMPTVVXIAG5QIPBSYGEDQWXTYQHIPZPVZHQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045284019 (340h14m52.47636415s) [noise=true , address=104.36.82.45:4922 , piece_id=AKF26ERPUMLP547SJFU4RTBZ47P54FO55KDAINYVE5I2ADJTBETQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045646873 (340h14m52.476727004s) [noise=true , address=104.36.82.46:4503 , piece_id=Z3O3USZR6GHLGL7W7Z5QMOTMMY4ARTEHE5FGJWSWFOUS5XYLSE2Q, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.045914616 (340h14m52.476994747s) [noise=true , address=104.36.82.34:4575 , piece_id=G6FNUHAELP6FQA7HIFOF3RDY4CJHV5K3DGVAQG5MXAOCJ3QUMEVA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050135038 (340h14m52.481215169s) [noise=true , address=104.36.82.5:4865 , piece_id=GUJE4YYEX6DV7MX4HAOJQDP46HS3ZJBLSKDKAVS4CGIRPZ4FFDSQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050486409 (340h14m52.481566541s) [noise=true , address=104.36.82.51:4081 , piece_id=U4CE27RP4ZRXGZDJK4D2FOUFVA7SLOSUSJAEEOQQL2N5W63NMXBQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.050776936 (340h14m52.481857067s) [noise=true , address=77.90.31.16:4754 , piece_id=D65OAODYYHYWEABO5ZYT6U5DARUPYFIHLLKKLSCYPBG5U5NORVGA, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051068393 (340h14m52.482148524s) [noise=true , address=104.36.82.4:4834 , piece_id=WYY3X2XXGF6W4QPD36OBB2K6WY4GNTCZBG2WRKOWTZYGJSAROUDQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051562658 (340h14m52.48264278s) [noise=true , address=45.91.116.12:4231 , piece_id=NVCS3ZC337QLCSHACKQDM7UBQR6GKSY3JRIBETWBCGB76YUKB35A, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:58.051902568 (340h14m52.4829827s) [noise=true , address=45.91.116.10:4086 , piece_id=VIZUCI32JRYZIFEQ4ATNYTPZ4KSJT75JMMVXGDCI5IZD4OI2X2YQ, seg_pos={0 0}, upload=353958]: Uploading piece...
Aug 22 21:40:59.565685289 (340h14m53.99676542s) [upload=353958]: Next returned nil segment
Aug 22 21:40:59.565707271 (340h14m53.996787392s) [upload=353958]: Waiting for error group managing segments...
Aug 22 21:40:59.946483725 (340h14m54.377563856s) [noise=true , address=79.127.219.48:4092 , piece_id=VDRZVEDSYMFGJES3DD4BUHIVEXT2UHDGGQDJNVLL7RSNQHU2NRZQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.060120898 (340h14m54.491201029s) [noise=true , address=104.36.82.22:4519 , piece_id=CV2SBRZSJSV5B7SZFOMPTVVXIAG5QIPBSYGEDQWXTYQHIPZPVZHQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.080700483 (340h14m54.511780614s) [noise=true , address=45.91.116.10:4086 , piece_id=VIZUCI32JRYZIFEQ4ATNYTPZ4KSJT75JMMVXGDCI5IZD4OI2X2YQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.092428286 (340h14m54.523508417s) [noise=true , address=104.36.82.8:4984 , piece_id=ON2U74FBBAI3DEGSWETVGQNKRHRYPA6U2D5PW3WXJCGSIHFDWFSQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.138566839 (340h14m54.56964698s) [noise=true , address=104.36.82.4:4834 , piece_id=WYY3X2XXGF6W4QPD36OBB2K6WY4GNTCZBG2WRKOWTZYGJSAROUDQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.139660360 (340h14m54.570740492s) [noise=true , address=77.90.31.16:4754 , piece_id=D65OAODYYHYWEABO5ZYT6U5DARUPYFIHLLKKLSCYPBG5U5NORVGA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.158444390 (340h14m54.589524521s) [noise=true , address=104.36.82.21:4505 , piece_id=SJR4LJT5WWT2X5AKERB6TUV4Z5X5HFCBDH6N3WRHUNRUUWTLOVCQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.170355914 (340h14m54.601436045s) [noise=true , address=104.36.82.45:4922 , piece_id=AKF26ERPUMLP547SJFU4RTBZ47P54FO55KDAINYVE5I2ADJTBETQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.186411595 (340h14m54.617491726s) [noise=true , address=104.36.82.7:4939 , piece_id=BLRDDZYCFVHPO4EBYNOZTMPW4WASKIUWBQBK2LIK5IR3T4RCJEGQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.199800225 (340h14m54.630880356s) [noise=true , address=104.36.82.34:4575 , piece_id=G6FNUHAELP6FQA7HIFOF3RDY4CJHV5K3DGVAQG5MXAOCJ3QUMEVA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.220242326 (340h14m54.651322457s) [noise=true , address=104.36.82.46:4503 , piece_id=Z3O3USZR6GHLGL7W7Z5QMOTMMY4ARTEHE5FGJWSWFOUS5XYLSE2Q, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.374724247 (340h14m54.805804379s) [noise=true , address=77.90.31.10:4543 , piece_id=TK7EHEFGS2LVB7FUZMRQRK7EILY37XY22652L7YAVUSP72SLMBKA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.393724993 (340h14m54.824805124s) [noise=true , address=77.90.31.19:4876 , piece_id=X6MDUCCK75ZD56BG4TPRZQS7OAXTBERGST35U7G7EIG5UXM77LDQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.431278654 (340h14m54.862358785s) [noise=true , address=104.36.82.5:4865 , piece_id=GUJE4YYEX6DV7MX4HAOJQDP46HS3ZJBLSKDKAVS4CGIRPZ4FFDSQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: <nil>
Aug 22 21:41:00.431306538 (340h14m54.862386669s) [seg_pos={0 0}, upload=353958]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:41:00.431400357 (340h14m54.862480488s) [noise=true , address=104.36.82.51:4081 , piece_id=U4CE27RP4ZRXGZDJK4D2FOUFVA7SLOSUSJAEEOQQL2N5W63NMXBQ, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121Gj3trM89mKpTffMYkrV9PrwkPqQU2LauCiG1v3J91Mej9KWF): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431499537 (340h14m54.862579668s) [noise=true , address=77.90.31.12:4603 , piece_id=P22ARZVBEJIL223J7BINBWQY7BSYWITGJKI5I243PFDQHK34CYRA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431547257 (340h14m54.862627388s) [noise=true , address=77.90.31.11:4577 , piece_id=6ANOLCMW35P7J4YGCOUPORHALYHPGCSXJ4AW5T3RRTJJ3R5POQKA, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rKdimacehmW1Tp5Zp4DJFxafLhcEeNh61cfw8Bfefr9pRG2ei): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431593586 (340h14m54.862673717s) [noise=true , address=45.91.116.12:4231 , piece_id=NVCS3ZC337QLCSHACKQDM7UBQR6GKSY3JRIBETWBCGB76YUKB35A, seg_pos={0 0}, upload=353958]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 22 21:41:00.431631108 (340h14m54.862711239s) [seg_pos={0 0}, upload=353958]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:41:00.431741830 (340h14m54.862821961s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:41:00.431771327 (340h14m54.862851458s) [upload=353958]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:41:00.923112146 (340h14m55.354192278s) [upload=353958]: Done uploading segments...
Aug 22 21:41:00.923131634 (340h14m55.354211755s) [upload=353958]: Upload finished. err: <nil>
Duration: 6.469676522s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [........X........XX.....X..X.X...........X..................] duration:
1.999672537s
FAIL (2025-08-22 21:40:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:27:24.505293131 (340h1m18.936373252s) [upload=353721]: Starting upload Aug 22 21:27:24.505339489 (340h1m18.93641962s) [upload=353721]: Done starting upload Aug 22 21:27:24.505385868 (340h1m18.936465989s) [upload=353721]: Uploading segments... Aug 22 21:27:24.505419953 (340h1m18.936500084s) [upload=353721]: Got next segment. Inline: true Aug 22 21:27:24.505423720 (340h1m18.936503851s) [upload=353721]: Waiting for error group managing segments... Aug 22 21:27:24.505457025 (340h1m18.936537146s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:27:24.505461413 (340h1m18.936541544s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:27:24.505463928 (340h1m18.936544059s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:27:24.720733208 (340h1m19.151813339s) [upload=353721]: Done uploading segments... Aug 22 21:27:24.720749881 (340h1m19.151830012s) [upload=353721]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.999699067s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [............X.........X........X.X.................X........] duration:
5.966163924s
FAIL (2025-08-22 21:39:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 21:36:01.641895143 (340h9m56.072975274s) [upload=353866]: Starting upload
Aug 22 21:36:01.641959005 (340h9m56.073039136s) [upload=353866]: Done starting upload
Aug 22 21:36:01.642059387 (340h9m56.073139518s) [upload=353866]: Uploading segments...
Aug 22 21:36:01.642247777 (340h9m56.073327908s) [upload=353866]: Got next segment. Inline: false
Aug 22 21:36:01.642319184 (340h9m56.073399315s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:36:01.642327119 (340h9m56.07340728s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:36:02.091844671 (340h9m56.522924822s) [seg_pos={0 0}, upload=353866]: Begin upload segment...
Aug 22 21:36:02.091970141 (340h9m56.523050272s) [seg_pos={0 0}, upload=353866]: Done begin upload segment.
Aug 22 21:36:02.091988607 (340h9m56.523068758s) [noise=true , address=104.36.82.20:4448 , piece_id=HLCUNUUI3GC4CCAFKMZH4EFM5WRW2MKT5JYUB62U6X34R5VQKKNA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.091996562 (340h9m56.523076703s) [noise=true , address=104.36.82.49:4999 , piece_id=KLTQ2PXRIR5OAI67U6V2YHWNSLFA7AKFYFGWSTUNWJXY47XAAHYA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092073599 (340h9m56.523153741s) [noise=true , address=77.90.31.10:4551 , piece_id=ZEIWOPBFIBYTWASHV7P6PQRZJE5OKLEKNIAN4G2GMO5TMHUNIFBQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092634152 (340h9m56.523714293s) [noise=true , address=104.36.82.5:4865 , piece_id=LZIDPUPKAUM44EROSDOHLV6RNMZB4FUVMLUFDNCFRXKN3HWZBEUA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092721218 (340h9m56.523801349s) [noise=true , address=45.91.116.11:4142 , piece_id=Z6VVNQYAV74ZS2TI6J5ZRR4XKIDXKXQAWOYHQBBLJSKJIFE73W2Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093126504 (340h9m56.524206645s) [noise=true , address=45.91.116.9:4265 , piece_id=U7IEOR7IIOA4JYPLOB7CIPEMXBW4OV5SKZPMKTJVGPI35TGJ7HXQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093317078 (340h9m56.524397229s) [noise=true , address=104.36.82.23:4470 , piece_id=ALN6754Z5V3OUPW2K5A5OMCDGAVMBFKIRKQVM6KGPIHSJCCLKM7Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093604860 (340h9m56.524685001s) [noise=true , address=104.36.82.9:4022 , piece_id=VNPCFDKEGAVLFWOMPB4ZD65KD5LGILCEQJL6TF2BYMULFNORSOAQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093856531 (340h9m56.524936662s) [noise=true , address=45.91.116.6:4007 , piece_id=DTDCNQG4C5Q5VRATUDSNEGMU5HHHTGSTZY543SZTUYPYUKMGSJCQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093959348 (340h9m56.525039479s) [noise=true , address=77.90.31.18:4837 , piece_id=CI4C52HE4RBTKDGQCZES3X7ZG2SLZG2MA3NZ2MWRRDYSWLXR6N6Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094295000 (340h9m56.525375141s) [noise=true , address=104.36.82.17:4343 , piece_id=ZJQYYVV5T2B3SACZAJY4ZQRNNRBZXBG7HVFKVUBTKEAHFZ37MR5Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094379742 (340h9m56.525459873s) [noise=true , address=77.90.31.11:4587 , piece_id=VNZNFGFWVAEGDIGHB3T3KD4APJP63A3XBUO3ETRTQVKP227HEQLQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094726947 (340h9m56.525807078s) [noise=true , address=45.91.116.8:4066 , piece_id=4FBA7PZINOQE6JEQE3R52KDRCI3LJE4POAGFFHNL33M6B5BL7LBA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.095589987 (340h9m56.526670129s) [noise=true , address=104.36.82.21:4500 , piece_id=UM4SUURDW7FPSASYFTRCTQCWKREFSCOHEOCEKAX2ERSNNSF24ZKA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096076018 (340h9m56.527156159s) [noise=true , address=104.36.82.8:4977 , piece_id=7PYTAJXOKPP62EVCT4YFSB5QG6EU5DTINAJDCU6CLTZGU2FFHAJA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096142294 (340h9m56.527222425s) [noise=true , address=104.36.82.11:4132 , piece_id=GUU4QW6OECM3U62KLP266J5HZVACSN2ND53A3EDY7GZJDESCKRHA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096548862 (340h9m56.527629013s) [noise=true , address=104.36.82.12:4174 , piece_id=USGTPBPAV7OQQNTQZKMQYZAISSFWYNFDSI7INORCA5UU7IOXMN5A, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.098834986 (340h9m56.529915117s) [noise=true , address=104.36.82.16:4297 , piece_id=MPKCIEL2SUYUDLQQMK2HUD3AYPFLDEI5EF7F6EDHNSKTN2775AZQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:03.616829816 (340h9m58.047909947s) [upload=353866]: Next returned nil segment
Aug 22 21:36:03.616848501 (340h9m58.047928632s) [upload=353866]: Waiting for error group managing segments...
Aug 22 21:36:04.065073249 (340h9m58.49615337s) [noise=true , address=104.36.82.17:4343 , piece_id=ZJQYYVV5T2B3SACZAJY4ZQRNNRBZXBG7HVFKVUBTKEAHFZ37MR5Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.091104127 (340h9m58.522184258s) [noise=true , address=104.36.82.20:4448 , piece_id=HLCUNUUI3GC4CCAFKMZH4EFM5WRW2MKT5JYUB62U6X34R5VQKKNA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.094482922 (340h9m58.525563053s) [noise=true , address=104.36.82.23:4470 , piece_id=ALN6754Z5V3OUPW2K5A5OMCDGAVMBFKIRKQVM6KGPIHSJCCLKM7Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.114285413 (340h9m58.545365544s) [noise=true , address=104.36.82.8:4977 , piece_id=7PYTAJXOKPP62EVCT4YFSB5QG6EU5DTINAJDCU6CLTZGU2FFHAJA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.133500259 (340h9m58.56458039s) [noise=true , address=45.91.116.8:4066 , piece_id=4FBA7PZINOQE6JEQE3R52KDRCI3LJE4POAGFFHNL33M6B5BL7LBA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.150011482 (340h9m58.581091613s) [noise=true , address=104.36.82.9:4022 , piece_id=VNPCFDKEGAVLFWOMPB4ZD65KD5LGILCEQJL6TF2BYMULFNORSOAQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.164828223 (340h9m58.595908344s) [noise=true , address=104.36.82.11:4132 , piece_id=GUU4QW6OECM3U62KLP266J5HZVACSN2ND53A3EDY7GZJDESCKRHA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.181561921 (340h9m58.612642052s) [noise=true , address=104.36.82.21:4500 , piece_id=UM4SUURDW7FPSASYFTRCTQCWKREFSCOHEOCEKAX2ERSNNSF24ZKA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.227706236 (340h9m58.658786367s) [noise=true , address=45.91.116.6:4007 , piece_id=DTDCNQG4C5Q5VRATUDSNEGMU5HHHTGSTZY543SZTUYPYUKMGSJCQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.228769060 (340h9m58.659849191s) [noise=true , address=45.91.116.11:4142 , piece_id=Z6VVNQYAV74ZS2TI6J5ZRR4XKIDXKXQAWOYHQBBLJSKJIFE73W2Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.232607284 (340h9m58.663687415s) [noise=true , address=104.36.82.16:4297 , piece_id=MPKCIEL2SUYUDLQQMK2HUD3AYPFLDEI5EF7F6EDHNSKTN2775AZQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.333024565 (340h9m58.764104696s) [noise=true , address=77.90.31.11:4587 , piece_id=VNZNFGFWVAEGDIGHB3T3KD4APJP63A3XBUO3ETRTQVKP227HEQLQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.337623985 (340h9m58.768704116s) [noise=true , address=104.36.82.12:4174 , piece_id=USGTPBPAV7OQQNTQZKMQYZAISSFWYNFDSI7INORCA5UU7IOXMN5A, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.407758242 (340h9m58.838838363s) [noise=true , address=77.90.31.10:4551 , piece_id=ZEIWOPBFIBYTWASHV7P6PQRZJE5OKLEKNIAN4G2GMO5TMHUNIFBQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.407784542 (340h9m58.838864663s) [seg_pos={0 0}, upload=353866]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:36:04.407971801 (340h9m58.839051932s) [noise=true , address=77.90.31.18:4837 , piece_id=CI4C52HE4RBTKDGQCZES3X7ZG2SLZG2MA3NZ2MWRRDYSWLXR6N6Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF
Aug 22 21:36:04.408067815 (340h9m58.839147946s) [noise=true , address=104.36.82.49:4999 , piece_id=KLTQ2PXRIR5OAI67U6V2YHWNSLFA7AKFYFGWSTUNWJXY47XAAHYA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tSiyPFy1xn1YRCLmKmPmbTm3LUmDP9nT1YRCXnsuyY6XsLKrG): protocol: expected piece hash; write tcp 188.166.225.170:38572->104.36.82.49:4999: use of closed network connection; write tcp 188.166.225.170:38572->104.36.82.49:4999: use of closed network connection; EOF
Aug 22 21:36:04.408200479 (340h9m58.8392806s) [noise=true , address=104.36.82.5:4865 , piece_id=LZIDPUPKAUM44EROSDOHLV6RNMZB4FUVMLUFDNCFRXKN3HWZBEUA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kqNGahsBw6VsV3JTALvPyGshuSFaAdRSo94cQnCXF3ak54KtL): protocol: write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection; write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection
Aug 22 21:36:04.408223141 (340h9m58.839303273s) [noise=true , address=45.91.116.9:4265 , piece_id=U7IEOR7IIOA4JYPLOB7CIPEMXBW4OV5SKZPMKTJVGPI35TGJ7HXQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xJiYuKnpkxVvRVXLmW2ZXR7KL8kQgw9SKHpgoD7uKhdfD2CyP): protocol: expected piece hash; context canceled; EOF
Aug 22 21:36:04.408231648 (340h9m58.839311769s) [seg_pos={0 0}, upload=353866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:36:04.408300079 (340h9m58.8393802s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:36:04.408303726 (340h9m58.839383857s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:36:04.908534994 (340h9m59.339615125s) [upload=353866]: Done uploading segments...
Aug 22 21:36:04.908553539 (340h9m59.33963366s) [upload=353866]: Upload finished. err: <nil>
Duration: 5.966190415s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.........X........XX.....X..X.X...........X.................] duration:
1.850437472s
FAIL (2025-08-22 21:39:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:27:24.505293131 (340h1m18.936373252s) [upload=353721]: Starting upload Aug 22 21:27:24.505339489 (340h1m18.93641962s) [upload=353721]: Done starting upload Aug 22 21:27:24.505385868 (340h1m18.936465989s) [upload=353721]: Uploading segments... Aug 22 21:27:24.505419953 (340h1m18.936500084s) [upload=353721]: Got next segment. Inline: true Aug 22 21:27:24.505423720 (340h1m18.936503851s) [upload=353721]: Waiting for error group managing segments... Aug 22 21:27:24.505457025 (340h1m18.936537146s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:27:24.505461413 (340h1m18.936541544s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:27:24.505463928 (340h1m18.936544059s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:27:24.720733208 (340h1m19.151813339s) [upload=353721]: Done uploading segments... Aug 22 21:27:24.720749881 (340h1m19.151830012s) [upload=353721]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.850460428s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.............X.........X........X.X.................X.......] duration:
5.844735058s
FAIL (2025-08-22 21:39:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 21:36:01.641895143 (340h9m56.072975274s) [upload=353866]: Starting upload
Aug 22 21:36:01.641959005 (340h9m56.073039136s) [upload=353866]: Done starting upload
Aug 22 21:36:01.642059387 (340h9m56.073139518s) [upload=353866]: Uploading segments...
Aug 22 21:36:01.642247777 (340h9m56.073327908s) [upload=353866]: Got next segment. Inline: false
Aug 22 21:36:01.642319184 (340h9m56.073399315s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:36:01.642327119 (340h9m56.07340728s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:36:02.091844671 (340h9m56.522924822s) [seg_pos={0 0}, upload=353866]: Begin upload segment...
Aug 22 21:36:02.091970141 (340h9m56.523050272s) [seg_pos={0 0}, upload=353866]: Done begin upload segment.
Aug 22 21:36:02.091988607 (340h9m56.523068758s) [noise=true , address=104.36.82.20:4448 , piece_id=HLCUNUUI3GC4CCAFKMZH4EFM5WRW2MKT5JYUB62U6X34R5VQKKNA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.091996562 (340h9m56.523076703s) [noise=true , address=104.36.82.49:4999 , piece_id=KLTQ2PXRIR5OAI67U6V2YHWNSLFA7AKFYFGWSTUNWJXY47XAAHYA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092073599 (340h9m56.523153741s) [noise=true , address=77.90.31.10:4551 , piece_id=ZEIWOPBFIBYTWASHV7P6PQRZJE5OKLEKNIAN4G2GMO5TMHUNIFBQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092634152 (340h9m56.523714293s) [noise=true , address=104.36.82.5:4865 , piece_id=LZIDPUPKAUM44EROSDOHLV6RNMZB4FUVMLUFDNCFRXKN3HWZBEUA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092721218 (340h9m56.523801349s) [noise=true , address=45.91.116.11:4142 , piece_id=Z6VVNQYAV74ZS2TI6J5ZRR4XKIDXKXQAWOYHQBBLJSKJIFE73W2Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093126504 (340h9m56.524206645s) [noise=true , address=45.91.116.9:4265 , piece_id=U7IEOR7IIOA4JYPLOB7CIPEMXBW4OV5SKZPMKTJVGPI35TGJ7HXQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093317078 (340h9m56.524397229s) [noise=true , address=104.36.82.23:4470 , piece_id=ALN6754Z5V3OUPW2K5A5OMCDGAVMBFKIRKQVM6KGPIHSJCCLKM7Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093604860 (340h9m56.524685001s) [noise=true , address=104.36.82.9:4022 , piece_id=VNPCFDKEGAVLFWOMPB4ZD65KD5LGILCEQJL6TF2BYMULFNORSOAQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093856531 (340h9m56.524936662s) [noise=true , address=45.91.116.6:4007 , piece_id=DTDCNQG4C5Q5VRATUDSNEGMU5HHHTGSTZY543SZTUYPYUKMGSJCQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093959348 (340h9m56.525039479s) [noise=true , address=77.90.31.18:4837 , piece_id=CI4C52HE4RBTKDGQCZES3X7ZG2SLZG2MA3NZ2MWRRDYSWLXR6N6Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094295000 (340h9m56.525375141s) [noise=true , address=104.36.82.17:4343 , piece_id=ZJQYYVV5T2B3SACZAJY4ZQRNNRBZXBG7HVFKVUBTKEAHFZ37MR5Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094379742 (340h9m56.525459873s) [noise=true , address=77.90.31.11:4587 , piece_id=VNZNFGFWVAEGDIGHB3T3KD4APJP63A3XBUO3ETRTQVKP227HEQLQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094726947 (340h9m56.525807078s) [noise=true , address=45.91.116.8:4066 , piece_id=4FBA7PZINOQE6JEQE3R52KDRCI3LJE4POAGFFHNL33M6B5BL7LBA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.095589987 (340h9m56.526670129s) [noise=true , address=104.36.82.21:4500 , piece_id=UM4SUURDW7FPSASYFTRCTQCWKREFSCOHEOCEKAX2ERSNNSF24ZKA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096076018 (340h9m56.527156159s) [noise=true , address=104.36.82.8:4977 , piece_id=7PYTAJXOKPP62EVCT4YFSB5QG6EU5DTINAJDCU6CLTZGU2FFHAJA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096142294 (340h9m56.527222425s) [noise=true , address=104.36.82.11:4132 , piece_id=GUU4QW6OECM3U62KLP266J5HZVACSN2ND53A3EDY7GZJDESCKRHA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096548862 (340h9m56.527629013s) [noise=true , address=104.36.82.12:4174 , piece_id=USGTPBPAV7OQQNTQZKMQYZAISSFWYNFDSI7INORCA5UU7IOXMN5A, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.098834986 (340h9m56.529915117s) [noise=true , address=104.36.82.16:4297 , piece_id=MPKCIEL2SUYUDLQQMK2HUD3AYPFLDEI5EF7F6EDHNSKTN2775AZQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:03.616829816 (340h9m58.047909947s) [upload=353866]: Next returned nil segment
Aug 22 21:36:03.616848501 (340h9m58.047928632s) [upload=353866]: Waiting for error group managing segments...
Aug 22 21:36:04.065073249 (340h9m58.49615337s) [noise=true , address=104.36.82.17:4343 , piece_id=ZJQYYVV5T2B3SACZAJY4ZQRNNRBZXBG7HVFKVUBTKEAHFZ37MR5Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.091104127 (340h9m58.522184258s) [noise=true , address=104.36.82.20:4448 , piece_id=HLCUNUUI3GC4CCAFKMZH4EFM5WRW2MKT5JYUB62U6X34R5VQKKNA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.094482922 (340h9m58.525563053s) [noise=true , address=104.36.82.23:4470 , piece_id=ALN6754Z5V3OUPW2K5A5OMCDGAVMBFKIRKQVM6KGPIHSJCCLKM7Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.114285413 (340h9m58.545365544s) [noise=true , address=104.36.82.8:4977 , piece_id=7PYTAJXOKPP62EVCT4YFSB5QG6EU5DTINAJDCU6CLTZGU2FFHAJA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.133500259 (340h9m58.56458039s) [noise=true , address=45.91.116.8:4066 , piece_id=4FBA7PZINOQE6JEQE3R52KDRCI3LJE4POAGFFHNL33M6B5BL7LBA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.150011482 (340h9m58.581091613s) [noise=true , address=104.36.82.9:4022 , piece_id=VNPCFDKEGAVLFWOMPB4ZD65KD5LGILCEQJL6TF2BYMULFNORSOAQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.164828223 (340h9m58.595908344s) [noise=true , address=104.36.82.11:4132 , piece_id=GUU4QW6OECM3U62KLP266J5HZVACSN2ND53A3EDY7GZJDESCKRHA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.181561921 (340h9m58.612642052s) [noise=true , address=104.36.82.21:4500 , piece_id=UM4SUURDW7FPSASYFTRCTQCWKREFSCOHEOCEKAX2ERSNNSF24ZKA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.227706236 (340h9m58.658786367s) [noise=true , address=45.91.116.6:4007 , piece_id=DTDCNQG4C5Q5VRATUDSNEGMU5HHHTGSTZY543SZTUYPYUKMGSJCQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.228769060 (340h9m58.659849191s) [noise=true , address=45.91.116.11:4142 , piece_id=Z6VVNQYAV74ZS2TI6J5ZRR4XKIDXKXQAWOYHQBBLJSKJIFE73W2Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.232607284 (340h9m58.663687415s) [noise=true , address=104.36.82.16:4297 , piece_id=MPKCIEL2SUYUDLQQMK2HUD3AYPFLDEI5EF7F6EDHNSKTN2775AZQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.333024565 (340h9m58.764104696s) [noise=true , address=77.90.31.11:4587 , piece_id=VNZNFGFWVAEGDIGHB3T3KD4APJP63A3XBUO3ETRTQVKP227HEQLQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.337623985 (340h9m58.768704116s) [noise=true , address=104.36.82.12:4174 , piece_id=USGTPBPAV7OQQNTQZKMQYZAISSFWYNFDSI7INORCA5UU7IOXMN5A, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.407758242 (340h9m58.838838363s) [noise=true , address=77.90.31.10:4551 , piece_id=ZEIWOPBFIBYTWASHV7P6PQRZJE5OKLEKNIAN4G2GMO5TMHUNIFBQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.407784542 (340h9m58.838864663s) [seg_pos={0 0}, upload=353866]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:36:04.407971801 (340h9m58.839051932s) [noise=true , address=77.90.31.18:4837 , piece_id=CI4C52HE4RBTKDGQCZES3X7ZG2SLZG2MA3NZ2MWRRDYSWLXR6N6Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF
Aug 22 21:36:04.408067815 (340h9m58.839147946s) [noise=true , address=104.36.82.49:4999 , piece_id=KLTQ2PXRIR5OAI67U6V2YHWNSLFA7AKFYFGWSTUNWJXY47XAAHYA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tSiyPFy1xn1YRCLmKmPmbTm3LUmDP9nT1YRCXnsuyY6XsLKrG): protocol: expected piece hash; write tcp 188.166.225.170:38572->104.36.82.49:4999: use of closed network connection; write tcp 188.166.225.170:38572->104.36.82.49:4999: use of closed network connection; EOF
Aug 22 21:36:04.408200479 (340h9m58.8392806s) [noise=true , address=104.36.82.5:4865 , piece_id=LZIDPUPKAUM44EROSDOHLV6RNMZB4FUVMLUFDNCFRXKN3HWZBEUA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kqNGahsBw6VsV3JTALvPyGshuSFaAdRSo94cQnCXF3ak54KtL): protocol: write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection; write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection
Aug 22 21:36:04.408223141 (340h9m58.839303273s) [noise=true , address=45.91.116.9:4265 , piece_id=U7IEOR7IIOA4JYPLOB7CIPEMXBW4OV5SKZPMKTJVGPI35TGJ7HXQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xJiYuKnpkxVvRVXLmW2ZXR7KL8kQgw9SKHpgoD7uKhdfD2CyP): protocol: expected piece hash; context canceled; EOF
Aug 22 21:36:04.408231648 (340h9m58.839311769s) [seg_pos={0 0}, upload=353866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:36:04.408300079 (340h9m58.8393802s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:36:04.408303726 (340h9m58.839383857s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:36:04.908534994 (340h9m59.339615125s) [upload=353866]: Done uploading segments...
Aug 22 21:36:04.908553539 (340h9m59.33963366s) [upload=353866]: Upload finished. err: <nil>
Duration: 5.844759875s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..............X.........X........X.X.................X......] duration:
6.384334807s
FAIL (2025-08-22 21:39:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 21:36:01.641895143 (340h9m56.072975274s) [upload=353866]: Starting upload
Aug 22 21:36:01.641959005 (340h9m56.073039136s) [upload=353866]: Done starting upload
Aug 22 21:36:01.642059387 (340h9m56.073139518s) [upload=353866]: Uploading segments...
Aug 22 21:36:01.642247777 (340h9m56.073327908s) [upload=353866]: Got next segment. Inline: false
Aug 22 21:36:01.642319184 (340h9m56.073399315s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:36:01.642327119 (340h9m56.07340728s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:36:02.091844671 (340h9m56.522924822s) [seg_pos={0 0}, upload=353866]: Begin upload segment...
Aug 22 21:36:02.091970141 (340h9m56.523050272s) [seg_pos={0 0}, upload=353866]: Done begin upload segment.
Aug 22 21:36:02.091988607 (340h9m56.523068758s) [noise=true , address=104.36.82.20:4448 , piece_id=HLCUNUUI3GC4CCAFKMZH4EFM5WRW2MKT5JYUB62U6X34R5VQKKNA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.091996562 (340h9m56.523076703s) [noise=true , address=104.36.82.49:4999 , piece_id=KLTQ2PXRIR5OAI67U6V2YHWNSLFA7AKFYFGWSTUNWJXY47XAAHYA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092073599 (340h9m56.523153741s) [noise=true , address=77.90.31.10:4551 , piece_id=ZEIWOPBFIBYTWASHV7P6PQRZJE5OKLEKNIAN4G2GMO5TMHUNIFBQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092634152 (340h9m56.523714293s) [noise=true , address=104.36.82.5:4865 , piece_id=LZIDPUPKAUM44EROSDOHLV6RNMZB4FUVMLUFDNCFRXKN3HWZBEUA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092721218 (340h9m56.523801349s) [noise=true , address=45.91.116.11:4142 , piece_id=Z6VVNQYAV74ZS2TI6J5ZRR4XKIDXKXQAWOYHQBBLJSKJIFE73W2Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093126504 (340h9m56.524206645s) [noise=true , address=45.91.116.9:4265 , piece_id=U7IEOR7IIOA4JYPLOB7CIPEMXBW4OV5SKZPMKTJVGPI35TGJ7HXQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093317078 (340h9m56.524397229s) [noise=true , address=104.36.82.23:4470 , piece_id=ALN6754Z5V3OUPW2K5A5OMCDGAVMBFKIRKQVM6KGPIHSJCCLKM7Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093604860 (340h9m56.524685001s) [noise=true , address=104.36.82.9:4022 , piece_id=VNPCFDKEGAVLFWOMPB4ZD65KD5LGILCEQJL6TF2BYMULFNORSOAQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093856531 (340h9m56.524936662s) [noise=true , address=45.91.116.6:4007 , piece_id=DTDCNQG4C5Q5VRATUDSNEGMU5HHHTGSTZY543SZTUYPYUKMGSJCQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093959348 (340h9m56.525039479s) [noise=true , address=77.90.31.18:4837 , piece_id=CI4C52HE4RBTKDGQCZES3X7ZG2SLZG2MA3NZ2MWRRDYSWLXR6N6Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094295000 (340h9m56.525375141s) [noise=true , address=104.36.82.17:4343 , piece_id=ZJQYYVV5T2B3SACZAJY4ZQRNNRBZXBG7HVFKVUBTKEAHFZ37MR5Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094379742 (340h9m56.525459873s) [noise=true , address=77.90.31.11:4587 , piece_id=VNZNFGFWVAEGDIGHB3T3KD4APJP63A3XBUO3ETRTQVKP227HEQLQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094726947 (340h9m56.525807078s) [noise=true , address=45.91.116.8:4066 , piece_id=4FBA7PZINOQE6JEQE3R52KDRCI3LJE4POAGFFHNL33M6B5BL7LBA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.095589987 (340h9m56.526670129s) [noise=true , address=104.36.82.21:4500 , piece_id=UM4SUURDW7FPSASYFTRCTQCWKREFSCOHEOCEKAX2ERSNNSF24ZKA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096076018 (340h9m56.527156159s) [noise=true , address=104.36.82.8:4977 , piece_id=7PYTAJXOKPP62EVCT4YFSB5QG6EU5DTINAJDCU6CLTZGU2FFHAJA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096142294 (340h9m56.527222425s) [noise=true , address=104.36.82.11:4132 , piece_id=GUU4QW6OECM3U62KLP266J5HZVACSN2ND53A3EDY7GZJDESCKRHA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096548862 (340h9m56.527629013s) [noise=true , address=104.36.82.12:4174 , piece_id=USGTPBPAV7OQQNTQZKMQYZAISSFWYNFDSI7INORCA5UU7IOXMN5A, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.098834986 (340h9m56.529915117s) [noise=true , address=104.36.82.16:4297 , piece_id=MPKCIEL2SUYUDLQQMK2HUD3AYPFLDEI5EF7F6EDHNSKTN2775AZQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:03.616829816 (340h9m58.047909947s) [upload=353866]: Next returned nil segment
Aug 22 21:36:03.616848501 (340h9m58.047928632s) [upload=353866]: Waiting for error group managing segments...
Aug 22 21:36:04.065073249 (340h9m58.49615337s) [noise=true , address=104.36.82.17:4343 , piece_id=ZJQYYVV5T2B3SACZAJY4ZQRNNRBZXBG7HVFKVUBTKEAHFZ37MR5Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.091104127 (340h9m58.522184258s) [noise=true , address=104.36.82.20:4448 , piece_id=HLCUNUUI3GC4CCAFKMZH4EFM5WRW2MKT5JYUB62U6X34R5VQKKNA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.094482922 (340h9m58.525563053s) [noise=true , address=104.36.82.23:4470 , piece_id=ALN6754Z5V3OUPW2K5A5OMCDGAVMBFKIRKQVM6KGPIHSJCCLKM7Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.114285413 (340h9m58.545365544s) [noise=true , address=104.36.82.8:4977 , piece_id=7PYTAJXOKPP62EVCT4YFSB5QG6EU5DTINAJDCU6CLTZGU2FFHAJA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.133500259 (340h9m58.56458039s) [noise=true , address=45.91.116.8:4066 , piece_id=4FBA7PZINOQE6JEQE3R52KDRCI3LJE4POAGFFHNL33M6B5BL7LBA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.150011482 (340h9m58.581091613s) [noise=true , address=104.36.82.9:4022 , piece_id=VNPCFDKEGAVLFWOMPB4ZD65KD5LGILCEQJL6TF2BYMULFNORSOAQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.164828223 (340h9m58.595908344s) [noise=true , address=104.36.82.11:4132 , piece_id=GUU4QW6OECM3U62KLP266J5HZVACSN2ND53A3EDY7GZJDESCKRHA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.181561921 (340h9m58.612642052s) [noise=true , address=104.36.82.21:4500 , piece_id=UM4SUURDW7FPSASYFTRCTQCWKREFSCOHEOCEKAX2ERSNNSF24ZKA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.227706236 (340h9m58.658786367s) [noise=true , address=45.91.116.6:4007 , piece_id=DTDCNQG4C5Q5VRATUDSNEGMU5HHHTGSTZY543SZTUYPYUKMGSJCQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.228769060 (340h9m58.659849191s) [noise=true , address=45.91.116.11:4142 , piece_id=Z6VVNQYAV74ZS2TI6J5ZRR4XKIDXKXQAWOYHQBBLJSKJIFE73W2Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.232607284 (340h9m58.663687415s) [noise=true , address=104.36.82.16:4297 , piece_id=MPKCIEL2SUYUDLQQMK2HUD3AYPFLDEI5EF7F6EDHNSKTN2775AZQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.333024565 (340h9m58.764104696s) [noise=true , address=77.90.31.11:4587 , piece_id=VNZNFGFWVAEGDIGHB3T3KD4APJP63A3XBUO3ETRTQVKP227HEQLQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.337623985 (340h9m58.768704116s) [noise=true , address=104.36.82.12:4174 , piece_id=USGTPBPAV7OQQNTQZKMQYZAISSFWYNFDSI7INORCA5UU7IOXMN5A, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.407758242 (340h9m58.838838363s) [noise=true , address=77.90.31.10:4551 , piece_id=ZEIWOPBFIBYTWASHV7P6PQRZJE5OKLEKNIAN4G2GMO5TMHUNIFBQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.407784542 (340h9m58.838864663s) [seg_pos={0 0}, upload=353866]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:36:04.407971801 (340h9m58.839051932s) [noise=true , address=77.90.31.18:4837 , piece_id=CI4C52HE4RBTKDGQCZES3X7ZG2SLZG2MA3NZ2MWRRDYSWLXR6N6Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF
Aug 22 21:36:04.408067815 (340h9m58.839147946s) [noise=true , address=104.36.82.49:4999 , piece_id=KLTQ2PXRIR5OAI67U6V2YHWNSLFA7AKFYFGWSTUNWJXY47XAAHYA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tSiyPFy1xn1YRCLmKmPmbTm3LUmDP9nT1YRCXnsuyY6XsLKrG): protocol: expected piece hash; write tcp 188.166.225.170:38572->104.36.82.49:4999: use of closed network connection; write tcp 188.166.225.170:38572->104.36.82.49:4999: use of closed network connection; EOF
Aug 22 21:36:04.408200479 (340h9m58.8392806s) [noise=true , address=104.36.82.5:4865 , piece_id=LZIDPUPKAUM44EROSDOHLV6RNMZB4FUVMLUFDNCFRXKN3HWZBEUA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kqNGahsBw6VsV3JTALvPyGshuSFaAdRSo94cQnCXF3ak54KtL): protocol: write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection; write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection
Aug 22 21:36:04.408223141 (340h9m58.839303273s) [noise=true , address=45.91.116.9:4265 , piece_id=U7IEOR7IIOA4JYPLOB7CIPEMXBW4OV5SKZPMKTJVGPI35TGJ7HXQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xJiYuKnpkxVvRVXLmW2ZXR7KL8kQgw9SKHpgoD7uKhdfD2CyP): protocol: expected piece hash; context canceled; EOF
Aug 22 21:36:04.408231648 (340h9m58.839311769s) [seg_pos={0 0}, upload=353866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:36:04.408300079 (340h9m58.8393802s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:36:04.408303726 (340h9m58.839383857s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:36:04.908534994 (340h9m59.339615125s) [upload=353866]: Done uploading segments...
Aug 22 21:36:04.908553539 (340h9m59.33963366s) [upload=353866]: Upload finished. err: <nil>
Duration: 6.384368811s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [..........X........XX.....X..X.X...........X................] duration:
1.974087019s
FAIL (2025-08-22 21:39:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:27:24.505293131 (340h1m18.936373252s) [upload=353721]: Starting upload Aug 22 21:27:24.505339489 (340h1m18.93641962s) [upload=353721]: Done starting upload Aug 22 21:27:24.505385868 (340h1m18.936465989s) [upload=353721]: Uploading segments... Aug 22 21:27:24.505419953 (340h1m18.936500084s) [upload=353721]: Got next segment. Inline: true Aug 22 21:27:24.505423720 (340h1m18.936503851s) [upload=353721]: Waiting for error group managing segments... Aug 22 21:27:24.505457025 (340h1m18.936537146s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:27:24.505461413 (340h1m18.936541544s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:27:24.505463928 (340h1m18.936544059s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:27:24.720733208 (340h1m19.151813339s) [upload=353721]: Done uploading segments... Aug 22 21:27:24.720749881 (340h1m19.151830012s) [upload=353721]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.974114812s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [...........X........XX.....X..X.X...........X...............] duration:
1.978907593s
FAIL (2025-08-22 21:38:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:27:24.505293131 (340h1m18.936373252s) [upload=353721]: Starting upload Aug 22 21:27:24.505339489 (340h1m18.93641962s) [upload=353721]: Done starting upload Aug 22 21:27:24.505385868 (340h1m18.936465989s) [upload=353721]: Uploading segments... Aug 22 21:27:24.505419953 (340h1m18.936500084s) [upload=353721]: Got next segment. Inline: true Aug 22 21:27:24.505423720 (340h1m18.936503851s) [upload=353721]: Waiting for error group managing segments... Aug 22 21:27:24.505457025 (340h1m18.936537146s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:27:24.505461413 (340h1m18.936541544s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:27:24.505463928 (340h1m18.936544059s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:27:24.720733208 (340h1m19.151813339s) [upload=353721]: Done uploading segments... Aug 22 21:27:24.720749881 (340h1m19.151830012s) [upload=353721]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.978935958s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...............X.........X........X.X.................X.....] duration:
5.986587604s
FAIL (2025-08-22 21:38:33 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 21:36:01.641895143 (340h9m56.072975274s) [upload=353866]: Starting upload
Aug 22 21:36:01.641959005 (340h9m56.073039136s) [upload=353866]: Done starting upload
Aug 22 21:36:01.642059387 (340h9m56.073139518s) [upload=353866]: Uploading segments...
Aug 22 21:36:01.642247777 (340h9m56.073327908s) [upload=353866]: Got next segment. Inline: false
Aug 22 21:36:01.642319184 (340h9m56.073399315s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:36:01.642327119 (340h9m56.07340728s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:36:02.091844671 (340h9m56.522924822s) [seg_pos={0 0}, upload=353866]: Begin upload segment...
Aug 22 21:36:02.091970141 (340h9m56.523050272s) [seg_pos={0 0}, upload=353866]: Done begin upload segment.
Aug 22 21:36:02.091988607 (340h9m56.523068758s) [noise=true , address=104.36.82.20:4448 , piece_id=HLCUNUUI3GC4CCAFKMZH4EFM5WRW2MKT5JYUB62U6X34R5VQKKNA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.091996562 (340h9m56.523076703s) [noise=true , address=104.36.82.49:4999 , piece_id=KLTQ2PXRIR5OAI67U6V2YHWNSLFA7AKFYFGWSTUNWJXY47XAAHYA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092073599 (340h9m56.523153741s) [noise=true , address=77.90.31.10:4551 , piece_id=ZEIWOPBFIBYTWASHV7P6PQRZJE5OKLEKNIAN4G2GMO5TMHUNIFBQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092634152 (340h9m56.523714293s) [noise=true , address=104.36.82.5:4865 , piece_id=LZIDPUPKAUM44EROSDOHLV6RNMZB4FUVMLUFDNCFRXKN3HWZBEUA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092721218 (340h9m56.523801349s) [noise=true , address=45.91.116.11:4142 , piece_id=Z6VVNQYAV74ZS2TI6J5ZRR4XKIDXKXQAWOYHQBBLJSKJIFE73W2Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093126504 (340h9m56.524206645s) [noise=true , address=45.91.116.9:4265 , piece_id=U7IEOR7IIOA4JYPLOB7CIPEMXBW4OV5SKZPMKTJVGPI35TGJ7HXQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093317078 (340h9m56.524397229s) [noise=true , address=104.36.82.23:4470 , piece_id=ALN6754Z5V3OUPW2K5A5OMCDGAVMBFKIRKQVM6KGPIHSJCCLKM7Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093604860 (340h9m56.524685001s) [noise=true , address=104.36.82.9:4022 , piece_id=VNPCFDKEGAVLFWOMPB4ZD65KD5LGILCEQJL6TF2BYMULFNORSOAQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093856531 (340h9m56.524936662s) [noise=true , address=45.91.116.6:4007 , piece_id=DTDCNQG4C5Q5VRATUDSNEGMU5HHHTGSTZY543SZTUYPYUKMGSJCQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093959348 (340h9m56.525039479s) [noise=true , address=77.90.31.18:4837 , piece_id=CI4C52HE4RBTKDGQCZES3X7ZG2SLZG2MA3NZ2MWRRDYSWLXR6N6Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094295000 (340h9m56.525375141s) [noise=true , address=104.36.82.17:4343 , piece_id=ZJQYYVV5T2B3SACZAJY4ZQRNNRBZXBG7HVFKVUBTKEAHFZ37MR5Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094379742 (340h9m56.525459873s) [noise=true , address=77.90.31.11:4587 , piece_id=VNZNFGFWVAEGDIGHB3T3KD4APJP63A3XBUO3ETRTQVKP227HEQLQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094726947 (340h9m56.525807078s) [noise=true , address=45.91.116.8:4066 , piece_id=4FBA7PZINOQE6JEQE3R52KDRCI3LJE4POAGFFHNL33M6B5BL7LBA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.095589987 (340h9m56.526670129s) [noise=true , address=104.36.82.21:4500 , piece_id=UM4SUURDW7FPSASYFTRCTQCWKREFSCOHEOCEKAX2ERSNNSF24ZKA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096076018 (340h9m56.527156159s) [noise=true , address=104.36.82.8:4977 , piece_id=7PYTAJXOKPP62EVCT4YFSB5QG6EU5DTINAJDCU6CLTZGU2FFHAJA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096142294 (340h9m56.527222425s) [noise=true , address=104.36.82.11:4132 , piece_id=GUU4QW6OECM3U62KLP266J5HZVACSN2ND53A3EDY7GZJDESCKRHA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096548862 (340h9m56.527629013s) [noise=true , address=104.36.82.12:4174 , piece_id=USGTPBPAV7OQQNTQZKMQYZAISSFWYNFDSI7INORCA5UU7IOXMN5A, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.098834986 (340h9m56.529915117s) [noise=true , address=104.36.82.16:4297 , piece_id=MPKCIEL2SUYUDLQQMK2HUD3AYPFLDEI5EF7F6EDHNSKTN2775AZQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:03.616829816 (340h9m58.047909947s) [upload=353866]: Next returned nil segment
Aug 22 21:36:03.616848501 (340h9m58.047928632s) [upload=353866]: Waiting for error group managing segments...
Aug 22 21:36:04.065073249 (340h9m58.49615337s) [noise=true , address=104.36.82.17:4343 , piece_id=ZJQYYVV5T2B3SACZAJY4ZQRNNRBZXBG7HVFKVUBTKEAHFZ37MR5Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.091104127 (340h9m58.522184258s) [noise=true , address=104.36.82.20:4448 , piece_id=HLCUNUUI3GC4CCAFKMZH4EFM5WRW2MKT5JYUB62U6X34R5VQKKNA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.094482922 (340h9m58.525563053s) [noise=true , address=104.36.82.23:4470 , piece_id=ALN6754Z5V3OUPW2K5A5OMCDGAVMBFKIRKQVM6KGPIHSJCCLKM7Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.114285413 (340h9m58.545365544s) [noise=true , address=104.36.82.8:4977 , piece_id=7PYTAJXOKPP62EVCT4YFSB5QG6EU5DTINAJDCU6CLTZGU2FFHAJA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.133500259 (340h9m58.56458039s) [noise=true , address=45.91.116.8:4066 , piece_id=4FBA7PZINOQE6JEQE3R52KDRCI3LJE4POAGFFHNL33M6B5BL7LBA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.150011482 (340h9m58.581091613s) [noise=true , address=104.36.82.9:4022 , piece_id=VNPCFDKEGAVLFWOMPB4ZD65KD5LGILCEQJL6TF2BYMULFNORSOAQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.164828223 (340h9m58.595908344s) [noise=true , address=104.36.82.11:4132 , piece_id=GUU4QW6OECM3U62KLP266J5HZVACSN2ND53A3EDY7GZJDESCKRHA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.181561921 (340h9m58.612642052s) [noise=true , address=104.36.82.21:4500 , piece_id=UM4SUURDW7FPSASYFTRCTQCWKREFSCOHEOCEKAX2ERSNNSF24ZKA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.227706236 (340h9m58.658786367s) [noise=true , address=45.91.116.6:4007 , piece_id=DTDCNQG4C5Q5VRATUDSNEGMU5HHHTGSTZY543SZTUYPYUKMGSJCQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.228769060 (340h9m58.659849191s) [noise=true , address=45.91.116.11:4142 , piece_id=Z6VVNQYAV74ZS2TI6J5ZRR4XKIDXKXQAWOYHQBBLJSKJIFE73W2Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.232607284 (340h9m58.663687415s) [noise=true , address=104.36.82.16:4297 , piece_id=MPKCIEL2SUYUDLQQMK2HUD3AYPFLDEI5EF7F6EDHNSKTN2775AZQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.333024565 (340h9m58.764104696s) [noise=true , address=77.90.31.11:4587 , piece_id=VNZNFGFWVAEGDIGHB3T3KD4APJP63A3XBUO3ETRTQVKP227HEQLQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.337623985 (340h9m58.768704116s) [noise=true , address=104.36.82.12:4174 , piece_id=USGTPBPAV7OQQNTQZKMQYZAISSFWYNFDSI7INORCA5UU7IOXMN5A, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.407758242 (340h9m58.838838363s) [noise=true , address=77.90.31.10:4551 , piece_id=ZEIWOPBFIBYTWASHV7P6PQRZJE5OKLEKNIAN4G2GMO5TMHUNIFBQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.407784542 (340h9m58.838864663s) [seg_pos={0 0}, upload=353866]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:36:04.407971801 (340h9m58.839051932s) [noise=true , address=77.90.31.18:4837 , piece_id=CI4C52HE4RBTKDGQCZES3X7ZG2SLZG2MA3NZ2MWRRDYSWLXR6N6Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF
Aug 22 21:36:04.408067815 (340h9m58.839147946s) [noise=true , address=104.36.82.49:4999 , piece_id=KLTQ2PXRIR5OAI67U6V2YHWNSLFA7AKFYFGWSTUNWJXY47XAAHYA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tSiyPFy1xn1YRCLmKmPmbTm3LUmDP9nT1YRCXnsuyY6XsLKrG): protocol: expected piece hash; write tcp 188.166.225.170:38572->104.36.82.49:4999: use of closed network connection; write tcp 188.166.225.170:38572->104.36.82.49:4999: use of closed network connection; EOF
Aug 22 21:36:04.408200479 (340h9m58.8392806s) [noise=true , address=104.36.82.5:4865 , piece_id=LZIDPUPKAUM44EROSDOHLV6RNMZB4FUVMLUFDNCFRXKN3HWZBEUA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kqNGahsBw6VsV3JTALvPyGshuSFaAdRSo94cQnCXF3ak54KtL): protocol: write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection; write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection
Aug 22 21:36:04.408223141 (340h9m58.839303273s) [noise=true , address=45.91.116.9:4265 , piece_id=U7IEOR7IIOA4JYPLOB7CIPEMXBW4OV5SKZPMKTJVGPI35TGJ7HXQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xJiYuKnpkxVvRVXLmW2ZXR7KL8kQgw9SKHpgoD7uKhdfD2CyP): protocol: expected piece hash; context canceled; EOF
Aug 22 21:36:04.408231648 (340h9m58.839311769s) [seg_pos={0 0}, upload=353866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:36:04.408300079 (340h9m58.8393802s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:36:04.408303726 (340h9m58.839383857s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:36:04.908534994 (340h9m59.339615125s) [upload=353866]: Done uploading segments...
Aug 22 21:36:04.908553539 (340h9m59.33963366s) [upload=353866]: Upload finished. err: <nil>
Duration: 5.986605859s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [................X.........X........X.X.................X....] duration:
5.780320032s
FAIL (2025-08-22 21:38:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 21:36:01.641895143 (340h9m56.072975274s) [upload=353866]: Starting upload
Aug 22 21:36:01.641959005 (340h9m56.073039136s) [upload=353866]: Done starting upload
Aug 22 21:36:01.642059387 (340h9m56.073139518s) [upload=353866]: Uploading segments...
Aug 22 21:36:01.642247777 (340h9m56.073327908s) [upload=353866]: Got next segment. Inline: false
Aug 22 21:36:01.642319184 (340h9m56.073399315s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:36:01.642327119 (340h9m56.07340728s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:36:02.091844671 (340h9m56.522924822s) [seg_pos={0 0}, upload=353866]: Begin upload segment...
Aug 22 21:36:02.091970141 (340h9m56.523050272s) [seg_pos={0 0}, upload=353866]: Done begin upload segment.
Aug 22 21:36:02.091988607 (340h9m56.523068758s) [noise=true , address=104.36.82.20:4448 , piece_id=HLCUNUUI3GC4CCAFKMZH4EFM5WRW2MKT5JYUB62U6X34R5VQKKNA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.091996562 (340h9m56.523076703s) [noise=true , address=104.36.82.49:4999 , piece_id=KLTQ2PXRIR5OAI67U6V2YHWNSLFA7AKFYFGWSTUNWJXY47XAAHYA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092073599 (340h9m56.523153741s) [noise=true , address=77.90.31.10:4551 , piece_id=ZEIWOPBFIBYTWASHV7P6PQRZJE5OKLEKNIAN4G2GMO5TMHUNIFBQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092634152 (340h9m56.523714293s) [noise=true , address=104.36.82.5:4865 , piece_id=LZIDPUPKAUM44EROSDOHLV6RNMZB4FUVMLUFDNCFRXKN3HWZBEUA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092721218 (340h9m56.523801349s) [noise=true , address=45.91.116.11:4142 , piece_id=Z6VVNQYAV74ZS2TI6J5ZRR4XKIDXKXQAWOYHQBBLJSKJIFE73W2Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093126504 (340h9m56.524206645s) [noise=true , address=45.91.116.9:4265 , piece_id=U7IEOR7IIOA4JYPLOB7CIPEMXBW4OV5SKZPMKTJVGPI35TGJ7HXQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093317078 (340h9m56.524397229s) [noise=true , address=104.36.82.23:4470 , piece_id=ALN6754Z5V3OUPW2K5A5OMCDGAVMBFKIRKQVM6KGPIHSJCCLKM7Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093604860 (340h9m56.524685001s) [noise=true , address=104.36.82.9:4022 , piece_id=VNPCFDKEGAVLFWOMPB4ZD65KD5LGILCEQJL6TF2BYMULFNORSOAQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093856531 (340h9m56.524936662s) [noise=true , address=45.91.116.6:4007 , piece_id=DTDCNQG4C5Q5VRATUDSNEGMU5HHHTGSTZY543SZTUYPYUKMGSJCQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093959348 (340h9m56.525039479s) [noise=true , address=77.90.31.18:4837 , piece_id=CI4C52HE4RBTKDGQCZES3X7ZG2SLZG2MA3NZ2MWRRDYSWLXR6N6Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094295000 (340h9m56.525375141s) [noise=true , address=104.36.82.17:4343 , piece_id=ZJQYYVV5T2B3SACZAJY4ZQRNNRBZXBG7HVFKVUBTKEAHFZ37MR5Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094379742 (340h9m56.525459873s) [noise=true , address=77.90.31.11:4587 , piece_id=VNZNFGFWVAEGDIGHB3T3KD4APJP63A3XBUO3ETRTQVKP227HEQLQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094726947 (340h9m56.525807078s) [noise=true , address=45.91.116.8:4066 , piece_id=4FBA7PZINOQE6JEQE3R52KDRCI3LJE4POAGFFHNL33M6B5BL7LBA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.095589987 (340h9m56.526670129s) [noise=true , address=104.36.82.21:4500 , piece_id=UM4SUURDW7FPSASYFTRCTQCWKREFSCOHEOCEKAX2ERSNNSF24ZKA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096076018 (340h9m56.527156159s) [noise=true , address=104.36.82.8:4977 , piece_id=7PYTAJXOKPP62EVCT4YFSB5QG6EU5DTINAJDCU6CLTZGU2FFHAJA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096142294 (340h9m56.527222425s) [noise=true , address=104.36.82.11:4132 , piece_id=GUU4QW6OECM3U62KLP266J5HZVACSN2ND53A3EDY7GZJDESCKRHA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096548862 (340h9m56.527629013s) [noise=true , address=104.36.82.12:4174 , piece_id=USGTPBPAV7OQQNTQZKMQYZAISSFWYNFDSI7INORCA5UU7IOXMN5A, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.098834986 (340h9m56.529915117s) [noise=true , address=104.36.82.16:4297 , piece_id=MPKCIEL2SUYUDLQQMK2HUD3AYPFLDEI5EF7F6EDHNSKTN2775AZQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:03.616829816 (340h9m58.047909947s) [upload=353866]: Next returned nil segment
Aug 22 21:36:03.616848501 (340h9m58.047928632s) [upload=353866]: Waiting for error group managing segments...
Aug 22 21:36:04.065073249 (340h9m58.49615337s) [noise=true , address=104.36.82.17:4343 , piece_id=ZJQYYVV5T2B3SACZAJY4ZQRNNRBZXBG7HVFKVUBTKEAHFZ37MR5Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.091104127 (340h9m58.522184258s) [noise=true , address=104.36.82.20:4448 , piece_id=HLCUNUUI3GC4CCAFKMZH4EFM5WRW2MKT5JYUB62U6X34R5VQKKNA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.094482922 (340h9m58.525563053s) [noise=true , address=104.36.82.23:4470 , piece_id=ALN6754Z5V3OUPW2K5A5OMCDGAVMBFKIRKQVM6KGPIHSJCCLKM7Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.114285413 (340h9m58.545365544s) [noise=true , address=104.36.82.8:4977 , piece_id=7PYTAJXOKPP62EVCT4YFSB5QG6EU5DTINAJDCU6CLTZGU2FFHAJA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.133500259 (340h9m58.56458039s) [noise=true , address=45.91.116.8:4066 , piece_id=4FBA7PZINOQE6JEQE3R52KDRCI3LJE4POAGFFHNL33M6B5BL7LBA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.150011482 (340h9m58.581091613s) [noise=true , address=104.36.82.9:4022 , piece_id=VNPCFDKEGAVLFWOMPB4ZD65KD5LGILCEQJL6TF2BYMULFNORSOAQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.164828223 (340h9m58.595908344s) [noise=true , address=104.36.82.11:4132 , piece_id=GUU4QW6OECM3U62KLP266J5HZVACSN2ND53A3EDY7GZJDESCKRHA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.181561921 (340h9m58.612642052s) [noise=true , address=104.36.82.21:4500 , piece_id=UM4SUURDW7FPSASYFTRCTQCWKREFSCOHEOCEKAX2ERSNNSF24ZKA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.227706236 (340h9m58.658786367s) [noise=true , address=45.91.116.6:4007 , piece_id=DTDCNQG4C5Q5VRATUDSNEGMU5HHHTGSTZY543SZTUYPYUKMGSJCQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.228769060 (340h9m58.659849191s) [noise=true , address=45.91.116.11:4142 , piece_id=Z6VVNQYAV74ZS2TI6J5ZRR4XKIDXKXQAWOYHQBBLJSKJIFE73W2Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.232607284 (340h9m58.663687415s) [noise=true , address=104.36.82.16:4297 , piece_id=MPKCIEL2SUYUDLQQMK2HUD3AYPFLDEI5EF7F6EDHNSKTN2775AZQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.333024565 (340h9m58.764104696s) [noise=true , address=77.90.31.11:4587 , piece_id=VNZNFGFWVAEGDIGHB3T3KD4APJP63A3XBUO3ETRTQVKP227HEQLQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.337623985 (340h9m58.768704116s) [noise=true , address=104.36.82.12:4174 , piece_id=USGTPBPAV7OQQNTQZKMQYZAISSFWYNFDSI7INORCA5UU7IOXMN5A, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.407758242 (340h9m58.838838363s) [noise=true , address=77.90.31.10:4551 , piece_id=ZEIWOPBFIBYTWASHV7P6PQRZJE5OKLEKNIAN4G2GMO5TMHUNIFBQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.407784542 (340h9m58.838864663s) [seg_pos={0 0}, upload=353866]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:36:04.407971801 (340h9m58.839051932s) [noise=true , address=77.90.31.18:4837 , piece_id=CI4C52HE4RBTKDGQCZES3X7ZG2SLZG2MA3NZ2MWRRDYSWLXR6N6Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF
Aug 22 21:36:04.408067815 (340h9m58.839147946s) [noise=true , address=104.36.82.49:4999 , piece_id=KLTQ2PXRIR5OAI67U6V2YHWNSLFA7AKFYFGWSTUNWJXY47XAAHYA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tSiyPFy1xn1YRCLmKmPmbTm3LUmDP9nT1YRCXnsuyY6XsLKrG): protocol: expected piece hash; write tcp 188.166.225.170:38572->104.36.82.49:4999: use of closed network connection; write tcp 188.166.225.170:38572->104.36.82.49:4999: use of closed network connection; EOF
Aug 22 21:36:04.408200479 (340h9m58.8392806s) [noise=true , address=104.36.82.5:4865 , piece_id=LZIDPUPKAUM44EROSDOHLV6RNMZB4FUVMLUFDNCFRXKN3HWZBEUA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kqNGahsBw6VsV3JTALvPyGshuSFaAdRSo94cQnCXF3ak54KtL): protocol: write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection; write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection
Aug 22 21:36:04.408223141 (340h9m58.839303273s) [noise=true , address=45.91.116.9:4265 , piece_id=U7IEOR7IIOA4JYPLOB7CIPEMXBW4OV5SKZPMKTJVGPI35TGJ7HXQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xJiYuKnpkxVvRVXLmW2ZXR7KL8kQgw9SKHpgoD7uKhdfD2CyP): protocol: expected piece hash; context canceled; EOF
Aug 22 21:36:04.408231648 (340h9m58.839311769s) [seg_pos={0 0}, upload=353866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:36:04.408300079 (340h9m58.8393802s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:36:04.408303726 (340h9m58.839383857s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:36:04.908534994 (340h9m59.339615125s) [upload=353866]: Done uploading segments...
Aug 22 21:36:04.908553539 (340h9m59.33963366s) [upload=353866]: Upload finished. err: <nil>
Duration: 5.780354208s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [............X........XX.....X..X.X...........X..............] duration:
2.069812322s
FAIL (2025-08-22 21:38:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:27:24.505293131 (340h1m18.936373252s) [upload=353721]: Starting upload Aug 22 21:27:24.505339489 (340h1m18.93641962s) [upload=353721]: Done starting upload Aug 22 21:27:24.505385868 (340h1m18.936465989s) [upload=353721]: Uploading segments... Aug 22 21:27:24.505419953 (340h1m18.936500084s) [upload=353721]: Got next segment. Inline: true Aug 22 21:27:24.505423720 (340h1m18.936503851s) [upload=353721]: Waiting for error group managing segments... Aug 22 21:27:24.505457025 (340h1m18.936537146s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:27:24.505461413 (340h1m18.936541544s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:27:24.505463928 (340h1m18.936544059s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:27:24.720733208 (340h1m19.151813339s) [upload=353721]: Done uploading segments... Aug 22 21:27:24.720749881 (340h1m19.151830012s) [upload=353721]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.069840656s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.................X.........X........X.X.................X...] duration:
6.341878268s
FAIL (2025-08-22 21:37:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 21:36:01.641895143 (340h9m56.072975274s) [upload=353866]: Starting upload
Aug 22 21:36:01.641959005 (340h9m56.073039136s) [upload=353866]: Done starting upload
Aug 22 21:36:01.642059387 (340h9m56.073139518s) [upload=353866]: Uploading segments...
Aug 22 21:36:01.642247777 (340h9m56.073327908s) [upload=353866]: Got next segment. Inline: false
Aug 22 21:36:01.642319184 (340h9m56.073399315s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:36:01.642327119 (340h9m56.07340728s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:36:02.091844671 (340h9m56.522924822s) [seg_pos={0 0}, upload=353866]: Begin upload segment...
Aug 22 21:36:02.091970141 (340h9m56.523050272s) [seg_pos={0 0}, upload=353866]: Done begin upload segment.
Aug 22 21:36:02.091988607 (340h9m56.523068758s) [noise=true , address=104.36.82.20:4448 , piece_id=HLCUNUUI3GC4CCAFKMZH4EFM5WRW2MKT5JYUB62U6X34R5VQKKNA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.091996562 (340h9m56.523076703s) [noise=true , address=104.36.82.49:4999 , piece_id=KLTQ2PXRIR5OAI67U6V2YHWNSLFA7AKFYFGWSTUNWJXY47XAAHYA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092073599 (340h9m56.523153741s) [noise=true , address=77.90.31.10:4551 , piece_id=ZEIWOPBFIBYTWASHV7P6PQRZJE5OKLEKNIAN4G2GMO5TMHUNIFBQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092634152 (340h9m56.523714293s) [noise=true , address=104.36.82.5:4865 , piece_id=LZIDPUPKAUM44EROSDOHLV6RNMZB4FUVMLUFDNCFRXKN3HWZBEUA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092721218 (340h9m56.523801349s) [noise=true , address=45.91.116.11:4142 , piece_id=Z6VVNQYAV74ZS2TI6J5ZRR4XKIDXKXQAWOYHQBBLJSKJIFE73W2Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093126504 (340h9m56.524206645s) [noise=true , address=45.91.116.9:4265 , piece_id=U7IEOR7IIOA4JYPLOB7CIPEMXBW4OV5SKZPMKTJVGPI35TGJ7HXQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093317078 (340h9m56.524397229s) [noise=true , address=104.36.82.23:4470 , piece_id=ALN6754Z5V3OUPW2K5A5OMCDGAVMBFKIRKQVM6KGPIHSJCCLKM7Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093604860 (340h9m56.524685001s) [noise=true , address=104.36.82.9:4022 , piece_id=VNPCFDKEGAVLFWOMPB4ZD65KD5LGILCEQJL6TF2BYMULFNORSOAQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093856531 (340h9m56.524936662s) [noise=true , address=45.91.116.6:4007 , piece_id=DTDCNQG4C5Q5VRATUDSNEGMU5HHHTGSTZY543SZTUYPYUKMGSJCQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093959348 (340h9m56.525039479s) [noise=true , address=77.90.31.18:4837 , piece_id=CI4C52HE4RBTKDGQCZES3X7ZG2SLZG2MA3NZ2MWRRDYSWLXR6N6Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094295000 (340h9m56.525375141s) [noise=true , address=104.36.82.17:4343 , piece_id=ZJQYYVV5T2B3SACZAJY4ZQRNNRBZXBG7HVFKVUBTKEAHFZ37MR5Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094379742 (340h9m56.525459873s) [noise=true , address=77.90.31.11:4587 , piece_id=VNZNFGFWVAEGDIGHB3T3KD4APJP63A3XBUO3ETRTQVKP227HEQLQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094726947 (340h9m56.525807078s) [noise=true , address=45.91.116.8:4066 , piece_id=4FBA7PZINOQE6JEQE3R52KDRCI3LJE4POAGFFHNL33M6B5BL7LBA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.095589987 (340h9m56.526670129s) [noise=true , address=104.36.82.21:4500 , piece_id=UM4SUURDW7FPSASYFTRCTQCWKREFSCOHEOCEKAX2ERSNNSF24ZKA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096076018 (340h9m56.527156159s) [noise=true , address=104.36.82.8:4977 , piece_id=7PYTAJXOKPP62EVCT4YFSB5QG6EU5DTINAJDCU6CLTZGU2FFHAJA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096142294 (340h9m56.527222425s) [noise=true , address=104.36.82.11:4132 , piece_id=GUU4QW6OECM3U62KLP266J5HZVACSN2ND53A3EDY7GZJDESCKRHA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096548862 (340h9m56.527629013s) [noise=true , address=104.36.82.12:4174 , piece_id=USGTPBPAV7OQQNTQZKMQYZAISSFWYNFDSI7INORCA5UU7IOXMN5A, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.098834986 (340h9m56.529915117s) [noise=true , address=104.36.82.16:4297 , piece_id=MPKCIEL2SUYUDLQQMK2HUD3AYPFLDEI5EF7F6EDHNSKTN2775AZQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:03.616829816 (340h9m58.047909947s) [upload=353866]: Next returned nil segment
Aug 22 21:36:03.616848501 (340h9m58.047928632s) [upload=353866]: Waiting for error group managing segments...
Aug 22 21:36:04.065073249 (340h9m58.49615337s) [noise=true , address=104.36.82.17:4343 , piece_id=ZJQYYVV5T2B3SACZAJY4ZQRNNRBZXBG7HVFKVUBTKEAHFZ37MR5Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.091104127 (340h9m58.522184258s) [noise=true , address=104.36.82.20:4448 , piece_id=HLCUNUUI3GC4CCAFKMZH4EFM5WRW2MKT5JYUB62U6X34R5VQKKNA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.094482922 (340h9m58.525563053s) [noise=true , address=104.36.82.23:4470 , piece_id=ALN6754Z5V3OUPW2K5A5OMCDGAVMBFKIRKQVM6KGPIHSJCCLKM7Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.114285413 (340h9m58.545365544s) [noise=true , address=104.36.82.8:4977 , piece_id=7PYTAJXOKPP62EVCT4YFSB5QG6EU5DTINAJDCU6CLTZGU2FFHAJA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.133500259 (340h9m58.56458039s) [noise=true , address=45.91.116.8:4066 , piece_id=4FBA7PZINOQE6JEQE3R52KDRCI3LJE4POAGFFHNL33M6B5BL7LBA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.150011482 (340h9m58.581091613s) [noise=true , address=104.36.82.9:4022 , piece_id=VNPCFDKEGAVLFWOMPB4ZD65KD5LGILCEQJL6TF2BYMULFNORSOAQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.164828223 (340h9m58.595908344s) [noise=true , address=104.36.82.11:4132 , piece_id=GUU4QW6OECM3U62KLP266J5HZVACSN2ND53A3EDY7GZJDESCKRHA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.181561921 (340h9m58.612642052s) [noise=true , address=104.36.82.21:4500 , piece_id=UM4SUURDW7FPSASYFTRCTQCWKREFSCOHEOCEKAX2ERSNNSF24ZKA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.227706236 (340h9m58.658786367s) [noise=true , address=45.91.116.6:4007 , piece_id=DTDCNQG4C5Q5VRATUDSNEGMU5HHHTGSTZY543SZTUYPYUKMGSJCQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.228769060 (340h9m58.659849191s) [noise=true , address=45.91.116.11:4142 , piece_id=Z6VVNQYAV74ZS2TI6J5ZRR4XKIDXKXQAWOYHQBBLJSKJIFE73W2Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.232607284 (340h9m58.663687415s) [noise=true , address=104.36.82.16:4297 , piece_id=MPKCIEL2SUYUDLQQMK2HUD3AYPFLDEI5EF7F6EDHNSKTN2775AZQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.333024565 (340h9m58.764104696s) [noise=true , address=77.90.31.11:4587 , piece_id=VNZNFGFWVAEGDIGHB3T3KD4APJP63A3XBUO3ETRTQVKP227HEQLQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.337623985 (340h9m58.768704116s) [noise=true , address=104.36.82.12:4174 , piece_id=USGTPBPAV7OQQNTQZKMQYZAISSFWYNFDSI7INORCA5UU7IOXMN5A, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.407758242 (340h9m58.838838363s) [noise=true , address=77.90.31.10:4551 , piece_id=ZEIWOPBFIBYTWASHV7P6PQRZJE5OKLEKNIAN4G2GMO5TMHUNIFBQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.407784542 (340h9m58.838864663s) [seg_pos={0 0}, upload=353866]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:36:04.407971801 (340h9m58.839051932s) [noise=true , address=77.90.31.18:4837 , piece_id=CI4C52HE4RBTKDGQCZES3X7ZG2SLZG2MA3NZ2MWRRDYSWLXR6N6Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF
Aug 22 21:36:04.408067815 (340h9m58.839147946s) [noise=true , address=104.36.82.49:4999 , piece_id=KLTQ2PXRIR5OAI67U6V2YHWNSLFA7AKFYFGWSTUNWJXY47XAAHYA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tSiyPFy1xn1YRCLmKmPmbTm3LUmDP9nT1YRCXnsuyY6XsLKrG): protocol: expected piece hash; write tcp 188.166.225.170:38572->104.36.82.49:4999: use of closed network connection; write tcp 188.166.225.170:38572->104.36.82.49:4999: use of closed network connection; EOF
Aug 22 21:36:04.408200479 (340h9m58.8392806s) [noise=true , address=104.36.82.5:4865 , piece_id=LZIDPUPKAUM44EROSDOHLV6RNMZB4FUVMLUFDNCFRXKN3HWZBEUA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kqNGahsBw6VsV3JTALvPyGshuSFaAdRSo94cQnCXF3ak54KtL): protocol: write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection; write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection
Aug 22 21:36:04.408223141 (340h9m58.839303273s) [noise=true , address=45.91.116.9:4265 , piece_id=U7IEOR7IIOA4JYPLOB7CIPEMXBW4OV5SKZPMKTJVGPI35TGJ7HXQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xJiYuKnpkxVvRVXLmW2ZXR7KL8kQgw9SKHpgoD7uKhdfD2CyP): protocol: expected piece hash; context canceled; EOF
Aug 22 21:36:04.408231648 (340h9m58.839311769s) [seg_pos={0 0}, upload=353866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:36:04.408300079 (340h9m58.8393802s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:36:04.408303726 (340h9m58.839383857s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:36:04.908534994 (340h9m59.339615125s) [upload=353866]: Done uploading segments...
Aug 22 21:36:04.908553539 (340h9m59.33963366s) [upload=353866]: Upload finished. err: <nil>
Duration: 6.34190073s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.............X........XX.....X..X.X...........X.............] duration:
1.992215367s
FAIL (2025-08-22 21:37:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:27:24.505293131 (340h1m18.936373252s) [upload=353721]: Starting upload Aug 22 21:27:24.505339489 (340h1m18.93641962s) [upload=353721]: Done starting upload Aug 22 21:27:24.505385868 (340h1m18.936465989s) [upload=353721]: Uploading segments... Aug 22 21:27:24.505419953 (340h1m18.936500084s) [upload=353721]: Got next segment. Inline: true Aug 22 21:27:24.505423720 (340h1m18.936503851s) [upload=353721]: Waiting for error group managing segments... Aug 22 21:27:24.505457025 (340h1m18.936537146s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:27:24.505461413 (340h1m18.936541544s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:27:24.505463928 (340h1m18.936544059s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:27:24.720733208 (340h1m19.151813339s) [upload=353721]: Done uploading segments... Aug 22 21:27:24.720749881 (340h1m19.151830012s) [upload=353721]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.992287574s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..................X.........X........X.X.................X..] duration:
6.253370753s
FAIL (2025-08-22 21:37:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 21:36:01.641895143 (340h9m56.072975274s) [upload=353866]: Starting upload
Aug 22 21:36:01.641959005 (340h9m56.073039136s) [upload=353866]: Done starting upload
Aug 22 21:36:01.642059387 (340h9m56.073139518s) [upload=353866]: Uploading segments...
Aug 22 21:36:01.642247777 (340h9m56.073327908s) [upload=353866]: Got next segment. Inline: false
Aug 22 21:36:01.642319184 (340h9m56.073399315s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:36:01.642327119 (340h9m56.07340728s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:36:02.091844671 (340h9m56.522924822s) [seg_pos={0 0}, upload=353866]: Begin upload segment...
Aug 22 21:36:02.091970141 (340h9m56.523050272s) [seg_pos={0 0}, upload=353866]: Done begin upload segment.
Aug 22 21:36:02.091988607 (340h9m56.523068758s) [noise=true , address=104.36.82.20:4448 , piece_id=HLCUNUUI3GC4CCAFKMZH4EFM5WRW2MKT5JYUB62U6X34R5VQKKNA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.091996562 (340h9m56.523076703s) [noise=true , address=104.36.82.49:4999 , piece_id=KLTQ2PXRIR5OAI67U6V2YHWNSLFA7AKFYFGWSTUNWJXY47XAAHYA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092073599 (340h9m56.523153741s) [noise=true , address=77.90.31.10:4551 , piece_id=ZEIWOPBFIBYTWASHV7P6PQRZJE5OKLEKNIAN4G2GMO5TMHUNIFBQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092634152 (340h9m56.523714293s) [noise=true , address=104.36.82.5:4865 , piece_id=LZIDPUPKAUM44EROSDOHLV6RNMZB4FUVMLUFDNCFRXKN3HWZBEUA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092721218 (340h9m56.523801349s) [noise=true , address=45.91.116.11:4142 , piece_id=Z6VVNQYAV74ZS2TI6J5ZRR4XKIDXKXQAWOYHQBBLJSKJIFE73W2Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093126504 (340h9m56.524206645s) [noise=true , address=45.91.116.9:4265 , piece_id=U7IEOR7IIOA4JYPLOB7CIPEMXBW4OV5SKZPMKTJVGPI35TGJ7HXQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093317078 (340h9m56.524397229s) [noise=true , address=104.36.82.23:4470 , piece_id=ALN6754Z5V3OUPW2K5A5OMCDGAVMBFKIRKQVM6KGPIHSJCCLKM7Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093604860 (340h9m56.524685001s) [noise=true , address=104.36.82.9:4022 , piece_id=VNPCFDKEGAVLFWOMPB4ZD65KD5LGILCEQJL6TF2BYMULFNORSOAQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093856531 (340h9m56.524936662s) [noise=true , address=45.91.116.6:4007 , piece_id=DTDCNQG4C5Q5VRATUDSNEGMU5HHHTGSTZY543SZTUYPYUKMGSJCQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093959348 (340h9m56.525039479s) [noise=true , address=77.90.31.18:4837 , piece_id=CI4C52HE4RBTKDGQCZES3X7ZG2SLZG2MA3NZ2MWRRDYSWLXR6N6Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094295000 (340h9m56.525375141s) [noise=true , address=104.36.82.17:4343 , piece_id=ZJQYYVV5T2B3SACZAJY4ZQRNNRBZXBG7HVFKVUBTKEAHFZ37MR5Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094379742 (340h9m56.525459873s) [noise=true , address=77.90.31.11:4587 , piece_id=VNZNFGFWVAEGDIGHB3T3KD4APJP63A3XBUO3ETRTQVKP227HEQLQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094726947 (340h9m56.525807078s) [noise=true , address=45.91.116.8:4066 , piece_id=4FBA7PZINOQE6JEQE3R52KDRCI3LJE4POAGFFHNL33M6B5BL7LBA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.095589987 (340h9m56.526670129s) [noise=true , address=104.36.82.21:4500 , piece_id=UM4SUURDW7FPSASYFTRCTQCWKREFSCOHEOCEKAX2ERSNNSF24ZKA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096076018 (340h9m56.527156159s) [noise=true , address=104.36.82.8:4977 , piece_id=7PYTAJXOKPP62EVCT4YFSB5QG6EU5DTINAJDCU6CLTZGU2FFHAJA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096142294 (340h9m56.527222425s) [noise=true , address=104.36.82.11:4132 , piece_id=GUU4QW6OECM3U62KLP266J5HZVACSN2ND53A3EDY7GZJDESCKRHA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096548862 (340h9m56.527629013s) [noise=true , address=104.36.82.12:4174 , piece_id=USGTPBPAV7OQQNTQZKMQYZAISSFWYNFDSI7INORCA5UU7IOXMN5A, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.098834986 (340h9m56.529915117s) [noise=true , address=104.36.82.16:4297 , piece_id=MPKCIEL2SUYUDLQQMK2HUD3AYPFLDEI5EF7F6EDHNSKTN2775AZQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:03.616829816 (340h9m58.047909947s) [upload=353866]: Next returned nil segment
Aug 22 21:36:03.616848501 (340h9m58.047928632s) [upload=353866]: Waiting for error group managing segments...
Aug 22 21:36:04.065073249 (340h9m58.49615337s) [noise=true , address=104.36.82.17:4343 , piece_id=ZJQYYVV5T2B3SACZAJY4ZQRNNRBZXBG7HVFKVUBTKEAHFZ37MR5Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.091104127 (340h9m58.522184258s) [noise=true , address=104.36.82.20:4448 , piece_id=HLCUNUUI3GC4CCAFKMZH4EFM5WRW2MKT5JYUB62U6X34R5VQKKNA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.094482922 (340h9m58.525563053s) [noise=true , address=104.36.82.23:4470 , piece_id=ALN6754Z5V3OUPW2K5A5OMCDGAVMBFKIRKQVM6KGPIHSJCCLKM7Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.114285413 (340h9m58.545365544s) [noise=true , address=104.36.82.8:4977 , piece_id=7PYTAJXOKPP62EVCT4YFSB5QG6EU5DTINAJDCU6CLTZGU2FFHAJA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.133500259 (340h9m58.56458039s) [noise=true , address=45.91.116.8:4066 , piece_id=4FBA7PZINOQE6JEQE3R52KDRCI3LJE4POAGFFHNL33M6B5BL7LBA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.150011482 (340h9m58.581091613s) [noise=true , address=104.36.82.9:4022 , piece_id=VNPCFDKEGAVLFWOMPB4ZD65KD5LGILCEQJL6TF2BYMULFNORSOAQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.164828223 (340h9m58.595908344s) [noise=true , address=104.36.82.11:4132 , piece_id=GUU4QW6OECM3U62KLP266J5HZVACSN2ND53A3EDY7GZJDESCKRHA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.181561921 (340h9m58.612642052s) [noise=true , address=104.36.82.21:4500 , piece_id=UM4SUURDW7FPSASYFTRCTQCWKREFSCOHEOCEKAX2ERSNNSF24ZKA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.227706236 (340h9m58.658786367s) [noise=true , address=45.91.116.6:4007 , piece_id=DTDCNQG4C5Q5VRATUDSNEGMU5HHHTGSTZY543SZTUYPYUKMGSJCQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.228769060 (340h9m58.659849191s) [noise=true , address=45.91.116.11:4142 , piece_id=Z6VVNQYAV74ZS2TI6J5ZRR4XKIDXKXQAWOYHQBBLJSKJIFE73W2Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.232607284 (340h9m58.663687415s) [noise=true , address=104.36.82.16:4297 , piece_id=MPKCIEL2SUYUDLQQMK2HUD3AYPFLDEI5EF7F6EDHNSKTN2775AZQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.333024565 (340h9m58.764104696s) [noise=true , address=77.90.31.11:4587 , piece_id=VNZNFGFWVAEGDIGHB3T3KD4APJP63A3XBUO3ETRTQVKP227HEQLQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.337623985 (340h9m58.768704116s) [noise=true , address=104.36.82.12:4174 , piece_id=USGTPBPAV7OQQNTQZKMQYZAISSFWYNFDSI7INORCA5UU7IOXMN5A, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.407758242 (340h9m58.838838363s) [noise=true , address=77.90.31.10:4551 , piece_id=ZEIWOPBFIBYTWASHV7P6PQRZJE5OKLEKNIAN4G2GMO5TMHUNIFBQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.407784542 (340h9m58.838864663s) [seg_pos={0 0}, upload=353866]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:36:04.407971801 (340h9m58.839051932s) [noise=true , address=77.90.31.18:4837 , piece_id=CI4C52HE4RBTKDGQCZES3X7ZG2SLZG2MA3NZ2MWRRDYSWLXR6N6Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF
Aug 22 21:36:04.408067815 (340h9m58.839147946s) [noise=true , address=104.36.82.49:4999 , piece_id=KLTQ2PXRIR5OAI67U6V2YHWNSLFA7AKFYFGWSTUNWJXY47XAAHYA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tSiyPFy1xn1YRCLmKmPmbTm3LUmDP9nT1YRCXnsuyY6XsLKrG): protocol: expected piece hash; write tcp 188.166.225.170:38572->104.36.82.49:4999: use of closed network connection; write tcp 188.166.225.170:38572->104.36.82.49:4999: use of closed network connection; EOF
Aug 22 21:36:04.408200479 (340h9m58.8392806s) [noise=true , address=104.36.82.5:4865 , piece_id=LZIDPUPKAUM44EROSDOHLV6RNMZB4FUVMLUFDNCFRXKN3HWZBEUA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kqNGahsBw6VsV3JTALvPyGshuSFaAdRSo94cQnCXF3ak54KtL): protocol: write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection; write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection
Aug 22 21:36:04.408223141 (340h9m58.839303273s) [noise=true , address=45.91.116.9:4265 , piece_id=U7IEOR7IIOA4JYPLOB7CIPEMXBW4OV5SKZPMKTJVGPI35TGJ7HXQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xJiYuKnpkxVvRVXLmW2ZXR7KL8kQgw9SKHpgoD7uKhdfD2CyP): protocol: expected piece hash; context canceled; EOF
Aug 22 21:36:04.408231648 (340h9m58.839311769s) [seg_pos={0 0}, upload=353866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:36:04.408300079 (340h9m58.8393802s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:36:04.408303726 (340h9m58.839383857s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:36:04.908534994 (340h9m59.339615125s) [upload=353866]: Done uploading segments...
Aug 22 21:36:04.908553539 (340h9m59.33963366s) [upload=353866]: Upload finished. err: <nil>
Duration: 6.25339565s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [..............X........XX.....X..X.X...........X............] duration:
1.883255472s
FAIL (2025-08-22 21:36:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:27:24.505293131 (340h1m18.936373252s) [upload=353721]: Starting upload Aug 22 21:27:24.505339489 (340h1m18.93641962s) [upload=353721]: Done starting upload Aug 22 21:27:24.505385868 (340h1m18.936465989s) [upload=353721]: Uploading segments... Aug 22 21:27:24.505419953 (340h1m18.936500084s) [upload=353721]: Got next segment. Inline: true Aug 22 21:27:24.505423720 (340h1m18.936503851s) [upload=353721]: Waiting for error group managing segments... Aug 22 21:27:24.505457025 (340h1m18.936537146s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:27:24.505461413 (340h1m18.936541544s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:27:24.505463928 (340h1m18.936544059s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:27:24.720733208 (340h1m19.151813339s) [upload=353721]: Done uploading segments... Aug 22 21:27:24.720749881 (340h1m19.151830012s) [upload=353721]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.883281651s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...................X.........X........X.X.................X.] duration:
6.05427471s
FAIL (2025-08-22 21:36:33 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 21:36:01.641895143 (340h9m56.072975274s) [upload=353866]: Starting upload
Aug 22 21:36:01.641959005 (340h9m56.073039136s) [upload=353866]: Done starting upload
Aug 22 21:36:01.642059387 (340h9m56.073139518s) [upload=353866]: Uploading segments...
Aug 22 21:36:01.642247777 (340h9m56.073327908s) [upload=353866]: Got next segment. Inline: false
Aug 22 21:36:01.642319184 (340h9m56.073399315s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:36:01.642327119 (340h9m56.07340728s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:36:02.091844671 (340h9m56.522924822s) [seg_pos={0 0}, upload=353866]: Begin upload segment...
Aug 22 21:36:02.091970141 (340h9m56.523050272s) [seg_pos={0 0}, upload=353866]: Done begin upload segment.
Aug 22 21:36:02.091988607 (340h9m56.523068758s) [noise=true , address=104.36.82.20:4448 , piece_id=HLCUNUUI3GC4CCAFKMZH4EFM5WRW2MKT5JYUB62U6X34R5VQKKNA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.091996562 (340h9m56.523076703s) [noise=true , address=104.36.82.49:4999 , piece_id=KLTQ2PXRIR5OAI67U6V2YHWNSLFA7AKFYFGWSTUNWJXY47XAAHYA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092073599 (340h9m56.523153741s) [noise=true , address=77.90.31.10:4551 , piece_id=ZEIWOPBFIBYTWASHV7P6PQRZJE5OKLEKNIAN4G2GMO5TMHUNIFBQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092634152 (340h9m56.523714293s) [noise=true , address=104.36.82.5:4865 , piece_id=LZIDPUPKAUM44EROSDOHLV6RNMZB4FUVMLUFDNCFRXKN3HWZBEUA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092721218 (340h9m56.523801349s) [noise=true , address=45.91.116.11:4142 , piece_id=Z6VVNQYAV74ZS2TI6J5ZRR4XKIDXKXQAWOYHQBBLJSKJIFE73W2Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093126504 (340h9m56.524206645s) [noise=true , address=45.91.116.9:4265 , piece_id=U7IEOR7IIOA4JYPLOB7CIPEMXBW4OV5SKZPMKTJVGPI35TGJ7HXQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093317078 (340h9m56.524397229s) [noise=true , address=104.36.82.23:4470 , piece_id=ALN6754Z5V3OUPW2K5A5OMCDGAVMBFKIRKQVM6KGPIHSJCCLKM7Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093604860 (340h9m56.524685001s) [noise=true , address=104.36.82.9:4022 , piece_id=VNPCFDKEGAVLFWOMPB4ZD65KD5LGILCEQJL6TF2BYMULFNORSOAQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093856531 (340h9m56.524936662s) [noise=true , address=45.91.116.6:4007 , piece_id=DTDCNQG4C5Q5VRATUDSNEGMU5HHHTGSTZY543SZTUYPYUKMGSJCQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093959348 (340h9m56.525039479s) [noise=true , address=77.90.31.18:4837 , piece_id=CI4C52HE4RBTKDGQCZES3X7ZG2SLZG2MA3NZ2MWRRDYSWLXR6N6Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094295000 (340h9m56.525375141s) [noise=true , address=104.36.82.17:4343 , piece_id=ZJQYYVV5T2B3SACZAJY4ZQRNNRBZXBG7HVFKVUBTKEAHFZ37MR5Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094379742 (340h9m56.525459873s) [noise=true , address=77.90.31.11:4587 , piece_id=VNZNFGFWVAEGDIGHB3T3KD4APJP63A3XBUO3ETRTQVKP227HEQLQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094726947 (340h9m56.525807078s) [noise=true , address=45.91.116.8:4066 , piece_id=4FBA7PZINOQE6JEQE3R52KDRCI3LJE4POAGFFHNL33M6B5BL7LBA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.095589987 (340h9m56.526670129s) [noise=true , address=104.36.82.21:4500 , piece_id=UM4SUURDW7FPSASYFTRCTQCWKREFSCOHEOCEKAX2ERSNNSF24ZKA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096076018 (340h9m56.527156159s) [noise=true , address=104.36.82.8:4977 , piece_id=7PYTAJXOKPP62EVCT4YFSB5QG6EU5DTINAJDCU6CLTZGU2FFHAJA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096142294 (340h9m56.527222425s) [noise=true , address=104.36.82.11:4132 , piece_id=GUU4QW6OECM3U62KLP266J5HZVACSN2ND53A3EDY7GZJDESCKRHA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096548862 (340h9m56.527629013s) [noise=true , address=104.36.82.12:4174 , piece_id=USGTPBPAV7OQQNTQZKMQYZAISSFWYNFDSI7INORCA5UU7IOXMN5A, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.098834986 (340h9m56.529915117s) [noise=true , address=104.36.82.16:4297 , piece_id=MPKCIEL2SUYUDLQQMK2HUD3AYPFLDEI5EF7F6EDHNSKTN2775AZQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:03.616829816 (340h9m58.047909947s) [upload=353866]: Next returned nil segment
Aug 22 21:36:03.616848501 (340h9m58.047928632s) [upload=353866]: Waiting for error group managing segments...
Aug 22 21:36:04.065073249 (340h9m58.49615337s) [noise=true , address=104.36.82.17:4343 , piece_id=ZJQYYVV5T2B3SACZAJY4ZQRNNRBZXBG7HVFKVUBTKEAHFZ37MR5Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.091104127 (340h9m58.522184258s) [noise=true , address=104.36.82.20:4448 , piece_id=HLCUNUUI3GC4CCAFKMZH4EFM5WRW2MKT5JYUB62U6X34R5VQKKNA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.094482922 (340h9m58.525563053s) [noise=true , address=104.36.82.23:4470 , piece_id=ALN6754Z5V3OUPW2K5A5OMCDGAVMBFKIRKQVM6KGPIHSJCCLKM7Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.114285413 (340h9m58.545365544s) [noise=true , address=104.36.82.8:4977 , piece_id=7PYTAJXOKPP62EVCT4YFSB5QG6EU5DTINAJDCU6CLTZGU2FFHAJA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.133500259 (340h9m58.56458039s) [noise=true , address=45.91.116.8:4066 , piece_id=4FBA7PZINOQE6JEQE3R52KDRCI3LJE4POAGFFHNL33M6B5BL7LBA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.150011482 (340h9m58.581091613s) [noise=true , address=104.36.82.9:4022 , piece_id=VNPCFDKEGAVLFWOMPB4ZD65KD5LGILCEQJL6TF2BYMULFNORSOAQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.164828223 (340h9m58.595908344s) [noise=true , address=104.36.82.11:4132 , piece_id=GUU4QW6OECM3U62KLP266J5HZVACSN2ND53A3EDY7GZJDESCKRHA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.181561921 (340h9m58.612642052s) [noise=true , address=104.36.82.21:4500 , piece_id=UM4SUURDW7FPSASYFTRCTQCWKREFSCOHEOCEKAX2ERSNNSF24ZKA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.227706236 (340h9m58.658786367s) [noise=true , address=45.91.116.6:4007 , piece_id=DTDCNQG4C5Q5VRATUDSNEGMU5HHHTGSTZY543SZTUYPYUKMGSJCQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.228769060 (340h9m58.659849191s) [noise=true , address=45.91.116.11:4142 , piece_id=Z6VVNQYAV74ZS2TI6J5ZRR4XKIDXKXQAWOYHQBBLJSKJIFE73W2Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.232607284 (340h9m58.663687415s) [noise=true , address=104.36.82.16:4297 , piece_id=MPKCIEL2SUYUDLQQMK2HUD3AYPFLDEI5EF7F6EDHNSKTN2775AZQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.333024565 (340h9m58.764104696s) [noise=true , address=77.90.31.11:4587 , piece_id=VNZNFGFWVAEGDIGHB3T3KD4APJP63A3XBUO3ETRTQVKP227HEQLQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.337623985 (340h9m58.768704116s) [noise=true , address=104.36.82.12:4174 , piece_id=USGTPBPAV7OQQNTQZKMQYZAISSFWYNFDSI7INORCA5UU7IOXMN5A, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.407758242 (340h9m58.838838363s) [noise=true , address=77.90.31.10:4551 , piece_id=ZEIWOPBFIBYTWASHV7P6PQRZJE5OKLEKNIAN4G2GMO5TMHUNIFBQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.407784542 (340h9m58.838864663s) [seg_pos={0 0}, upload=353866]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:36:04.407971801 (340h9m58.839051932s) [noise=true , address=77.90.31.18:4837 , piece_id=CI4C52HE4RBTKDGQCZES3X7ZG2SLZG2MA3NZ2MWRRDYSWLXR6N6Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF
Aug 22 21:36:04.408067815 (340h9m58.839147946s) [noise=true , address=104.36.82.49:4999 , piece_id=KLTQ2PXRIR5OAI67U6V2YHWNSLFA7AKFYFGWSTUNWJXY47XAAHYA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tSiyPFy1xn1YRCLmKmPmbTm3LUmDP9nT1YRCXnsuyY6XsLKrG): protocol: expected piece hash; write tcp 188.166.225.170:38572->104.36.82.49:4999: use of closed network connection; write tcp 188.166.225.170:38572->104.36.82.49:4999: use of closed network connection; EOF
Aug 22 21:36:04.408200479 (340h9m58.8392806s) [noise=true , address=104.36.82.5:4865 , piece_id=LZIDPUPKAUM44EROSDOHLV6RNMZB4FUVMLUFDNCFRXKN3HWZBEUA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kqNGahsBw6VsV3JTALvPyGshuSFaAdRSo94cQnCXF3ak54KtL): protocol: write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection; write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection
Aug 22 21:36:04.408223141 (340h9m58.839303273s) [noise=true , address=45.91.116.9:4265 , piece_id=U7IEOR7IIOA4JYPLOB7CIPEMXBW4OV5SKZPMKTJVGPI35TGJ7HXQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xJiYuKnpkxVvRVXLmW2ZXR7KL8kQgw9SKHpgoD7uKhdfD2CyP): protocol: expected piece hash; context canceled; EOF
Aug 22 21:36:04.408231648 (340h9m58.839311769s) [seg_pos={0 0}, upload=353866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:36:04.408300079 (340h9m58.8393802s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:36:04.408303726 (340h9m58.839383857s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:36:04.908534994 (340h9m59.339615125s) [upload=353866]: Done uploading segments...
Aug 22 21:36:04.908553539 (340h9m59.33963366s) [upload=353866]: Upload finished. err: <nil>
Duration: 6.054297214s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [...............X........XX.....X..X.X...........X...........] duration:
2.072991437s
FAIL (2025-08-22 21:36:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:27:24.505293131 (340h1m18.936373252s) [upload=353721]: Starting upload Aug 22 21:27:24.505339489 (340h1m18.93641962s) [upload=353721]: Done starting upload Aug 22 21:27:24.505385868 (340h1m18.936465989s) [upload=353721]: Uploading segments... Aug 22 21:27:24.505419953 (340h1m18.936500084s) [upload=353721]: Got next segment. Inline: true Aug 22 21:27:24.505423720 (340h1m18.936503851s) [upload=353721]: Waiting for error group managing segments... Aug 22 21:27:24.505457025 (340h1m18.936537146s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:27:24.505461413 (340h1m18.936541544s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:27:24.505463928 (340h1m18.936544059s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:27:24.720733208 (340h1m19.151813339s) [upload=353721]: Done uploading segments... Aug 22 21:27:24.720749881 (340h1m19.151830012s) [upload=353721]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.073020473s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [....................X.........X........X.X.................X] duration:
4.438744112s
FAIL (2025-08-22 21:36:05 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 21:36:01.641895143 (340h9m56.072975274s) [upload=353866]: Starting upload
Aug 22 21:36:01.641959005 (340h9m56.073039136s) [upload=353866]: Done starting upload
Aug 22 21:36:01.642059387 (340h9m56.073139518s) [upload=353866]: Uploading segments...
Aug 22 21:36:01.642247777 (340h9m56.073327908s) [upload=353866]: Got next segment. Inline: false
Aug 22 21:36:01.642319184 (340h9m56.073399315s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:36:01.642327119 (340h9m56.07340728s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:36:02.091844671 (340h9m56.522924822s) [seg_pos={0 0}, upload=353866]: Begin upload segment...
Aug 22 21:36:02.091970141 (340h9m56.523050272s) [seg_pos={0 0}, upload=353866]: Done begin upload segment.
Aug 22 21:36:02.091988607 (340h9m56.523068758s) [noise=true , address=104.36.82.20:4448 , piece_id=HLCUNUUI3GC4CCAFKMZH4EFM5WRW2MKT5JYUB62U6X34R5VQKKNA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.091996562 (340h9m56.523076703s) [noise=true , address=104.36.82.49:4999 , piece_id=KLTQ2PXRIR5OAI67U6V2YHWNSLFA7AKFYFGWSTUNWJXY47XAAHYA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092073599 (340h9m56.523153741s) [noise=true , address=77.90.31.10:4551 , piece_id=ZEIWOPBFIBYTWASHV7P6PQRZJE5OKLEKNIAN4G2GMO5TMHUNIFBQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092634152 (340h9m56.523714293s) [noise=true , address=104.36.82.5:4865 , piece_id=LZIDPUPKAUM44EROSDOHLV6RNMZB4FUVMLUFDNCFRXKN3HWZBEUA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.092721218 (340h9m56.523801349s) [noise=true , address=45.91.116.11:4142 , piece_id=Z6VVNQYAV74ZS2TI6J5ZRR4XKIDXKXQAWOYHQBBLJSKJIFE73W2Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093126504 (340h9m56.524206645s) [noise=true , address=45.91.116.9:4265 , piece_id=U7IEOR7IIOA4JYPLOB7CIPEMXBW4OV5SKZPMKTJVGPI35TGJ7HXQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093317078 (340h9m56.524397229s) [noise=true , address=104.36.82.23:4470 , piece_id=ALN6754Z5V3OUPW2K5A5OMCDGAVMBFKIRKQVM6KGPIHSJCCLKM7Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093604860 (340h9m56.524685001s) [noise=true , address=104.36.82.9:4022 , piece_id=VNPCFDKEGAVLFWOMPB4ZD65KD5LGILCEQJL6TF2BYMULFNORSOAQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093856531 (340h9m56.524936662s) [noise=true , address=45.91.116.6:4007 , piece_id=DTDCNQG4C5Q5VRATUDSNEGMU5HHHTGSTZY543SZTUYPYUKMGSJCQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.093959348 (340h9m56.525039479s) [noise=true , address=77.90.31.18:4837 , piece_id=CI4C52HE4RBTKDGQCZES3X7ZG2SLZG2MA3NZ2MWRRDYSWLXR6N6Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094295000 (340h9m56.525375141s) [noise=true , address=104.36.82.17:4343 , piece_id=ZJQYYVV5T2B3SACZAJY4ZQRNNRBZXBG7HVFKVUBTKEAHFZ37MR5Q, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094379742 (340h9m56.525459873s) [noise=true , address=77.90.31.11:4587 , piece_id=VNZNFGFWVAEGDIGHB3T3KD4APJP63A3XBUO3ETRTQVKP227HEQLQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.094726947 (340h9m56.525807078s) [noise=true , address=45.91.116.8:4066 , piece_id=4FBA7PZINOQE6JEQE3R52KDRCI3LJE4POAGFFHNL33M6B5BL7LBA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.095589987 (340h9m56.526670129s) [noise=true , address=104.36.82.21:4500 , piece_id=UM4SUURDW7FPSASYFTRCTQCWKREFSCOHEOCEKAX2ERSNNSF24ZKA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096076018 (340h9m56.527156159s) [noise=true , address=104.36.82.8:4977 , piece_id=7PYTAJXOKPP62EVCT4YFSB5QG6EU5DTINAJDCU6CLTZGU2FFHAJA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096142294 (340h9m56.527222425s) [noise=true , address=104.36.82.11:4132 , piece_id=GUU4QW6OECM3U62KLP266J5HZVACSN2ND53A3EDY7GZJDESCKRHA, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.096548862 (340h9m56.527629013s) [noise=true , address=104.36.82.12:4174 , piece_id=USGTPBPAV7OQQNTQZKMQYZAISSFWYNFDSI7INORCA5UU7IOXMN5A, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:02.098834986 (340h9m56.529915117s) [noise=true , address=104.36.82.16:4297 , piece_id=MPKCIEL2SUYUDLQQMK2HUD3AYPFLDEI5EF7F6EDHNSKTN2775AZQ, seg_pos={0 0}, upload=353866]: Uploading piece...
Aug 22 21:36:03.616829816 (340h9m58.047909947s) [upload=353866]: Next returned nil segment
Aug 22 21:36:03.616848501 (340h9m58.047928632s) [upload=353866]: Waiting for error group managing segments...
Aug 22 21:36:04.065073249 (340h9m58.49615337s) [noise=true , address=104.36.82.17:4343 , piece_id=ZJQYYVV5T2B3SACZAJY4ZQRNNRBZXBG7HVFKVUBTKEAHFZ37MR5Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.091104127 (340h9m58.522184258s) [noise=true , address=104.36.82.20:4448 , piece_id=HLCUNUUI3GC4CCAFKMZH4EFM5WRW2MKT5JYUB62U6X34R5VQKKNA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.094482922 (340h9m58.525563053s) [noise=true , address=104.36.82.23:4470 , piece_id=ALN6754Z5V3OUPW2K5A5OMCDGAVMBFKIRKQVM6KGPIHSJCCLKM7Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.114285413 (340h9m58.545365544s) [noise=true , address=104.36.82.8:4977 , piece_id=7PYTAJXOKPP62EVCT4YFSB5QG6EU5DTINAJDCU6CLTZGU2FFHAJA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.133500259 (340h9m58.56458039s) [noise=true , address=45.91.116.8:4066 , piece_id=4FBA7PZINOQE6JEQE3R52KDRCI3LJE4POAGFFHNL33M6B5BL7LBA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.150011482 (340h9m58.581091613s) [noise=true , address=104.36.82.9:4022 , piece_id=VNPCFDKEGAVLFWOMPB4ZD65KD5LGILCEQJL6TF2BYMULFNORSOAQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.164828223 (340h9m58.595908344s) [noise=true , address=104.36.82.11:4132 , piece_id=GUU4QW6OECM3U62KLP266J5HZVACSN2ND53A3EDY7GZJDESCKRHA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.181561921 (340h9m58.612642052s) [noise=true , address=104.36.82.21:4500 , piece_id=UM4SUURDW7FPSASYFTRCTQCWKREFSCOHEOCEKAX2ERSNNSF24ZKA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.227706236 (340h9m58.658786367s) [noise=true , address=45.91.116.6:4007 , piece_id=DTDCNQG4C5Q5VRATUDSNEGMU5HHHTGSTZY543SZTUYPYUKMGSJCQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.228769060 (340h9m58.659849191s) [noise=true , address=45.91.116.11:4142 , piece_id=Z6VVNQYAV74ZS2TI6J5ZRR4XKIDXKXQAWOYHQBBLJSKJIFE73W2Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.232607284 (340h9m58.663687415s) [noise=true , address=104.36.82.16:4297 , piece_id=MPKCIEL2SUYUDLQQMK2HUD3AYPFLDEI5EF7F6EDHNSKTN2775AZQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.333024565 (340h9m58.764104696s) [noise=true , address=77.90.31.11:4587 , piece_id=VNZNFGFWVAEGDIGHB3T3KD4APJP63A3XBUO3ETRTQVKP227HEQLQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.337623985 (340h9m58.768704116s) [noise=true , address=104.36.82.12:4174 , piece_id=USGTPBPAV7OQQNTQZKMQYZAISSFWYNFDSI7INORCA5UU7IOXMN5A, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.407758242 (340h9m58.838838363s) [noise=true , address=77.90.31.10:4551 , piece_id=ZEIWOPBFIBYTWASHV7P6PQRZJE5OKLEKNIAN4G2GMO5TMHUNIFBQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: <nil>
Aug 22 21:36:04.407784542 (340h9m58.838864663s) [seg_pos={0 0}, upload=353866]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:36:04.407971801 (340h9m58.839051932s) [noise=true , address=77.90.31.18:4837 , piece_id=CI4C52HE4RBTKDGQCZES3X7ZG2SLZG2MA3NZ2MWRRDYSWLXR6N6Q, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF
Aug 22 21:36:04.408067815 (340h9m58.839147946s) [noise=true , address=104.36.82.49:4999 , piece_id=KLTQ2PXRIR5OAI67U6V2YHWNSLFA7AKFYFGWSTUNWJXY47XAAHYA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tSiyPFy1xn1YRCLmKmPmbTm3LUmDP9nT1YRCXnsuyY6XsLKrG): protocol: expected piece hash; write tcp 188.166.225.170:38572->104.36.82.49:4999: use of closed network connection; write tcp 188.166.225.170:38572->104.36.82.49:4999: use of closed network connection; EOF
Aug 22 21:36:04.408200479 (340h9m58.8392806s) [noise=true , address=104.36.82.5:4865 , piece_id=LZIDPUPKAUM44EROSDOHLV6RNMZB4FUVMLUFDNCFRXKN3HWZBEUA, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kqNGahsBw6VsV3JTALvPyGshuSFaAdRSo94cQnCXF3ak54KtL): protocol: write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection; write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36520->104.36.82.5:4865: use of closed network connection
Aug 22 21:36:04.408223141 (340h9m58.839303273s) [noise=true , address=45.91.116.9:4265 , piece_id=U7IEOR7IIOA4JYPLOB7CIPEMXBW4OV5SKZPMKTJVGPI35TGJ7HXQ, seg_pos={0 0}, upload=353866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xJiYuKnpkxVvRVXLmW2ZXR7KL8kQgw9SKHpgoD7uKhdfD2CyP): protocol: expected piece hash; context canceled; EOF
Aug 22 21:36:04.408231648 (340h9m58.839311769s) [seg_pos={0 0}, upload=353866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:36:04.408300079 (340h9m58.8393802s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:36:04.408303726 (340h9m58.839383857s) [upload=353866]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:36:04.908534994 (340h9m59.339615125s) [upload=353866]: Done uploading segments...
Aug 22 21:36:04.908553539 (340h9m59.33963366s) [upload=353866]: Upload finished. err: <nil>
Duration: 4.438771485s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [................X........XX.....X..X.X...........X..........] duration:
1.91977112s
FAIL (2025-08-22 21:35:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:27:24.505293131 (340h1m18.936373252s) [upload=353721]: Starting upload Aug 22 21:27:24.505339489 (340h1m18.93641962s) [upload=353721]: Done starting upload Aug 22 21:27:24.505385868 (340h1m18.936465989s) [upload=353721]: Uploading segments... Aug 22 21:27:24.505419953 (340h1m18.936500084s) [upload=353721]: Got next segment. Inline: true Aug 22 21:27:24.505423720 (340h1m18.936503851s) [upload=353721]: Waiting for error group managing segments... Aug 22 21:27:24.505457025 (340h1m18.936537146s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:27:24.505461413 (340h1m18.936541544s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:27:24.505463928 (340h1m18.936544059s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:27:24.720733208 (340h1m19.151813339s) [upload=353721]: Done uploading segments... Aug 22 21:27:24.720749881 (340h1m19.151830012s) [upload=353721]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.919797401s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....................X.........X........X.X.................] duration:
6.116072853s
FAIL (2025-08-22 21:35:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 21:20:41.940826160 (339h54m36.371906331s) [upload=353606]: Starting upload
Aug 22 21:20:41.940939767 (339h54m36.372019898s) [upload=353606]: Done starting upload
Aug 22 21:20:41.941011484 (339h54m36.372091666s) [upload=353606]: Uploading segments...
Aug 22 21:20:41.941397202 (339h54m36.372477363s) [upload=353606]: Got next segment. Inline: false
Aug 22 21:20:41.941463879 (339h54m36.372544091s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:20:41.941472727 (339h54m36.372552878s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:20:42.433073260 (339h54m36.864153391s) [seg_pos={0 0}, upload=353606]: Begin upload segment...
Aug 22 21:20:42.433126461 (339h54m36.864206583s) [seg_pos={0 0}, upload=353606]: Done begin upload segment.
Aug 22 21:20:42.433152251 (339h54m36.864232382s) [noise=true , address=104.36.82.37:4666 , piece_id=XTTEU3CSFCH2UQLCS76EIUATMF5ITRLKOZM6EZSZBCGJKDQ5YEJA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.433246592 (339h54m36.864326783s) [noise=true , address=104.36.82.6:4880 , piece_id=DFC6LZTRY46CKG4TNFFNYPI2OJJDAAPPSWRB6DBNPEWNXPMULK7A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.433522941 (339h54m36.864603062s) [noise=true , address=104.36.82.36:4636 , piece_id=IAURYTYJ2FHG2HEENLN64LD7HWERKMI6LC2PZRRJEK4B2ZN6G3PQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.433834787 (339h54m36.864914918s) [noise=true , address=45.91.116.14:4202 , piece_id=LYWALWZKWGBTZD7MAXIFFBPAMEQNJV35R7XF5TKFD6XH6YNAORPQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434069686 (339h54m36.865149817s) [noise=true , address=79.127.205.235:4686 , piece_id=K633E5VYSX2DMIWIXGLNVTNDNCEQ4R4LY53SSIM5DN4NP6EKFWGA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434124801 (339h54m36.865204932s) [noise=true , address=104.36.82.2:4749 , piece_id=XDLBSQWJTJV6BEEEJV643TCA2GNUHDMMMOU5IDCJWLLQ27UEXYFA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434445465 (339h54m36.865525596s) [noise=true , address=104.36.82.38:4692 , piece_id=2J4IEHVCH23ZJFWK3HFZS77E3WJMMHC6COB252OKSZOTQ43PN6WQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434497254 (339h54m36.865577385s) [noise=true , address=104.36.82.53:4137 , piece_id=ECXIZWUTS74GBHYCX4XE4LQ2JW62IPD4MSPTRPY56OVQ4V6NCUPA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434759476 (339h54m36.865839607s) [noise=true , address=104.36.82.20:4437 , piece_id=C6M3EY75MHKIBSIEBMJYBSPYTWD4TGJHTZMIS6UEO46GYB365EEA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434769395 (339h54m36.865849526s) [noise=true , address=77.90.31.15:4718 , piece_id=KDZ2T3R53NEZVKC36A4EM7TF6D6QXCGANHDMIRNS44T64BOEZA6A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434986691 (339h54m36.866066822s) [noise=true , address=79.127.205.233:4626 , piece_id=IRSA47O7NJDKY2EMTGB6UAULT3LRRYV3OVGRBGQTHUGVRHAO4NEA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434998463 (339h54m36.866078584s) [noise=true , address=45.91.116.11:4121 , piece_id=B2NDK7WEUIOH3A6BYBTOXQHOBIB3ZV3SMZ2ETRSNJDX32GJ32MCQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435209347 (339h54m36.866289478s) [noise=true , address=77.90.31.11:4586 , piece_id=3QMZXTTAUNJMZQEJLA573CDPPEF4FB7CUZ7CE3NI42OL5SWLQC3A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435219115 (339h54m36.866299246s) [noise=true , address=77.90.31.12:4600 , piece_id=GOJIROS4T6IMZZGH6F3SLE4PP4S3B7ZS4B3SHT3SJNLV5JSF5RCQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435455839 (339h54m36.86653597s) [noise=true , address=104.36.82.23:4478 , piece_id=UHMGYRTWRIOFPNYICJY5NVLR7PHSGBDQETQDLMODL33KF3Y2KWPA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435483532 (339h54m36.866563663s) [noise=true , address=104.36.82.16:4308 , piece_id=X4PQE26B6OFZB7L3OCHLIATJEKESSALZKGEVSO3KI5X5666FMGOA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435675589 (339h54m36.86675571s) [noise=true , address=77.90.31.16:4751 , piece_id=ORRKT4T4JMG5UTN32H3R5WIRT2WEUPMG6WUSZXLXPUIAXXDA33ZA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435701669 (339h54m36.8667818s) [noise=true , address=156.146.43.225:4451 , piece_id=5MTT6Z2GROX24S5HQ7PVP7DLH4NK5HTVKE5YIJ6OVCAPYWIFQK4A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:43.595727203 (339h54m38.026807335s) [upload=353606]: Next returned nil segment
Aug 22 21:20:43.595746771 (339h54m38.026826902s) [upload=353606]: Waiting for error group managing segments...
Aug 22 21:20:43.919150323 (339h54m38.350230464s) [noise=true , address=79.127.205.235:4686 , piece_id=K633E5VYSX2DMIWIXGLNVTNDNCEQ4R4LY53SSIM5DN4NP6EKFWGA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:43.932648276 (339h54m38.363728407s) [noise=true , address=79.127.205.233:4626 , piece_id=IRSA47O7NJDKY2EMTGB6UAULT3LRRYV3OVGRBGQTHUGVRHAO4NEA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.377315397 (339h54m38.808395518s) [noise=true , address=156.146.43.225:4451 , piece_id=5MTT6Z2GROX24S5HQ7PVP7DLH4NK5HTVKE5YIJ6OVCAPYWIFQK4A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.383579872 (339h54m38.814660003s) [noise=true , address=104.36.82.6:4880 , piece_id=DFC6LZTRY46CKG4TNFFNYPI2OJJDAAPPSWRB6DBNPEWNXPMULK7A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.422279301 (339h54m38.853359432s) [noise=true , address=77.90.31.16:4751 , piece_id=ORRKT4T4JMG5UTN32H3R5WIRT2WEUPMG6WUSZXLXPUIAXXDA33ZA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.435490226 (339h54m38.866570357s) [noise=true , address=104.36.82.37:4666 , piece_id=XTTEU3CSFCH2UQLCS76EIUATMF5ITRLKOZM6EZSZBCGJKDQ5YEJA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.460618241 (339h54m38.891698372s) [noise=true , address=45.91.116.14:4202 , piece_id=LYWALWZKWGBTZD7MAXIFFBPAMEQNJV35R7XF5TKFD6XH6YNAORPQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.476455161 (339h54m38.907535292s) [noise=true , address=104.36.82.16:4308 , piece_id=X4PQE26B6OFZB7L3OCHLIATJEKESSALZKGEVSO3KI5X5666FMGOA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.495127012 (339h54m38.926207143s) [noise=true , address=104.36.82.53:4137 , piece_id=ECXIZWUTS74GBHYCX4XE4LQ2JW62IPD4MSPTRPY56OVQ4V6NCUPA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.506495423 (339h54m38.937575554s) [noise=true , address=104.36.82.20:4437 , piece_id=C6M3EY75MHKIBSIEBMJYBSPYTWD4TGJHTZMIS6UEO46GYB365EEA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.512446929 (339h54m38.94352705s) [noise=true , address=77.90.31.11:4586 , piece_id=3QMZXTTAUNJMZQEJLA573CDPPEF4FB7CUZ7CE3NI42OL5SWLQC3A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.519654187 (339h54m38.950734318s) [noise=true , address=77.90.31.12:4600 , piece_id=GOJIROS4T6IMZZGH6F3SLE4PP4S3B7ZS4B3SHT3SJNLV5JSF5RCQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.527938217 (339h54m38.959018338s) [noise=true , address=104.36.82.36:4636 , piece_id=IAURYTYJ2FHG2HEENLN64LD7HWERKMI6LC2PZRRJEK4B2ZN6G3PQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.534433162 (339h54m38.965513293s) [noise=true , address=45.91.116.11:4121 , piece_id=B2NDK7WEUIOH3A6BYBTOXQHOBIB3ZV3SMZ2ETRSNJDX32GJ32MCQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.534452830 (339h54m38.965532961s) [seg_pos={0 0}, upload=353606]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:20:44.534604391 (339h54m38.965684522s) [noise=true , address=77.90.31.15:4718 , piece_id=KDZ2T3R53NEZVKC36A4EM7TF6D6QXCGANHDMIRNS44T64BOEZA6A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P53pBJhZqd4Kn47H6UcmxkDSh11qKmUaMhKTk3bGBF4FbmgMC): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534710504 (339h54m38.965790635s) [noise=true , address=104.36.82.2:4749 , piece_id=XDLBSQWJTJV6BEEEJV643TCA2GNUHDMMMOU5IDCJWLLQ27UEXYFA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534749428 (339h54m38.965829559s) [noise=true , address=104.36.82.38:4692 , piece_id=2J4IEHVCH23ZJFWK3HFZS77E3WJMMHC6COB252OKSZOTQ43PN6WQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n3SDzXGgXbvYBGtLdND9oy93AHNFokRnF6Yv3EvoMC9UgN2H9): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534769106 (339h54m38.965849237s) [noise=true , address=104.36.82.23:4478 , piece_id=UHMGYRTWRIOFPNYICJY5NVLR7PHSGBDQETQDLMODL33KF3Y2KWPA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534788693 (339h54m38.965868824s) [seg_pos={0 0}, upload=353606]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:20:44.534876031 (339h54m38.965956172s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:20:44.534880820 (339h54m38.965960951s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:20:44.874750362 (339h54m39.305830493s) [upload=353606]: Done uploading segments...
Aug 22 21:20:44.874769319 (339h54m39.30584945s) [upload=353606]: Upload finished. err: <nil>
Duration: 6.116121486s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.................X........XX.....X..X.X...........X.........] duration:
2.039720077s
FAIL (2025-08-22 21:34:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:27:24.505293131 (340h1m18.936373252s) [upload=353721]: Starting upload Aug 22 21:27:24.505339489 (340h1m18.93641962s) [upload=353721]: Done starting upload Aug 22 21:27:24.505385868 (340h1m18.936465989s) [upload=353721]: Uploading segments... Aug 22 21:27:24.505419953 (340h1m18.936500084s) [upload=353721]: Got next segment. Inline: true Aug 22 21:27:24.505423720 (340h1m18.936503851s) [upload=353721]: Waiting for error group managing segments... Aug 22 21:27:24.505457025 (340h1m18.936537146s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:27:24.505461413 (340h1m18.936541544s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:27:24.505463928 (340h1m18.936544059s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:27:24.720733208 (340h1m19.151813339s) [upload=353721]: Done uploading segments... Aug 22 21:27:24.720749881 (340h1m19.151830012s) [upload=353721]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.039752017s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......................X.........X........X.X................] duration:
6.200575977s
FAIL (2025-08-22 21:34:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 21:20:41.940826160 (339h54m36.371906331s) [upload=353606]: Starting upload
Aug 22 21:20:41.940939767 (339h54m36.372019898s) [upload=353606]: Done starting upload
Aug 22 21:20:41.941011484 (339h54m36.372091666s) [upload=353606]: Uploading segments...
Aug 22 21:20:41.941397202 (339h54m36.372477363s) [upload=353606]: Got next segment. Inline: false
Aug 22 21:20:41.941463879 (339h54m36.372544091s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:20:41.941472727 (339h54m36.372552878s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:20:42.433073260 (339h54m36.864153391s) [seg_pos={0 0}, upload=353606]: Begin upload segment...
Aug 22 21:20:42.433126461 (339h54m36.864206583s) [seg_pos={0 0}, upload=353606]: Done begin upload segment.
Aug 22 21:20:42.433152251 (339h54m36.864232382s) [noise=true , address=104.36.82.37:4666 , piece_id=XTTEU3CSFCH2UQLCS76EIUATMF5ITRLKOZM6EZSZBCGJKDQ5YEJA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.433246592 (339h54m36.864326783s) [noise=true , address=104.36.82.6:4880 , piece_id=DFC6LZTRY46CKG4TNFFNYPI2OJJDAAPPSWRB6DBNPEWNXPMULK7A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.433522941 (339h54m36.864603062s) [noise=true , address=104.36.82.36:4636 , piece_id=IAURYTYJ2FHG2HEENLN64LD7HWERKMI6LC2PZRRJEK4B2ZN6G3PQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.433834787 (339h54m36.864914918s) [noise=true , address=45.91.116.14:4202 , piece_id=LYWALWZKWGBTZD7MAXIFFBPAMEQNJV35R7XF5TKFD6XH6YNAORPQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434069686 (339h54m36.865149817s) [noise=true , address=79.127.205.235:4686 , piece_id=K633E5VYSX2DMIWIXGLNVTNDNCEQ4R4LY53SSIM5DN4NP6EKFWGA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434124801 (339h54m36.865204932s) [noise=true , address=104.36.82.2:4749 , piece_id=XDLBSQWJTJV6BEEEJV643TCA2GNUHDMMMOU5IDCJWLLQ27UEXYFA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434445465 (339h54m36.865525596s) [noise=true , address=104.36.82.38:4692 , piece_id=2J4IEHVCH23ZJFWK3HFZS77E3WJMMHC6COB252OKSZOTQ43PN6WQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434497254 (339h54m36.865577385s) [noise=true , address=104.36.82.53:4137 , piece_id=ECXIZWUTS74GBHYCX4XE4LQ2JW62IPD4MSPTRPY56OVQ4V6NCUPA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434759476 (339h54m36.865839607s) [noise=true , address=104.36.82.20:4437 , piece_id=C6M3EY75MHKIBSIEBMJYBSPYTWD4TGJHTZMIS6UEO46GYB365EEA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434769395 (339h54m36.865849526s) [noise=true , address=77.90.31.15:4718 , piece_id=KDZ2T3R53NEZVKC36A4EM7TF6D6QXCGANHDMIRNS44T64BOEZA6A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434986691 (339h54m36.866066822s) [noise=true , address=79.127.205.233:4626 , piece_id=IRSA47O7NJDKY2EMTGB6UAULT3LRRYV3OVGRBGQTHUGVRHAO4NEA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434998463 (339h54m36.866078584s) [noise=true , address=45.91.116.11:4121 , piece_id=B2NDK7WEUIOH3A6BYBTOXQHOBIB3ZV3SMZ2ETRSNJDX32GJ32MCQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435209347 (339h54m36.866289478s) [noise=true , address=77.90.31.11:4586 , piece_id=3QMZXTTAUNJMZQEJLA573CDPPEF4FB7CUZ7CE3NI42OL5SWLQC3A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435219115 (339h54m36.866299246s) [noise=true , address=77.90.31.12:4600 , piece_id=GOJIROS4T6IMZZGH6F3SLE4PP4S3B7ZS4B3SHT3SJNLV5JSF5RCQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435455839 (339h54m36.86653597s) [noise=true , address=104.36.82.23:4478 , piece_id=UHMGYRTWRIOFPNYICJY5NVLR7PHSGBDQETQDLMODL33KF3Y2KWPA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435483532 (339h54m36.866563663s) [noise=true , address=104.36.82.16:4308 , piece_id=X4PQE26B6OFZB7L3OCHLIATJEKESSALZKGEVSO3KI5X5666FMGOA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435675589 (339h54m36.86675571s) [noise=true , address=77.90.31.16:4751 , piece_id=ORRKT4T4JMG5UTN32H3R5WIRT2WEUPMG6WUSZXLXPUIAXXDA33ZA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435701669 (339h54m36.8667818s) [noise=true , address=156.146.43.225:4451 , piece_id=5MTT6Z2GROX24S5HQ7PVP7DLH4NK5HTVKE5YIJ6OVCAPYWIFQK4A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:43.595727203 (339h54m38.026807335s) [upload=353606]: Next returned nil segment
Aug 22 21:20:43.595746771 (339h54m38.026826902s) [upload=353606]: Waiting for error group managing segments...
Aug 22 21:20:43.919150323 (339h54m38.350230464s) [noise=true , address=79.127.205.235:4686 , piece_id=K633E5VYSX2DMIWIXGLNVTNDNCEQ4R4LY53SSIM5DN4NP6EKFWGA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:43.932648276 (339h54m38.363728407s) [noise=true , address=79.127.205.233:4626 , piece_id=IRSA47O7NJDKY2EMTGB6UAULT3LRRYV3OVGRBGQTHUGVRHAO4NEA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.377315397 (339h54m38.808395518s) [noise=true , address=156.146.43.225:4451 , piece_id=5MTT6Z2GROX24S5HQ7PVP7DLH4NK5HTVKE5YIJ6OVCAPYWIFQK4A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.383579872 (339h54m38.814660003s) [noise=true , address=104.36.82.6:4880 , piece_id=DFC6LZTRY46CKG4TNFFNYPI2OJJDAAPPSWRB6DBNPEWNXPMULK7A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.422279301 (339h54m38.853359432s) [noise=true , address=77.90.31.16:4751 , piece_id=ORRKT4T4JMG5UTN32H3R5WIRT2WEUPMG6WUSZXLXPUIAXXDA33ZA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.435490226 (339h54m38.866570357s) [noise=true , address=104.36.82.37:4666 , piece_id=XTTEU3CSFCH2UQLCS76EIUATMF5ITRLKOZM6EZSZBCGJKDQ5YEJA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.460618241 (339h54m38.891698372s) [noise=true , address=45.91.116.14:4202 , piece_id=LYWALWZKWGBTZD7MAXIFFBPAMEQNJV35R7XF5TKFD6XH6YNAORPQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.476455161 (339h54m38.907535292s) [noise=true , address=104.36.82.16:4308 , piece_id=X4PQE26B6OFZB7L3OCHLIATJEKESSALZKGEVSO3KI5X5666FMGOA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.495127012 (339h54m38.926207143s) [noise=true , address=104.36.82.53:4137 , piece_id=ECXIZWUTS74GBHYCX4XE4LQ2JW62IPD4MSPTRPY56OVQ4V6NCUPA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.506495423 (339h54m38.937575554s) [noise=true , address=104.36.82.20:4437 , piece_id=C6M3EY75MHKIBSIEBMJYBSPYTWD4TGJHTZMIS6UEO46GYB365EEA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.512446929 (339h54m38.94352705s) [noise=true , address=77.90.31.11:4586 , piece_id=3QMZXTTAUNJMZQEJLA573CDPPEF4FB7CUZ7CE3NI42OL5SWLQC3A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.519654187 (339h54m38.950734318s) [noise=true , address=77.90.31.12:4600 , piece_id=GOJIROS4T6IMZZGH6F3SLE4PP4S3B7ZS4B3SHT3SJNLV5JSF5RCQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.527938217 (339h54m38.959018338s) [noise=true , address=104.36.82.36:4636 , piece_id=IAURYTYJ2FHG2HEENLN64LD7HWERKMI6LC2PZRRJEK4B2ZN6G3PQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.534433162 (339h54m38.965513293s) [noise=true , address=45.91.116.11:4121 , piece_id=B2NDK7WEUIOH3A6BYBTOXQHOBIB3ZV3SMZ2ETRSNJDX32GJ32MCQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.534452830 (339h54m38.965532961s) [seg_pos={0 0}, upload=353606]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:20:44.534604391 (339h54m38.965684522s) [noise=true , address=77.90.31.15:4718 , piece_id=KDZ2T3R53NEZVKC36A4EM7TF6D6QXCGANHDMIRNS44T64BOEZA6A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P53pBJhZqd4Kn47H6UcmxkDSh11qKmUaMhKTk3bGBF4FbmgMC): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534710504 (339h54m38.965790635s) [noise=true , address=104.36.82.2:4749 , piece_id=XDLBSQWJTJV6BEEEJV643TCA2GNUHDMMMOU5IDCJWLLQ27UEXYFA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534749428 (339h54m38.965829559s) [noise=true , address=104.36.82.38:4692 , piece_id=2J4IEHVCH23ZJFWK3HFZS77E3WJMMHC6COB252OKSZOTQ43PN6WQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n3SDzXGgXbvYBGtLdND9oy93AHNFokRnF6Yv3EvoMC9UgN2H9): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534769106 (339h54m38.965849237s) [noise=true , address=104.36.82.23:4478 , piece_id=UHMGYRTWRIOFPNYICJY5NVLR7PHSGBDQETQDLMODL33KF3Y2KWPA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534788693 (339h54m38.965868824s) [seg_pos={0 0}, upload=353606]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:20:44.534876031 (339h54m38.965956172s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:20:44.534880820 (339h54m38.965960951s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:20:44.874750362 (339h54m39.305830493s) [upload=353606]: Done uploading segments...
Aug 22 21:20:44.874769319 (339h54m39.30584945s) [upload=353606]: Upload finished. err: <nil>
Duration: 6.200604611s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [..................X........XX.....X..X.X...........X........] duration:
2.134352754s
FAIL (2025-08-22 21:33:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:27:24.505293131 (340h1m18.936373252s) [upload=353721]: Starting upload Aug 22 21:27:24.505339489 (340h1m18.93641962s) [upload=353721]: Done starting upload Aug 22 21:27:24.505385868 (340h1m18.936465989s) [upload=353721]: Uploading segments... Aug 22 21:27:24.505419953 (340h1m18.936500084s) [upload=353721]: Got next segment. Inline: true Aug 22 21:27:24.505423720 (340h1m18.936503851s) [upload=353721]: Waiting for error group managing segments... Aug 22 21:27:24.505457025 (340h1m18.936537146s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:27:24.505461413 (340h1m18.936541544s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:27:24.505463928 (340h1m18.936544059s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:27:24.720733208 (340h1m19.151813339s) [upload=353721]: Done uploading segments... Aug 22 21:27:24.720749881 (340h1m19.151830012s) [upload=353721]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.134382329s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......................X.........X........X.X...............] duration:
6.018022479s
FAIL (2025-08-22 21:33:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 21:20:41.940826160 (339h54m36.371906331s) [upload=353606]: Starting upload
Aug 22 21:20:41.940939767 (339h54m36.372019898s) [upload=353606]: Done starting upload
Aug 22 21:20:41.941011484 (339h54m36.372091666s) [upload=353606]: Uploading segments...
Aug 22 21:20:41.941397202 (339h54m36.372477363s) [upload=353606]: Got next segment. Inline: false
Aug 22 21:20:41.941463879 (339h54m36.372544091s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:20:41.941472727 (339h54m36.372552878s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:20:42.433073260 (339h54m36.864153391s) [seg_pos={0 0}, upload=353606]: Begin upload segment...
Aug 22 21:20:42.433126461 (339h54m36.864206583s) [seg_pos={0 0}, upload=353606]: Done begin upload segment.
Aug 22 21:20:42.433152251 (339h54m36.864232382s) [noise=true , address=104.36.82.37:4666 , piece_id=XTTEU3CSFCH2UQLCS76EIUATMF5ITRLKOZM6EZSZBCGJKDQ5YEJA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.433246592 (339h54m36.864326783s) [noise=true , address=104.36.82.6:4880 , piece_id=DFC6LZTRY46CKG4TNFFNYPI2OJJDAAPPSWRB6DBNPEWNXPMULK7A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.433522941 (339h54m36.864603062s) [noise=true , address=104.36.82.36:4636 , piece_id=IAURYTYJ2FHG2HEENLN64LD7HWERKMI6LC2PZRRJEK4B2ZN6G3PQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.433834787 (339h54m36.864914918s) [noise=true , address=45.91.116.14:4202 , piece_id=LYWALWZKWGBTZD7MAXIFFBPAMEQNJV35R7XF5TKFD6XH6YNAORPQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434069686 (339h54m36.865149817s) [noise=true , address=79.127.205.235:4686 , piece_id=K633E5VYSX2DMIWIXGLNVTNDNCEQ4R4LY53SSIM5DN4NP6EKFWGA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434124801 (339h54m36.865204932s) [noise=true , address=104.36.82.2:4749 , piece_id=XDLBSQWJTJV6BEEEJV643TCA2GNUHDMMMOU5IDCJWLLQ27UEXYFA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434445465 (339h54m36.865525596s) [noise=true , address=104.36.82.38:4692 , piece_id=2J4IEHVCH23ZJFWK3HFZS77E3WJMMHC6COB252OKSZOTQ43PN6WQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434497254 (339h54m36.865577385s) [noise=true , address=104.36.82.53:4137 , piece_id=ECXIZWUTS74GBHYCX4XE4LQ2JW62IPD4MSPTRPY56OVQ4V6NCUPA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434759476 (339h54m36.865839607s) [noise=true , address=104.36.82.20:4437 , piece_id=C6M3EY75MHKIBSIEBMJYBSPYTWD4TGJHTZMIS6UEO46GYB365EEA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434769395 (339h54m36.865849526s) [noise=true , address=77.90.31.15:4718 , piece_id=KDZ2T3R53NEZVKC36A4EM7TF6D6QXCGANHDMIRNS44T64BOEZA6A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434986691 (339h54m36.866066822s) [noise=true , address=79.127.205.233:4626 , piece_id=IRSA47O7NJDKY2EMTGB6UAULT3LRRYV3OVGRBGQTHUGVRHAO4NEA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434998463 (339h54m36.866078584s) [noise=true , address=45.91.116.11:4121 , piece_id=B2NDK7WEUIOH3A6BYBTOXQHOBIB3ZV3SMZ2ETRSNJDX32GJ32MCQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435209347 (339h54m36.866289478s) [noise=true , address=77.90.31.11:4586 , piece_id=3QMZXTTAUNJMZQEJLA573CDPPEF4FB7CUZ7CE3NI42OL5SWLQC3A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435219115 (339h54m36.866299246s) [noise=true , address=77.90.31.12:4600 , piece_id=GOJIROS4T6IMZZGH6F3SLE4PP4S3B7ZS4B3SHT3SJNLV5JSF5RCQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435455839 (339h54m36.86653597s) [noise=true , address=104.36.82.23:4478 , piece_id=UHMGYRTWRIOFPNYICJY5NVLR7PHSGBDQETQDLMODL33KF3Y2KWPA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435483532 (339h54m36.866563663s) [noise=true , address=104.36.82.16:4308 , piece_id=X4PQE26B6OFZB7L3OCHLIATJEKESSALZKGEVSO3KI5X5666FMGOA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435675589 (339h54m36.86675571s) [noise=true , address=77.90.31.16:4751 , piece_id=ORRKT4T4JMG5UTN32H3R5WIRT2WEUPMG6WUSZXLXPUIAXXDA33ZA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435701669 (339h54m36.8667818s) [noise=true , address=156.146.43.225:4451 , piece_id=5MTT6Z2GROX24S5HQ7PVP7DLH4NK5HTVKE5YIJ6OVCAPYWIFQK4A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:43.595727203 (339h54m38.026807335s) [upload=353606]: Next returned nil segment
Aug 22 21:20:43.595746771 (339h54m38.026826902s) [upload=353606]: Waiting for error group managing segments...
Aug 22 21:20:43.919150323 (339h54m38.350230464s) [noise=true , address=79.127.205.235:4686 , piece_id=K633E5VYSX2DMIWIXGLNVTNDNCEQ4R4LY53SSIM5DN4NP6EKFWGA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:43.932648276 (339h54m38.363728407s) [noise=true , address=79.127.205.233:4626 , piece_id=IRSA47O7NJDKY2EMTGB6UAULT3LRRYV3OVGRBGQTHUGVRHAO4NEA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.377315397 (339h54m38.808395518s) [noise=true , address=156.146.43.225:4451 , piece_id=5MTT6Z2GROX24S5HQ7PVP7DLH4NK5HTVKE5YIJ6OVCAPYWIFQK4A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.383579872 (339h54m38.814660003s) [noise=true , address=104.36.82.6:4880 , piece_id=DFC6LZTRY46CKG4TNFFNYPI2OJJDAAPPSWRB6DBNPEWNXPMULK7A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.422279301 (339h54m38.853359432s) [noise=true , address=77.90.31.16:4751 , piece_id=ORRKT4T4JMG5UTN32H3R5WIRT2WEUPMG6WUSZXLXPUIAXXDA33ZA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.435490226 (339h54m38.866570357s) [noise=true , address=104.36.82.37:4666 , piece_id=XTTEU3CSFCH2UQLCS76EIUATMF5ITRLKOZM6EZSZBCGJKDQ5YEJA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.460618241 (339h54m38.891698372s) [noise=true , address=45.91.116.14:4202 , piece_id=LYWALWZKWGBTZD7MAXIFFBPAMEQNJV35R7XF5TKFD6XH6YNAORPQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.476455161 (339h54m38.907535292s) [noise=true , address=104.36.82.16:4308 , piece_id=X4PQE26B6OFZB7L3OCHLIATJEKESSALZKGEVSO3KI5X5666FMGOA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.495127012 (339h54m38.926207143s) [noise=true , address=104.36.82.53:4137 , piece_id=ECXIZWUTS74GBHYCX4XE4LQ2JW62IPD4MSPTRPY56OVQ4V6NCUPA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.506495423 (339h54m38.937575554s) [noise=true , address=104.36.82.20:4437 , piece_id=C6M3EY75MHKIBSIEBMJYBSPYTWD4TGJHTZMIS6UEO46GYB365EEA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.512446929 (339h54m38.94352705s) [noise=true , address=77.90.31.11:4586 , piece_id=3QMZXTTAUNJMZQEJLA573CDPPEF4FB7CUZ7CE3NI42OL5SWLQC3A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.519654187 (339h54m38.950734318s) [noise=true , address=77.90.31.12:4600 , piece_id=GOJIROS4T6IMZZGH6F3SLE4PP4S3B7ZS4B3SHT3SJNLV5JSF5RCQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.527938217 (339h54m38.959018338s) [noise=true , address=104.36.82.36:4636 , piece_id=IAURYTYJ2FHG2HEENLN64LD7HWERKMI6LC2PZRRJEK4B2ZN6G3PQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.534433162 (339h54m38.965513293s) [noise=true , address=45.91.116.11:4121 , piece_id=B2NDK7WEUIOH3A6BYBTOXQHOBIB3ZV3SMZ2ETRSNJDX32GJ32MCQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.534452830 (339h54m38.965532961s) [seg_pos={0 0}, upload=353606]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:20:44.534604391 (339h54m38.965684522s) [noise=true , address=77.90.31.15:4718 , piece_id=KDZ2T3R53NEZVKC36A4EM7TF6D6QXCGANHDMIRNS44T64BOEZA6A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P53pBJhZqd4Kn47H6UcmxkDSh11qKmUaMhKTk3bGBF4FbmgMC): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534710504 (339h54m38.965790635s) [noise=true , address=104.36.82.2:4749 , piece_id=XDLBSQWJTJV6BEEEJV643TCA2GNUHDMMMOU5IDCJWLLQ27UEXYFA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534749428 (339h54m38.965829559s) [noise=true , address=104.36.82.38:4692 , piece_id=2J4IEHVCH23ZJFWK3HFZS77E3WJMMHC6COB252OKSZOTQ43PN6WQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n3SDzXGgXbvYBGtLdND9oy93AHNFokRnF6Yv3EvoMC9UgN2H9): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534769106 (339h54m38.965849237s) [noise=true , address=104.36.82.23:4478 , piece_id=UHMGYRTWRIOFPNYICJY5NVLR7PHSGBDQETQDLMODL33KF3Y2KWPA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534788693 (339h54m38.965868824s) [seg_pos={0 0}, upload=353606]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:20:44.534876031 (339h54m38.965956172s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:20:44.534880820 (339h54m38.965960951s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:20:44.874750362 (339h54m39.305830493s) [upload=353606]: Done uploading segments...
Aug 22 21:20:44.874769319 (339h54m39.30584945s) [upload=353606]: Upload finished. err: <nil>
Duration: 6.018047347s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [...................X........XX.....X..X.X...........X.......] duration:
1.878391012s
FAIL (2025-08-22 21:33:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:27:24.505293131 (340h1m18.936373252s) [upload=353721]: Starting upload Aug 22 21:27:24.505339489 (340h1m18.93641962s) [upload=353721]: Done starting upload Aug 22 21:27:24.505385868 (340h1m18.936465989s) [upload=353721]: Uploading segments... Aug 22 21:27:24.505419953 (340h1m18.936500084s) [upload=353721]: Got next segment. Inline: true Aug 22 21:27:24.505423720 (340h1m18.936503851s) [upload=353721]: Waiting for error group managing segments... Aug 22 21:27:24.505457025 (340h1m18.936537146s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:27:24.505461413 (340h1m18.936541544s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:27:24.505463928 (340h1m18.936544059s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:27:24.720733208 (340h1m19.151813339s) [upload=353721]: Done uploading segments... Aug 22 21:27:24.720749881 (340h1m19.151830012s) [upload=353721]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.878419076s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........................X.........X........X.X..............] duration:
5.905549446s
FAIL (2025-08-22 21:32:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 21:20:41.940826160 (339h54m36.371906331s) [upload=353606]: Starting upload
Aug 22 21:20:41.940939767 (339h54m36.372019898s) [upload=353606]: Done starting upload
Aug 22 21:20:41.941011484 (339h54m36.372091666s) [upload=353606]: Uploading segments...
Aug 22 21:20:41.941397202 (339h54m36.372477363s) [upload=353606]: Got next segment. Inline: false
Aug 22 21:20:41.941463879 (339h54m36.372544091s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:20:41.941472727 (339h54m36.372552878s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:20:42.433073260 (339h54m36.864153391s) [seg_pos={0 0}, upload=353606]: Begin upload segment...
Aug 22 21:20:42.433126461 (339h54m36.864206583s) [seg_pos={0 0}, upload=353606]: Done begin upload segment.
Aug 22 21:20:42.433152251 (339h54m36.864232382s) [noise=true , address=104.36.82.37:4666 , piece_id=XTTEU3CSFCH2UQLCS76EIUATMF5ITRLKOZM6EZSZBCGJKDQ5YEJA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.433246592 (339h54m36.864326783s) [noise=true , address=104.36.82.6:4880 , piece_id=DFC6LZTRY46CKG4TNFFNYPI2OJJDAAPPSWRB6DBNPEWNXPMULK7A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.433522941 (339h54m36.864603062s) [noise=true , address=104.36.82.36:4636 , piece_id=IAURYTYJ2FHG2HEENLN64LD7HWERKMI6LC2PZRRJEK4B2ZN6G3PQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.433834787 (339h54m36.864914918s) [noise=true , address=45.91.116.14:4202 , piece_id=LYWALWZKWGBTZD7MAXIFFBPAMEQNJV35R7XF5TKFD6XH6YNAORPQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434069686 (339h54m36.865149817s) [noise=true , address=79.127.205.235:4686 , piece_id=K633E5VYSX2DMIWIXGLNVTNDNCEQ4R4LY53SSIM5DN4NP6EKFWGA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434124801 (339h54m36.865204932s) [noise=true , address=104.36.82.2:4749 , piece_id=XDLBSQWJTJV6BEEEJV643TCA2GNUHDMMMOU5IDCJWLLQ27UEXYFA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434445465 (339h54m36.865525596s) [noise=true , address=104.36.82.38:4692 , piece_id=2J4IEHVCH23ZJFWK3HFZS77E3WJMMHC6COB252OKSZOTQ43PN6WQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434497254 (339h54m36.865577385s) [noise=true , address=104.36.82.53:4137 , piece_id=ECXIZWUTS74GBHYCX4XE4LQ2JW62IPD4MSPTRPY56OVQ4V6NCUPA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434759476 (339h54m36.865839607s) [noise=true , address=104.36.82.20:4437 , piece_id=C6M3EY75MHKIBSIEBMJYBSPYTWD4TGJHTZMIS6UEO46GYB365EEA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434769395 (339h54m36.865849526s) [noise=true , address=77.90.31.15:4718 , piece_id=KDZ2T3R53NEZVKC36A4EM7TF6D6QXCGANHDMIRNS44T64BOEZA6A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434986691 (339h54m36.866066822s) [noise=true , address=79.127.205.233:4626 , piece_id=IRSA47O7NJDKY2EMTGB6UAULT3LRRYV3OVGRBGQTHUGVRHAO4NEA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434998463 (339h54m36.866078584s) [noise=true , address=45.91.116.11:4121 , piece_id=B2NDK7WEUIOH3A6BYBTOXQHOBIB3ZV3SMZ2ETRSNJDX32GJ32MCQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435209347 (339h54m36.866289478s) [noise=true , address=77.90.31.11:4586 , piece_id=3QMZXTTAUNJMZQEJLA573CDPPEF4FB7CUZ7CE3NI42OL5SWLQC3A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435219115 (339h54m36.866299246s) [noise=true , address=77.90.31.12:4600 , piece_id=GOJIROS4T6IMZZGH6F3SLE4PP4S3B7ZS4B3SHT3SJNLV5JSF5RCQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435455839 (339h54m36.86653597s) [noise=true , address=104.36.82.23:4478 , piece_id=UHMGYRTWRIOFPNYICJY5NVLR7PHSGBDQETQDLMODL33KF3Y2KWPA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435483532 (339h54m36.866563663s) [noise=true , address=104.36.82.16:4308 , piece_id=X4PQE26B6OFZB7L3OCHLIATJEKESSALZKGEVSO3KI5X5666FMGOA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435675589 (339h54m36.86675571s) [noise=true , address=77.90.31.16:4751 , piece_id=ORRKT4T4JMG5UTN32H3R5WIRT2WEUPMG6WUSZXLXPUIAXXDA33ZA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435701669 (339h54m36.8667818s) [noise=true , address=156.146.43.225:4451 , piece_id=5MTT6Z2GROX24S5HQ7PVP7DLH4NK5HTVKE5YIJ6OVCAPYWIFQK4A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:43.595727203 (339h54m38.026807335s) [upload=353606]: Next returned nil segment
Aug 22 21:20:43.595746771 (339h54m38.026826902s) [upload=353606]: Waiting for error group managing segments...
Aug 22 21:20:43.919150323 (339h54m38.350230464s) [noise=true , address=79.127.205.235:4686 , piece_id=K633E5VYSX2DMIWIXGLNVTNDNCEQ4R4LY53SSIM5DN4NP6EKFWGA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:43.932648276 (339h54m38.363728407s) [noise=true , address=79.127.205.233:4626 , piece_id=IRSA47O7NJDKY2EMTGB6UAULT3LRRYV3OVGRBGQTHUGVRHAO4NEA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.377315397 (339h54m38.808395518s) [noise=true , address=156.146.43.225:4451 , piece_id=5MTT6Z2GROX24S5HQ7PVP7DLH4NK5HTVKE5YIJ6OVCAPYWIFQK4A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.383579872 (339h54m38.814660003s) [noise=true , address=104.36.82.6:4880 , piece_id=DFC6LZTRY46CKG4TNFFNYPI2OJJDAAPPSWRB6DBNPEWNXPMULK7A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.422279301 (339h54m38.853359432s) [noise=true , address=77.90.31.16:4751 , piece_id=ORRKT4T4JMG5UTN32H3R5WIRT2WEUPMG6WUSZXLXPUIAXXDA33ZA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.435490226 (339h54m38.866570357s) [noise=true , address=104.36.82.37:4666 , piece_id=XTTEU3CSFCH2UQLCS76EIUATMF5ITRLKOZM6EZSZBCGJKDQ5YEJA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.460618241 (339h54m38.891698372s) [noise=true , address=45.91.116.14:4202 , piece_id=LYWALWZKWGBTZD7MAXIFFBPAMEQNJV35R7XF5TKFD6XH6YNAORPQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.476455161 (339h54m38.907535292s) [noise=true , address=104.36.82.16:4308 , piece_id=X4PQE26B6OFZB7L3OCHLIATJEKESSALZKGEVSO3KI5X5666FMGOA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.495127012 (339h54m38.926207143s) [noise=true , address=104.36.82.53:4137 , piece_id=ECXIZWUTS74GBHYCX4XE4LQ2JW62IPD4MSPTRPY56OVQ4V6NCUPA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.506495423 (339h54m38.937575554s) [noise=true , address=104.36.82.20:4437 , piece_id=C6M3EY75MHKIBSIEBMJYBSPYTWD4TGJHTZMIS6UEO46GYB365EEA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.512446929 (339h54m38.94352705s) [noise=true , address=77.90.31.11:4586 , piece_id=3QMZXTTAUNJMZQEJLA573CDPPEF4FB7CUZ7CE3NI42OL5SWLQC3A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.519654187 (339h54m38.950734318s) [noise=true , address=77.90.31.12:4600 , piece_id=GOJIROS4T6IMZZGH6F3SLE4PP4S3B7ZS4B3SHT3SJNLV5JSF5RCQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.527938217 (339h54m38.959018338s) [noise=true , address=104.36.82.36:4636 , piece_id=IAURYTYJ2FHG2HEENLN64LD7HWERKMI6LC2PZRRJEK4B2ZN6G3PQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.534433162 (339h54m38.965513293s) [noise=true , address=45.91.116.11:4121 , piece_id=B2NDK7WEUIOH3A6BYBTOXQHOBIB3ZV3SMZ2ETRSNJDX32GJ32MCQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.534452830 (339h54m38.965532961s) [seg_pos={0 0}, upload=353606]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:20:44.534604391 (339h54m38.965684522s) [noise=true , address=77.90.31.15:4718 , piece_id=KDZ2T3R53NEZVKC36A4EM7TF6D6QXCGANHDMIRNS44T64BOEZA6A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P53pBJhZqd4Kn47H6UcmxkDSh11qKmUaMhKTk3bGBF4FbmgMC): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534710504 (339h54m38.965790635s) [noise=true , address=104.36.82.2:4749 , piece_id=XDLBSQWJTJV6BEEEJV643TCA2GNUHDMMMOU5IDCJWLLQ27UEXYFA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534749428 (339h54m38.965829559s) [noise=true , address=104.36.82.38:4692 , piece_id=2J4IEHVCH23ZJFWK3HFZS77E3WJMMHC6COB252OKSZOTQ43PN6WQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n3SDzXGgXbvYBGtLdND9oy93AHNFokRnF6Yv3EvoMC9UgN2H9): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534769106 (339h54m38.965849237s) [noise=true , address=104.36.82.23:4478 , piece_id=UHMGYRTWRIOFPNYICJY5NVLR7PHSGBDQETQDLMODL33KF3Y2KWPA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534788693 (339h54m38.965868824s) [seg_pos={0 0}, upload=353606]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:20:44.534876031 (339h54m38.965956172s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:20:44.534880820 (339h54m38.965960951s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:20:44.874750362 (339h54m39.305830493s) [upload=353606]: Done uploading segments...
Aug 22 21:20:44.874769319 (339h54m39.30584945s) [upload=353606]: Upload finished. err: <nil>
Duration: 5.905580033s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
8 out of 60 is failed (threshold=3) [X...................X........XX.....X..X.X...........X......] duration:
2.095214415s
FAIL (2025-08-22 21:32:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:27:24.505293131 (340h1m18.936373252s) [upload=353721]: Starting upload Aug 22 21:27:24.505339489 (340h1m18.93641962s) [upload=353721]: Done starting upload Aug 22 21:27:24.505385868 (340h1m18.936465989s) [upload=353721]: Uploading segments... Aug 22 21:27:24.505419953 (340h1m18.936500084s) [upload=353721]: Got next segment. Inline: true Aug 22 21:27:24.505423720 (340h1m18.936503851s) [upload=353721]: Waiting for error group managing segments... Aug 22 21:27:24.505457025 (340h1m18.936537146s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:27:24.505461413 (340h1m18.936541544s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:27:24.505463928 (340h1m18.936544059s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:27:24.720733208 (340h1m19.151813339s) [upload=353721]: Done uploading segments... Aug 22 21:27:24.720749881 (340h1m19.151830012s) [upload=353721]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.095243001s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
8 out of 60 is failed (threshold=3) [.X...................X........XX.....X..X.X...........X.....] duration:
1.860217954s
FAIL (2025-08-22 21:31:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:27:24.505293131 (340h1m18.936373252s) [upload=353721]: Starting upload Aug 22 21:27:24.505339489 (340h1m18.93641962s) [upload=353721]: Done starting upload Aug 22 21:27:24.505385868 (340h1m18.936465989s) [upload=353721]: Uploading segments... Aug 22 21:27:24.505419953 (340h1m18.936500084s) [upload=353721]: Got next segment. Inline: true Aug 22 21:27:24.505423720 (340h1m18.936503851s) [upload=353721]: Waiting for error group managing segments... Aug 22 21:27:24.505457025 (340h1m18.936537146s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:27:24.505461413 (340h1m18.936541544s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:27:24.505463928 (340h1m18.936544059s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:27:24.720733208 (340h1m19.151813339s) [upload=353721]: Done uploading segments... Aug 22 21:27:24.720749881 (340h1m19.151830012s) [upload=353721]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.860234626s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........................X.........X........X.X.............] duration:
6.488552388s
FAIL (2025-08-22 21:31:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 21:20:41.940826160 (339h54m36.371906331s) [upload=353606]: Starting upload
Aug 22 21:20:41.940939767 (339h54m36.372019898s) [upload=353606]: Done starting upload
Aug 22 21:20:41.941011484 (339h54m36.372091666s) [upload=353606]: Uploading segments...
Aug 22 21:20:41.941397202 (339h54m36.372477363s) [upload=353606]: Got next segment. Inline: false
Aug 22 21:20:41.941463879 (339h54m36.372544091s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:20:41.941472727 (339h54m36.372552878s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:20:42.433073260 (339h54m36.864153391s) [seg_pos={0 0}, upload=353606]: Begin upload segment...
Aug 22 21:20:42.433126461 (339h54m36.864206583s) [seg_pos={0 0}, upload=353606]: Done begin upload segment.
Aug 22 21:20:42.433152251 (339h54m36.864232382s) [noise=true , address=104.36.82.37:4666 , piece_id=XTTEU3CSFCH2UQLCS76EIUATMF5ITRLKOZM6EZSZBCGJKDQ5YEJA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.433246592 (339h54m36.864326783s) [noise=true , address=104.36.82.6:4880 , piece_id=DFC6LZTRY46CKG4TNFFNYPI2OJJDAAPPSWRB6DBNPEWNXPMULK7A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.433522941 (339h54m36.864603062s) [noise=true , address=104.36.82.36:4636 , piece_id=IAURYTYJ2FHG2HEENLN64LD7HWERKMI6LC2PZRRJEK4B2ZN6G3PQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.433834787 (339h54m36.864914918s) [noise=true , address=45.91.116.14:4202 , piece_id=LYWALWZKWGBTZD7MAXIFFBPAMEQNJV35R7XF5TKFD6XH6YNAORPQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434069686 (339h54m36.865149817s) [noise=true , address=79.127.205.235:4686 , piece_id=K633E5VYSX2DMIWIXGLNVTNDNCEQ4R4LY53SSIM5DN4NP6EKFWGA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434124801 (339h54m36.865204932s) [noise=true , address=104.36.82.2:4749 , piece_id=XDLBSQWJTJV6BEEEJV643TCA2GNUHDMMMOU5IDCJWLLQ27UEXYFA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434445465 (339h54m36.865525596s) [noise=true , address=104.36.82.38:4692 , piece_id=2J4IEHVCH23ZJFWK3HFZS77E3WJMMHC6COB252OKSZOTQ43PN6WQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434497254 (339h54m36.865577385s) [noise=true , address=104.36.82.53:4137 , piece_id=ECXIZWUTS74GBHYCX4XE4LQ2JW62IPD4MSPTRPY56OVQ4V6NCUPA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434759476 (339h54m36.865839607s) [noise=true , address=104.36.82.20:4437 , piece_id=C6M3EY75MHKIBSIEBMJYBSPYTWD4TGJHTZMIS6UEO46GYB365EEA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434769395 (339h54m36.865849526s) [noise=true , address=77.90.31.15:4718 , piece_id=KDZ2T3R53NEZVKC36A4EM7TF6D6QXCGANHDMIRNS44T64BOEZA6A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434986691 (339h54m36.866066822s) [noise=true , address=79.127.205.233:4626 , piece_id=IRSA47O7NJDKY2EMTGB6UAULT3LRRYV3OVGRBGQTHUGVRHAO4NEA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434998463 (339h54m36.866078584s) [noise=true , address=45.91.116.11:4121 , piece_id=B2NDK7WEUIOH3A6BYBTOXQHOBIB3ZV3SMZ2ETRSNJDX32GJ32MCQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435209347 (339h54m36.866289478s) [noise=true , address=77.90.31.11:4586 , piece_id=3QMZXTTAUNJMZQEJLA573CDPPEF4FB7CUZ7CE3NI42OL5SWLQC3A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435219115 (339h54m36.866299246s) [noise=true , address=77.90.31.12:4600 , piece_id=GOJIROS4T6IMZZGH6F3SLE4PP4S3B7ZS4B3SHT3SJNLV5JSF5RCQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435455839 (339h54m36.86653597s) [noise=true , address=104.36.82.23:4478 , piece_id=UHMGYRTWRIOFPNYICJY5NVLR7PHSGBDQETQDLMODL33KF3Y2KWPA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435483532 (339h54m36.866563663s) [noise=true , address=104.36.82.16:4308 , piece_id=X4PQE26B6OFZB7L3OCHLIATJEKESSALZKGEVSO3KI5X5666FMGOA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435675589 (339h54m36.86675571s) [noise=true , address=77.90.31.16:4751 , piece_id=ORRKT4T4JMG5UTN32H3R5WIRT2WEUPMG6WUSZXLXPUIAXXDA33ZA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435701669 (339h54m36.8667818s) [noise=true , address=156.146.43.225:4451 , piece_id=5MTT6Z2GROX24S5HQ7PVP7DLH4NK5HTVKE5YIJ6OVCAPYWIFQK4A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:43.595727203 (339h54m38.026807335s) [upload=353606]: Next returned nil segment
Aug 22 21:20:43.595746771 (339h54m38.026826902s) [upload=353606]: Waiting for error group managing segments...
Aug 22 21:20:43.919150323 (339h54m38.350230464s) [noise=true , address=79.127.205.235:4686 , piece_id=K633E5VYSX2DMIWIXGLNVTNDNCEQ4R4LY53SSIM5DN4NP6EKFWGA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:43.932648276 (339h54m38.363728407s) [noise=true , address=79.127.205.233:4626 , piece_id=IRSA47O7NJDKY2EMTGB6UAULT3LRRYV3OVGRBGQTHUGVRHAO4NEA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.377315397 (339h54m38.808395518s) [noise=true , address=156.146.43.225:4451 , piece_id=5MTT6Z2GROX24S5HQ7PVP7DLH4NK5HTVKE5YIJ6OVCAPYWIFQK4A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.383579872 (339h54m38.814660003s) [noise=true , address=104.36.82.6:4880 , piece_id=DFC6LZTRY46CKG4TNFFNYPI2OJJDAAPPSWRB6DBNPEWNXPMULK7A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.422279301 (339h54m38.853359432s) [noise=true , address=77.90.31.16:4751 , piece_id=ORRKT4T4JMG5UTN32H3R5WIRT2WEUPMG6WUSZXLXPUIAXXDA33ZA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.435490226 (339h54m38.866570357s) [noise=true , address=104.36.82.37:4666 , piece_id=XTTEU3CSFCH2UQLCS76EIUATMF5ITRLKOZM6EZSZBCGJKDQ5YEJA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.460618241 (339h54m38.891698372s) [noise=true , address=45.91.116.14:4202 , piece_id=LYWALWZKWGBTZD7MAXIFFBPAMEQNJV35R7XF5TKFD6XH6YNAORPQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.476455161 (339h54m38.907535292s) [noise=true , address=104.36.82.16:4308 , piece_id=X4PQE26B6OFZB7L3OCHLIATJEKESSALZKGEVSO3KI5X5666FMGOA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.495127012 (339h54m38.926207143s) [noise=true , address=104.36.82.53:4137 , piece_id=ECXIZWUTS74GBHYCX4XE4LQ2JW62IPD4MSPTRPY56OVQ4V6NCUPA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.506495423 (339h54m38.937575554s) [noise=true , address=104.36.82.20:4437 , piece_id=C6M3EY75MHKIBSIEBMJYBSPYTWD4TGJHTZMIS6UEO46GYB365EEA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.512446929 (339h54m38.94352705s) [noise=true , address=77.90.31.11:4586 , piece_id=3QMZXTTAUNJMZQEJLA573CDPPEF4FB7CUZ7CE3NI42OL5SWLQC3A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.519654187 (339h54m38.950734318s) [noise=true , address=77.90.31.12:4600 , piece_id=GOJIROS4T6IMZZGH6F3SLE4PP4S3B7ZS4B3SHT3SJNLV5JSF5RCQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.527938217 (339h54m38.959018338s) [noise=true , address=104.36.82.36:4636 , piece_id=IAURYTYJ2FHG2HEENLN64LD7HWERKMI6LC2PZRRJEK4B2ZN6G3PQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.534433162 (339h54m38.965513293s) [noise=true , address=45.91.116.11:4121 , piece_id=B2NDK7WEUIOH3A6BYBTOXQHOBIB3ZV3SMZ2ETRSNJDX32GJ32MCQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.534452830 (339h54m38.965532961s) [seg_pos={0 0}, upload=353606]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:20:44.534604391 (339h54m38.965684522s) [noise=true , address=77.90.31.15:4718 , piece_id=KDZ2T3R53NEZVKC36A4EM7TF6D6QXCGANHDMIRNS44T64BOEZA6A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P53pBJhZqd4Kn47H6UcmxkDSh11qKmUaMhKTk3bGBF4FbmgMC): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534710504 (339h54m38.965790635s) [noise=true , address=104.36.82.2:4749 , piece_id=XDLBSQWJTJV6BEEEJV643TCA2GNUHDMMMOU5IDCJWLLQ27UEXYFA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534749428 (339h54m38.965829559s) [noise=true , address=104.36.82.38:4692 , piece_id=2J4IEHVCH23ZJFWK3HFZS77E3WJMMHC6COB252OKSZOTQ43PN6WQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n3SDzXGgXbvYBGtLdND9oy93AHNFokRnF6Yv3EvoMC9UgN2H9): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534769106 (339h54m38.965849237s) [noise=true , address=104.36.82.23:4478 , piece_id=UHMGYRTWRIOFPNYICJY5NVLR7PHSGBDQETQDLMODL33KF3Y2KWPA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534788693 (339h54m38.965868824s) [seg_pos={0 0}, upload=353606]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:20:44.534876031 (339h54m38.965956172s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:20:44.534880820 (339h54m38.965960951s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:20:44.874750362 (339h54m39.305830493s) [upload=353606]: Done uploading segments...
Aug 22 21:20:44.874769319 (339h54m39.30584945s) [upload=353606]: Upload finished. err: <nil>
Duration: 6.488581584s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
8 out of 60 is failed (threshold=3) [..X...................X........XX.....X..X.X...........X....] duration:
2.096040405s
FAIL (2025-08-22 21:31:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:27:24.505293131 (340h1m18.936373252s) [upload=353721]: Starting upload Aug 22 21:27:24.505339489 (340h1m18.93641962s) [upload=353721]: Done starting upload Aug 22 21:27:24.505385868 (340h1m18.936465989s) [upload=353721]: Uploading segments... Aug 22 21:27:24.505419953 (340h1m18.936500084s) [upload=353721]: Got next segment. Inline: true Aug 22 21:27:24.505423720 (340h1m18.936503851s) [upload=353721]: Waiting for error group managing segments... Aug 22 21:27:24.505457025 (340h1m18.936537146s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:27:24.505461413 (340h1m18.936541544s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:27:24.505463928 (340h1m18.936544059s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:27:24.720733208 (340h1m19.151813339s) [upload=353721]: Done uploading segments... Aug 22 21:27:24.720749881 (340h1m19.151830012s) [upload=353721]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.096076535s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..........................X.........X........X.X............] duration:
6.158622311s
FAIL (2025-08-22 21:30:43 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 21:20:41.940826160 (339h54m36.371906331s) [upload=353606]: Starting upload
Aug 22 21:20:41.940939767 (339h54m36.372019898s) [upload=353606]: Done starting upload
Aug 22 21:20:41.941011484 (339h54m36.372091666s) [upload=353606]: Uploading segments...
Aug 22 21:20:41.941397202 (339h54m36.372477363s) [upload=353606]: Got next segment. Inline: false
Aug 22 21:20:41.941463879 (339h54m36.372544091s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:20:41.941472727 (339h54m36.372552878s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:20:42.433073260 (339h54m36.864153391s) [seg_pos={0 0}, upload=353606]: Begin upload segment...
Aug 22 21:20:42.433126461 (339h54m36.864206583s) [seg_pos={0 0}, upload=353606]: Done begin upload segment.
Aug 22 21:20:42.433152251 (339h54m36.864232382s) [noise=true , address=104.36.82.37:4666 , piece_id=XTTEU3CSFCH2UQLCS76EIUATMF5ITRLKOZM6EZSZBCGJKDQ5YEJA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.433246592 (339h54m36.864326783s) [noise=true , address=104.36.82.6:4880 , piece_id=DFC6LZTRY46CKG4TNFFNYPI2OJJDAAPPSWRB6DBNPEWNXPMULK7A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.433522941 (339h54m36.864603062s) [noise=true , address=104.36.82.36:4636 , piece_id=IAURYTYJ2FHG2HEENLN64LD7HWERKMI6LC2PZRRJEK4B2ZN6G3PQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.433834787 (339h54m36.864914918s) [noise=true , address=45.91.116.14:4202 , piece_id=LYWALWZKWGBTZD7MAXIFFBPAMEQNJV35R7XF5TKFD6XH6YNAORPQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434069686 (339h54m36.865149817s) [noise=true , address=79.127.205.235:4686 , piece_id=K633E5VYSX2DMIWIXGLNVTNDNCEQ4R4LY53SSIM5DN4NP6EKFWGA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434124801 (339h54m36.865204932s) [noise=true , address=104.36.82.2:4749 , piece_id=XDLBSQWJTJV6BEEEJV643TCA2GNUHDMMMOU5IDCJWLLQ27UEXYFA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434445465 (339h54m36.865525596s) [noise=true , address=104.36.82.38:4692 , piece_id=2J4IEHVCH23ZJFWK3HFZS77E3WJMMHC6COB252OKSZOTQ43PN6WQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434497254 (339h54m36.865577385s) [noise=true , address=104.36.82.53:4137 , piece_id=ECXIZWUTS74GBHYCX4XE4LQ2JW62IPD4MSPTRPY56OVQ4V6NCUPA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434759476 (339h54m36.865839607s) [noise=true , address=104.36.82.20:4437 , piece_id=C6M3EY75MHKIBSIEBMJYBSPYTWD4TGJHTZMIS6UEO46GYB365EEA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434769395 (339h54m36.865849526s) [noise=true , address=77.90.31.15:4718 , piece_id=KDZ2T3R53NEZVKC36A4EM7TF6D6QXCGANHDMIRNS44T64BOEZA6A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434986691 (339h54m36.866066822s) [noise=true , address=79.127.205.233:4626 , piece_id=IRSA47O7NJDKY2EMTGB6UAULT3LRRYV3OVGRBGQTHUGVRHAO4NEA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434998463 (339h54m36.866078584s) [noise=true , address=45.91.116.11:4121 , piece_id=B2NDK7WEUIOH3A6BYBTOXQHOBIB3ZV3SMZ2ETRSNJDX32GJ32MCQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435209347 (339h54m36.866289478s) [noise=true , address=77.90.31.11:4586 , piece_id=3QMZXTTAUNJMZQEJLA573CDPPEF4FB7CUZ7CE3NI42OL5SWLQC3A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435219115 (339h54m36.866299246s) [noise=true , address=77.90.31.12:4600 , piece_id=GOJIROS4T6IMZZGH6F3SLE4PP4S3B7ZS4B3SHT3SJNLV5JSF5RCQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435455839 (339h54m36.86653597s) [noise=true , address=104.36.82.23:4478 , piece_id=UHMGYRTWRIOFPNYICJY5NVLR7PHSGBDQETQDLMODL33KF3Y2KWPA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435483532 (339h54m36.866563663s) [noise=true , address=104.36.82.16:4308 , piece_id=X4PQE26B6OFZB7L3OCHLIATJEKESSALZKGEVSO3KI5X5666FMGOA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435675589 (339h54m36.86675571s) [noise=true , address=77.90.31.16:4751 , piece_id=ORRKT4T4JMG5UTN32H3R5WIRT2WEUPMG6WUSZXLXPUIAXXDA33ZA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435701669 (339h54m36.8667818s) [noise=true , address=156.146.43.225:4451 , piece_id=5MTT6Z2GROX24S5HQ7PVP7DLH4NK5HTVKE5YIJ6OVCAPYWIFQK4A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:43.595727203 (339h54m38.026807335s) [upload=353606]: Next returned nil segment
Aug 22 21:20:43.595746771 (339h54m38.026826902s) [upload=353606]: Waiting for error group managing segments...
Aug 22 21:20:43.919150323 (339h54m38.350230464s) [noise=true , address=79.127.205.235:4686 , piece_id=K633E5VYSX2DMIWIXGLNVTNDNCEQ4R4LY53SSIM5DN4NP6EKFWGA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:43.932648276 (339h54m38.363728407s) [noise=true , address=79.127.205.233:4626 , piece_id=IRSA47O7NJDKY2EMTGB6UAULT3LRRYV3OVGRBGQTHUGVRHAO4NEA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.377315397 (339h54m38.808395518s) [noise=true , address=156.146.43.225:4451 , piece_id=5MTT6Z2GROX24S5HQ7PVP7DLH4NK5HTVKE5YIJ6OVCAPYWIFQK4A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.383579872 (339h54m38.814660003s) [noise=true , address=104.36.82.6:4880 , piece_id=DFC6LZTRY46CKG4TNFFNYPI2OJJDAAPPSWRB6DBNPEWNXPMULK7A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.422279301 (339h54m38.853359432s) [noise=true , address=77.90.31.16:4751 , piece_id=ORRKT4T4JMG5UTN32H3R5WIRT2WEUPMG6WUSZXLXPUIAXXDA33ZA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.435490226 (339h54m38.866570357s) [noise=true , address=104.36.82.37:4666 , piece_id=XTTEU3CSFCH2UQLCS76EIUATMF5ITRLKOZM6EZSZBCGJKDQ5YEJA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.460618241 (339h54m38.891698372s) [noise=true , address=45.91.116.14:4202 , piece_id=LYWALWZKWGBTZD7MAXIFFBPAMEQNJV35R7XF5TKFD6XH6YNAORPQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.476455161 (339h54m38.907535292s) [noise=true , address=104.36.82.16:4308 , piece_id=X4PQE26B6OFZB7L3OCHLIATJEKESSALZKGEVSO3KI5X5666FMGOA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.495127012 (339h54m38.926207143s) [noise=true , address=104.36.82.53:4137 , piece_id=ECXIZWUTS74GBHYCX4XE4LQ2JW62IPD4MSPTRPY56OVQ4V6NCUPA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.506495423 (339h54m38.937575554s) [noise=true , address=104.36.82.20:4437 , piece_id=C6M3EY75MHKIBSIEBMJYBSPYTWD4TGJHTZMIS6UEO46GYB365EEA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.512446929 (339h54m38.94352705s) [noise=true , address=77.90.31.11:4586 , piece_id=3QMZXTTAUNJMZQEJLA573CDPPEF4FB7CUZ7CE3NI42OL5SWLQC3A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.519654187 (339h54m38.950734318s) [noise=true , address=77.90.31.12:4600 , piece_id=GOJIROS4T6IMZZGH6F3SLE4PP4S3B7ZS4B3SHT3SJNLV5JSF5RCQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.527938217 (339h54m38.959018338s) [noise=true , address=104.36.82.36:4636 , piece_id=IAURYTYJ2FHG2HEENLN64LD7HWERKMI6LC2PZRRJEK4B2ZN6G3PQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.534433162 (339h54m38.965513293s) [noise=true , address=45.91.116.11:4121 , piece_id=B2NDK7WEUIOH3A6BYBTOXQHOBIB3ZV3SMZ2ETRSNJDX32GJ32MCQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.534452830 (339h54m38.965532961s) [seg_pos={0 0}, upload=353606]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:20:44.534604391 (339h54m38.965684522s) [noise=true , address=77.90.31.15:4718 , piece_id=KDZ2T3R53NEZVKC36A4EM7TF6D6QXCGANHDMIRNS44T64BOEZA6A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P53pBJhZqd4Kn47H6UcmxkDSh11qKmUaMhKTk3bGBF4FbmgMC): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534710504 (339h54m38.965790635s) [noise=true , address=104.36.82.2:4749 , piece_id=XDLBSQWJTJV6BEEEJV643TCA2GNUHDMMMOU5IDCJWLLQ27UEXYFA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534749428 (339h54m38.965829559s) [noise=true , address=104.36.82.38:4692 , piece_id=2J4IEHVCH23ZJFWK3HFZS77E3WJMMHC6COB252OKSZOTQ43PN6WQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n3SDzXGgXbvYBGtLdND9oy93AHNFokRnF6Yv3EvoMC9UgN2H9): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534769106 (339h54m38.965849237s) [noise=true , address=104.36.82.23:4478 , piece_id=UHMGYRTWRIOFPNYICJY5NVLR7PHSGBDQETQDLMODL33KF3Y2KWPA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534788693 (339h54m38.965868824s) [seg_pos={0 0}, upload=353606]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:20:44.534876031 (339h54m38.965956172s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:20:44.534880820 (339h54m38.965960951s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:20:44.874750362 (339h54m39.305830493s) [upload=353606]: Done uploading segments...
Aug 22 21:20:44.874769319 (339h54m39.30584945s) [upload=353606]: Upload finished. err: <nil>
Duration: 6.158649273s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
8 out of 60 is failed (threshold=3) [...X...................X........XX.....X..X.X...........X...] duration:
1.961196304s
FAIL (2025-08-22 21:30:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:27:24.505293131 (340h1m18.936373252s) [upload=353721]: Starting upload Aug 22 21:27:24.505339489 (340h1m18.93641962s) [upload=353721]: Done starting upload Aug 22 21:27:24.505385868 (340h1m18.936465989s) [upload=353721]: Uploading segments... Aug 22 21:27:24.505419953 (340h1m18.936500084s) [upload=353721]: Got next segment. Inline: true Aug 22 21:27:24.505423720 (340h1m18.936503851s) [upload=353721]: Waiting for error group managing segments... Aug 22 21:27:24.505457025 (340h1m18.936537146s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:27:24.505461413 (340h1m18.936541544s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:27:24.505463928 (340h1m18.936544059s) [upload=353721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:27:24.720733208 (340h1m19.151813339s) [upload=353721]: Done uploading segments... Aug 22 21:27:24.720749881 (340h1m19.151830012s) [upload=353721]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.961233204s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...........................X.........X........X.X...........] duration:
5.935405564s
FAIL (2025-08-22 21:29:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 21:20:41.940826160 (339h54m36.371906331s) [upload=353606]: Starting upload
Aug 22 21:20:41.940939767 (339h54m36.372019898s) [upload=353606]: Done starting upload
Aug 22 21:20:41.941011484 (339h54m36.372091666s) [upload=353606]: Uploading segments...
Aug 22 21:20:41.941397202 (339h54m36.372477363s) [upload=353606]: Got next segment. Inline: false
Aug 22 21:20:41.941463879 (339h54m36.372544091s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:20:41.941472727 (339h54m36.372552878s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:20:42.433073260 (339h54m36.864153391s) [seg_pos={0 0}, upload=353606]: Begin upload segment...
Aug 22 21:20:42.433126461 (339h54m36.864206583s) [seg_pos={0 0}, upload=353606]: Done begin upload segment.
Aug 22 21:20:42.433152251 (339h54m36.864232382s) [noise=true , address=104.36.82.37:4666 , piece_id=XTTEU3CSFCH2UQLCS76EIUATMF5ITRLKOZM6EZSZBCGJKDQ5YEJA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.433246592 (339h54m36.864326783s) [noise=true , address=104.36.82.6:4880 , piece_id=DFC6LZTRY46CKG4TNFFNYPI2OJJDAAPPSWRB6DBNPEWNXPMULK7A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.433522941 (339h54m36.864603062s) [noise=true , address=104.36.82.36:4636 , piece_id=IAURYTYJ2FHG2HEENLN64LD7HWERKMI6LC2PZRRJEK4B2ZN6G3PQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.433834787 (339h54m36.864914918s) [noise=true , address=45.91.116.14:4202 , piece_id=LYWALWZKWGBTZD7MAXIFFBPAMEQNJV35R7XF5TKFD6XH6YNAORPQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434069686 (339h54m36.865149817s) [noise=true , address=79.127.205.235:4686 , piece_id=K633E5VYSX2DMIWIXGLNVTNDNCEQ4R4LY53SSIM5DN4NP6EKFWGA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434124801 (339h54m36.865204932s) [noise=true , address=104.36.82.2:4749 , piece_id=XDLBSQWJTJV6BEEEJV643TCA2GNUHDMMMOU5IDCJWLLQ27UEXYFA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434445465 (339h54m36.865525596s) [noise=true , address=104.36.82.38:4692 , piece_id=2J4IEHVCH23ZJFWK3HFZS77E3WJMMHC6COB252OKSZOTQ43PN6WQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434497254 (339h54m36.865577385s) [noise=true , address=104.36.82.53:4137 , piece_id=ECXIZWUTS74GBHYCX4XE4LQ2JW62IPD4MSPTRPY56OVQ4V6NCUPA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434759476 (339h54m36.865839607s) [noise=true , address=104.36.82.20:4437 , piece_id=C6M3EY75MHKIBSIEBMJYBSPYTWD4TGJHTZMIS6UEO46GYB365EEA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434769395 (339h54m36.865849526s) [noise=true , address=77.90.31.15:4718 , piece_id=KDZ2T3R53NEZVKC36A4EM7TF6D6QXCGANHDMIRNS44T64BOEZA6A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434986691 (339h54m36.866066822s) [noise=true , address=79.127.205.233:4626 , piece_id=IRSA47O7NJDKY2EMTGB6UAULT3LRRYV3OVGRBGQTHUGVRHAO4NEA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.434998463 (339h54m36.866078584s) [noise=true , address=45.91.116.11:4121 , piece_id=B2NDK7WEUIOH3A6BYBTOXQHOBIB3ZV3SMZ2ETRSNJDX32GJ32MCQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435209347 (339h54m36.866289478s) [noise=true , address=77.90.31.11:4586 , piece_id=3QMZXTTAUNJMZQEJLA573CDPPEF4FB7CUZ7CE3NI42OL5SWLQC3A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435219115 (339h54m36.866299246s) [noise=true , address=77.90.31.12:4600 , piece_id=GOJIROS4T6IMZZGH6F3SLE4PP4S3B7ZS4B3SHT3SJNLV5JSF5RCQ, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435455839 (339h54m36.86653597s) [noise=true , address=104.36.82.23:4478 , piece_id=UHMGYRTWRIOFPNYICJY5NVLR7PHSGBDQETQDLMODL33KF3Y2KWPA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435483532 (339h54m36.866563663s) [noise=true , address=104.36.82.16:4308 , piece_id=X4PQE26B6OFZB7L3OCHLIATJEKESSALZKGEVSO3KI5X5666FMGOA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435675589 (339h54m36.86675571s) [noise=true , address=77.90.31.16:4751 , piece_id=ORRKT4T4JMG5UTN32H3R5WIRT2WEUPMG6WUSZXLXPUIAXXDA33ZA, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:42.435701669 (339h54m36.8667818s) [noise=true , address=156.146.43.225:4451 , piece_id=5MTT6Z2GROX24S5HQ7PVP7DLH4NK5HTVKE5YIJ6OVCAPYWIFQK4A, seg_pos={0 0}, upload=353606]: Uploading piece...
Aug 22 21:20:43.595727203 (339h54m38.026807335s) [upload=353606]: Next returned nil segment
Aug 22 21:20:43.595746771 (339h54m38.026826902s) [upload=353606]: Waiting for error group managing segments...
Aug 22 21:20:43.919150323 (339h54m38.350230464s) [noise=true , address=79.127.205.235:4686 , piece_id=K633E5VYSX2DMIWIXGLNVTNDNCEQ4R4LY53SSIM5DN4NP6EKFWGA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:43.932648276 (339h54m38.363728407s) [noise=true , address=79.127.205.233:4626 , piece_id=IRSA47O7NJDKY2EMTGB6UAULT3LRRYV3OVGRBGQTHUGVRHAO4NEA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.377315397 (339h54m38.808395518s) [noise=true , address=156.146.43.225:4451 , piece_id=5MTT6Z2GROX24S5HQ7PVP7DLH4NK5HTVKE5YIJ6OVCAPYWIFQK4A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.383579872 (339h54m38.814660003s) [noise=true , address=104.36.82.6:4880 , piece_id=DFC6LZTRY46CKG4TNFFNYPI2OJJDAAPPSWRB6DBNPEWNXPMULK7A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.422279301 (339h54m38.853359432s) [noise=true , address=77.90.31.16:4751 , piece_id=ORRKT4T4JMG5UTN32H3R5WIRT2WEUPMG6WUSZXLXPUIAXXDA33ZA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.435490226 (339h54m38.866570357s) [noise=true , address=104.36.82.37:4666 , piece_id=XTTEU3CSFCH2UQLCS76EIUATMF5ITRLKOZM6EZSZBCGJKDQ5YEJA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.460618241 (339h54m38.891698372s) [noise=true , address=45.91.116.14:4202 , piece_id=LYWALWZKWGBTZD7MAXIFFBPAMEQNJV35R7XF5TKFD6XH6YNAORPQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.476455161 (339h54m38.907535292s) [noise=true , address=104.36.82.16:4308 , piece_id=X4PQE26B6OFZB7L3OCHLIATJEKESSALZKGEVSO3KI5X5666FMGOA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.495127012 (339h54m38.926207143s) [noise=true , address=104.36.82.53:4137 , piece_id=ECXIZWUTS74GBHYCX4XE4LQ2JW62IPD4MSPTRPY56OVQ4V6NCUPA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.506495423 (339h54m38.937575554s) [noise=true , address=104.36.82.20:4437 , piece_id=C6M3EY75MHKIBSIEBMJYBSPYTWD4TGJHTZMIS6UEO46GYB365EEA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.512446929 (339h54m38.94352705s) [noise=true , address=77.90.31.11:4586 , piece_id=3QMZXTTAUNJMZQEJLA573CDPPEF4FB7CUZ7CE3NI42OL5SWLQC3A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.519654187 (339h54m38.950734318s) [noise=true , address=77.90.31.12:4600 , piece_id=GOJIROS4T6IMZZGH6F3SLE4PP4S3B7ZS4B3SHT3SJNLV5JSF5RCQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.527938217 (339h54m38.959018338s) [noise=true , address=104.36.82.36:4636 , piece_id=IAURYTYJ2FHG2HEENLN64LD7HWERKMI6LC2PZRRJEK4B2ZN6G3PQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.534433162 (339h54m38.965513293s) [noise=true , address=45.91.116.11:4121 , piece_id=B2NDK7WEUIOH3A6BYBTOXQHOBIB3ZV3SMZ2ETRSNJDX32GJ32MCQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: <nil>
Aug 22 21:20:44.534452830 (339h54m38.965532961s) [seg_pos={0 0}, upload=353606]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:20:44.534604391 (339h54m38.965684522s) [noise=true , address=77.90.31.15:4718 , piece_id=KDZ2T3R53NEZVKC36A4EM7TF6D6QXCGANHDMIRNS44T64BOEZA6A, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P53pBJhZqd4Kn47H6UcmxkDSh11qKmUaMhKTk3bGBF4FbmgMC): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534710504 (339h54m38.965790635s) [noise=true , address=104.36.82.2:4749 , piece_id=XDLBSQWJTJV6BEEEJV643TCA2GNUHDMMMOU5IDCJWLLQ27UEXYFA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534749428 (339h54m38.965829559s) [noise=true , address=104.36.82.38:4692 , piece_id=2J4IEHVCH23ZJFWK3HFZS77E3WJMMHC6COB252OKSZOTQ43PN6WQ, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n3SDzXGgXbvYBGtLdND9oy93AHNFokRnF6Yv3EvoMC9UgN2H9): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534769106 (339h54m38.965849237s) [noise=true , address=104.36.82.23:4478 , piece_id=UHMGYRTWRIOFPNYICJY5NVLR7PHSGBDQETQDLMODL33KF3Y2KWPA, seg_pos={0 0}, upload=353606]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 22 21:20:44.534788693 (339h54m38.965868824s) [seg_pos={0 0}, upload=353606]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:20:44.534876031 (339h54m38.965956172s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:20:44.534880820 (339h54m38.965960951s) [upload=353606]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:20:44.874750362 (339h54m39.305830493s) [upload=353606]: Done uploading segments...
Aug 22 21:20:44.874769319 (339h54m39.30584945s) [upload=353606]: Upload finished. err: <nil>
Duration: 5.935436882s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|