Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....................X............X.................X..X....] duration:
6.600954825s
FAIL (2025-08-12 15:07:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 15:04:11.665990528 (93h38m6.097070659s) [upload=97539]: Starting upload
Aug 12 15:04:11.666030615 (93h38m6.097110746s) [upload=97539]: Done starting upload
Aug 12 15:04:11.666118292 (93h38m6.097198423s) [upload=97539]: Uploading segments...
Aug 12 15:04:11.666208154 (93h38m6.097288285s) [upload=97539]: Got next segment. Inline: false
Aug 12 15:04:11.666248711 (93h38m6.097328842s) [upload=97539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:04:11.666262328 (93h38m6.097342459s) [upload=97539]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:04:12.115380687 (93h38m6.546460818s) [seg_pos={0 0}, upload=97539]: Begin upload segment...
Aug 12 15:04:12.115437445 (93h38m6.546517577s) [seg_pos={0 0}, upload=97539]: Done begin upload segment.
Aug 12 15:04:12.115470660 (93h38m6.546550821s) [noise=true , address=104.36.82.17:4339 , piece_id=4TG2TYDJRSUW6DUB6L4GGC3SHIS7JZFU2D3LISOTDJULEJY7OITA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.115532528 (93h38m6.546612659s) [noise=true , address=104.36.82.37:4683 , piece_id=DQMJUTVPQSNZHZRM7MXIWTGP3CDCOSHUVVFMWJLKIJ7E4JEQGRSA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116051441 (93h38m6.547131572s) [noise=true , address=104.36.82.34:4559 , piece_id=VRS37NRIN2O3IGO4MRR675YAU7SNATURCF6IMJRPTVFWRF4XCIGA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116154307 (93h38m6.547234438s) [noise=true , address=104.36.82.16:4299 , piece_id=4S2N5PJ5GFL7WBH5XRYG7BWJKHLREVLZS4T3M4MXBFR4ORFUGZKA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116344862 (93h38m6.547424993s) [noise=true , address=104.36.82.44:4871 , piece_id=AEKFB3DFKC2XUM7EAZPDQXMWJRLSOSRBZM54M6HDFX5EZ5ABBHYQ, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116597755 (93h38m6.547677886s) [noise=true , address=104.36.82.58:4297 , piece_id=EUCQ5BPBXGUBHEPMJFV3EAQG4NTEIKIN4TDH7MAMGG4ZTJ3SFV2Q, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116760577 (93h38m6.547840708s) [noise=true , address=45.91.116.14:4221 , piece_id=QPNRJZ4VHFJ7LPTQEWWLBOUQ7E7MLOYCCXC672WEEHR7VSCAMNYQ, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116831653 (93h38m6.547911784s) [noise=true , address=104.36.82.59:4332 , piece_id=BS5RN6JER5QD5OH4AODEM5HMD55DAJENLRBUWR4TVJECHYBWFOPA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117065872 (93h38m6.548146003s) [noise=true , address=79.127.220.101:4066 , piece_id=43V5U5NLZHEW5WGZQEBM443JDJKAVUD7STBUYRTIMB3HJKPYMDXA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117202232 (93h38m6.548282363s) [noise=true , address=104.36.82.23:4459 , piece_id=ZPKWXOP7FQHM5RTA3AKYRAGYWK6XNAOHWTKAWKD7ZECUDSIDGWTA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117311862 (93h38m6.548392003s) [noise=true , address=104.36.82.3:4785 , piece_id=QVTNW3AGAU6EIS4NCFDBP2AXOWLKVTG7ZWXCPRZ5KJJZZDAPLSUA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117595355 (93h38m6.548675476s) [noise=true , address=104.36.82.60:4347 , piece_id=SKPCL3M4DIV6WQX76OS26CPH2AVUURJZH5HH4MQCE4MGDFOZMYQQ, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117602127 (93h38m6.548682259s) [noise=true , address=64.49.13.139:4469 , piece_id=BW34W6DNM6CVNFCFOQXYRDLPDVBM3JTLF6H2X2EDPJNANBN2Z2TA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117986022 (93h38m6.549066153s) [noise=true , address=66.23.193.175:4555 , piece_id=LVH76KSGCP2DYR46SYNIAQJKJVNPB3MHJPD23S6O57HAXMSWMWUQ, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.118036288 (93h38m6.549116419s) [noise=true , address=104.36.82.47:4542 , piece_id=H3JHJVKQARKVYDTZ436UGKE76TS2C4ADZ2DJON3VJRD4GHLPT26Q, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.118233365 (93h38m6.549313496s) [noise=true , address=104.36.82.36:4632 , piece_id=PCKWOXRJZP34Z6XXCCRKT4MZNMUEUEXAJYYUXPXSLADTM7NA3S3Q, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.118335010 (93h38m6.549415141s) [noise=true , address=104.36.82.62:4441 , piece_id=KQHSNYZQXADUUY5EPY53WC2NIT4SN2JMQTXAJLJUVBJBRZ7GJGYQ, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.118629984 (93h38m6.549710115s) [noise=true , address=64.49.13.140:4513 , piece_id=UEYTYUQHVSXWHFXOT7S3IKT32GMSC3GMMJNIFX3YLFGQ3DBWUBWA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:13.204852475 (93h38m7.635932606s) [upload=97539]: Next returned nil segment
Aug 12 15:04:13.204867503 (93h38m7.635947624s) [upload=97539]: Waiting for error group managing segments...
Aug 12 15:04:13.509271413 (93h38m7.940351544s) [noise=true , address=66.23.193.175:4555 , piece_id=LVH76KSGCP2DYR46SYNIAQJKJVNPB3MHJPD23S6O57HAXMSWMWUQ, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:13.511884514 (93h38m7.942964635s) [noise=true , address=64.49.13.139:4469 , piece_id=BW34W6DNM6CVNFCFOQXYRDLPDVBM3JTLF6H2X2EDPJNANBN2Z2TA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:13.523389196 (93h38m7.954469327s) [noise=true , address=64.49.13.140:4513 , piece_id=UEYTYUQHVSXWHFXOT7S3IKT32GMSC3GMMJNIFX3YLFGQ3DBWUBWA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.084352774 (93h38m8.515432905s) [noise=true , address=104.36.82.23:4459 , piece_id=ZPKWXOP7FQHM5RTA3AKYRAGYWK6XNAOHWTKAWKD7ZECUDSIDGWTA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.088640538 (93h38m8.519720669s) [noise=true , address=45.91.116.14:4221 , piece_id=QPNRJZ4VHFJ7LPTQEWWLBOUQ7E7MLOYCCXC672WEEHR7VSCAMNYQ, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.126663759 (93h38m8.55774393s) [noise=true , address=104.36.82.37:4683 , piece_id=DQMJUTVPQSNZHZRM7MXIWTGP3CDCOSHUVVFMWJLKIJ7E4JEQGRSA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.139981460 (93h38m8.571061591s) [noise=true , address=104.36.82.16:4299 , piece_id=4S2N5PJ5GFL7WBH5XRYG7BWJKHLREVLZS4T3M4MXBFR4ORFUGZKA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.174526156 (93h38m8.605606287s) [noise=true , address=104.36.82.36:4632 , piece_id=PCKWOXRJZP34Z6XXCCRKT4MZNMUEUEXAJYYUXPXSLADTM7NA3S3Q, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.185237671 (93h38m8.616317802s) [noise=true , address=104.36.82.3:4785 , piece_id=QVTNW3AGAU6EIS4NCFDBP2AXOWLKVTG7ZWXCPRZ5KJJZZDAPLSUA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.187994166 (93h38m8.619074297s) [noise=true , address=104.36.82.59:4332 , piece_id=BS5RN6JER5QD5OH4AODEM5HMD55DAJENLRBUWR4TVJECHYBWFOPA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.243876298 (93h38m8.674956429s) [noise=true , address=104.36.82.58:4297 , piece_id=EUCQ5BPBXGUBHEPMJFV3EAQG4NTEIKIN4TDH7MAMGG4ZTJ3SFV2Q, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.248478533 (93h38m8.679558654s) [noise=true , address=104.36.82.44:4871 , piece_id=AEKFB3DFKC2XUM7EAZPDQXMWJRLSOSRBZM54M6HDFX5EZ5ABBHYQ, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.357504968 (93h38m8.788585119s) [noise=true , address=104.36.82.17:4339 , piece_id=4TG2TYDJRSUW6DUB6L4GGC3SHIS7JZFU2D3LISOTDJULEJY7OITA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.395476942 (93h38m8.826557073s) [noise=true , address=104.36.82.60:4347 , piece_id=SKPCL3M4DIV6WQX76OS26CPH2AVUURJZH5HH4MQCE4MGDFOZMYQQ, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.395502020 (93h38m8.826582151s) [seg_pos={0 0}, upload=97539]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:04:14.395594207 (93h38m8.826674338s) [noise=true , address=104.36.82.62:4441 , piece_id=KQHSNYZQXADUUY5EPY53WC2NIT4SN2JMQTXAJLJUVBJBRZ7GJGYQ, seg_pos={0 0}, upload=97539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VBayWisMK1n3cwypeiLzGuffonBTzYga7thAZ8pSqrusc7kow): protocol: expected piece hash; context canceled; EOF
Aug 12 15:04:14.395661976 (93h38m8.826742107s) [noise=true , address=79.127.220.101:4066 , piece_id=43V5U5NLZHEW5WGZQEBM443JDJKAVUD7STBUYRTIMB3HJKPYMDXA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF
Aug 12 15:04:14.395740116 (93h38m8.826820237s) [noise=true , address=104.36.82.47:4542 , piece_id=H3JHJVKQARKVYDTZ436UGKE76TS2C4ADZ2DJON3VJRD4GHLPT26Q, seg_pos={0 0}, upload=97539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FwaCA1FbzJbmRNzhQeVgygicJYHWkSS9fLnJbAG7KZPpokLU): protocol: write tcp 188.166.225.170:46732->104.36.82.47:4542: use of closed network connection; write tcp 188.166.225.170:46732->104.36.82.47:4542: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46732->104.36.82.47:4542: use of closed network connection
Aug 12 15:04:14.395764242 (93h38m8.826844373s) [noise=true , address=104.36.82.34:4559 , piece_id=VRS37NRIN2O3IGO4MRR675YAU7SNATURCF6IMJRPTVFWRF4XCIGA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXGQfMeXYCUuSh5TUe8pTwwd19wn68r9buS11N8aJdx6vZysf): protocol: write tcp 188.166.225.170:41088->104.36.82.34:4559: use of closed network connection; write tcp 188.166.225.170:41088->104.36.82.34:4559: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41088->104.36.82.34:4559: use of closed network connection
Aug 12 15:04:14.395779110 (93h38m8.826859241s) [seg_pos={0 0}, upload=97539]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:04:14.395833965 (93h38m8.826914096s) [upload=97539]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:04:14.395837753 (93h38m8.826917884s) [upload=97539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:04:14.700910913 (93h38m9.131991044s) [upload=97539]: Done uploading segments...
Aug 12 15:04:14.700930431 (93h38m9.132010562s) [upload=97539]: Upload finished. err: <nil>
Duration: 6.600981756s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................................X..X......] duration:
2.096434154s
FAIL (2025-08-12 15:07:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 4e74452dc4a6cbb84c19c38ae09de2a14792ba0455f3fd49dd4b09585d5db40d != before 1807f36a3be378809fe937cebf225cac8f9699b81a1e5d17f82d72ac39a6a1a7 ======LOGS====== Aug 12 15:02:01.334418071 (93h35m55.765498202s) [upload=97502]: Starting upload Aug 12 15:02:01.334498996 (93h35m55.765579127s) [upload=97502]: Done starting upload Aug 12 15:02:01.334566566 (93h35m55.765646697s) [upload=97502]: Uploading segments... Aug 12 15:02:01.334618995 (93h35m55.765699126s) [upload=97502]: Got next segment. Inline: true Aug 12 15:02:01.334623204 (93h35m55.765703335s) [upload=97502]: Waiting for error group managing segments... Aug 12 15:02:01.334658531 (93h35m55.765738662s) [upload=97502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 15:02:01.334662258 (93h35m55.765742389s) [upload=97502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 15:02:01.334664613 (93h35m55.765744734s) [upload=97502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 15:02:01.612866971 (93h35m56.043947102s) [upload=97502]: Done uploading segments... Aug 12 15:02:01.612886870 (93h35m56.043967001s) [upload=97502]: Upload finished. err: <nil>
Duration: 2.096459382s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................................X..X.....] duration:
1.975595249s
FAIL (2025-08-12 15:06:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 4e74452dc4a6cbb84c19c38ae09de2a14792ba0455f3fd49dd4b09585d5db40d != before 1807f36a3be378809fe937cebf225cac8f9699b81a1e5d17f82d72ac39a6a1a7 ======LOGS====== Aug 12 15:02:01.334418071 (93h35m55.765498202s) [upload=97502]: Starting upload Aug 12 15:02:01.334498996 (93h35m55.765579127s) [upload=97502]: Done starting upload Aug 12 15:02:01.334566566 (93h35m55.765646697s) [upload=97502]: Uploading segments... Aug 12 15:02:01.334618995 (93h35m55.765699126s) [upload=97502]: Got next segment. Inline: true Aug 12 15:02:01.334623204 (93h35m55.765703335s) [upload=97502]: Waiting for error group managing segments... Aug 12 15:02:01.334658531 (93h35m55.765738662s) [upload=97502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 15:02:01.334662258 (93h35m55.765742389s) [upload=97502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 15:02:01.334664613 (93h35m55.765744734s) [upload=97502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 15:02:01.612866971 (93h35m56.043947102s) [upload=97502]: Done uploading segments... Aug 12 15:02:01.612886870 (93h35m56.043967001s) [upload=97502]: Upload finished. err: <nil>
Duration: 1.975667266s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......................X............X.................X..X...] duration:
5.835550976s
FAIL (2025-08-12 15:06:32 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 15:04:11.665990528 (93h38m6.097070659s) [upload=97539]: Starting upload
Aug 12 15:04:11.666030615 (93h38m6.097110746s) [upload=97539]: Done starting upload
Aug 12 15:04:11.666118292 (93h38m6.097198423s) [upload=97539]: Uploading segments...
Aug 12 15:04:11.666208154 (93h38m6.097288285s) [upload=97539]: Got next segment. Inline: false
Aug 12 15:04:11.666248711 (93h38m6.097328842s) [upload=97539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:04:11.666262328 (93h38m6.097342459s) [upload=97539]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:04:12.115380687 (93h38m6.546460818s) [seg_pos={0 0}, upload=97539]: Begin upload segment...
Aug 12 15:04:12.115437445 (93h38m6.546517577s) [seg_pos={0 0}, upload=97539]: Done begin upload segment.
Aug 12 15:04:12.115470660 (93h38m6.546550821s) [noise=true , address=104.36.82.17:4339 , piece_id=4TG2TYDJRSUW6DUB6L4GGC3SHIS7JZFU2D3LISOTDJULEJY7OITA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.115532528 (93h38m6.546612659s) [noise=true , address=104.36.82.37:4683 , piece_id=DQMJUTVPQSNZHZRM7MXIWTGP3CDCOSHUVVFMWJLKIJ7E4JEQGRSA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116051441 (93h38m6.547131572s) [noise=true , address=104.36.82.34:4559 , piece_id=VRS37NRIN2O3IGO4MRR675YAU7SNATURCF6IMJRPTVFWRF4XCIGA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116154307 (93h38m6.547234438s) [noise=true , address=104.36.82.16:4299 , piece_id=4S2N5PJ5GFL7WBH5XRYG7BWJKHLREVLZS4T3M4MXBFR4ORFUGZKA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116344862 (93h38m6.547424993s) [noise=true , address=104.36.82.44:4871 , piece_id=AEKFB3DFKC2XUM7EAZPDQXMWJRLSOSRBZM54M6HDFX5EZ5ABBHYQ, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116597755 (93h38m6.547677886s) [noise=true , address=104.36.82.58:4297 , piece_id=EUCQ5BPBXGUBHEPMJFV3EAQG4NTEIKIN4TDH7MAMGG4ZTJ3SFV2Q, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116760577 (93h38m6.547840708s) [noise=true , address=45.91.116.14:4221 , piece_id=QPNRJZ4VHFJ7LPTQEWWLBOUQ7E7MLOYCCXC672WEEHR7VSCAMNYQ, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116831653 (93h38m6.547911784s) [noise=true , address=104.36.82.59:4332 , piece_id=BS5RN6JER5QD5OH4AODEM5HMD55DAJENLRBUWR4TVJECHYBWFOPA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117065872 (93h38m6.548146003s) [noise=true , address=79.127.220.101:4066 , piece_id=43V5U5NLZHEW5WGZQEBM443JDJKAVUD7STBUYRTIMB3HJKPYMDXA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117202232 (93h38m6.548282363s) [noise=true , address=104.36.82.23:4459 , piece_id=ZPKWXOP7FQHM5RTA3AKYRAGYWK6XNAOHWTKAWKD7ZECUDSIDGWTA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117311862 (93h38m6.548392003s) [noise=true , address=104.36.82.3:4785 , piece_id=QVTNW3AGAU6EIS4NCFDBP2AXOWLKVTG7ZWXCPRZ5KJJZZDAPLSUA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117595355 (93h38m6.548675476s) [noise=true , address=104.36.82.60:4347 , piece_id=SKPCL3M4DIV6WQX76OS26CPH2AVUURJZH5HH4MQCE4MGDFOZMYQQ, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117602127 (93h38m6.548682259s) [noise=true , address=64.49.13.139:4469 , piece_id=BW34W6DNM6CVNFCFOQXYRDLPDVBM3JTLF6H2X2EDPJNANBN2Z2TA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117986022 (93h38m6.549066153s) [noise=true , address=66.23.193.175:4555 , piece_id=LVH76KSGCP2DYR46SYNIAQJKJVNPB3MHJPD23S6O57HAXMSWMWUQ, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.118036288 (93h38m6.549116419s) [noise=true , address=104.36.82.47:4542 , piece_id=H3JHJVKQARKVYDTZ436UGKE76TS2C4ADZ2DJON3VJRD4GHLPT26Q, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.118233365 (93h38m6.549313496s) [noise=true , address=104.36.82.36:4632 , piece_id=PCKWOXRJZP34Z6XXCCRKT4MZNMUEUEXAJYYUXPXSLADTM7NA3S3Q, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.118335010 (93h38m6.549415141s) [noise=true , address=104.36.82.62:4441 , piece_id=KQHSNYZQXADUUY5EPY53WC2NIT4SN2JMQTXAJLJUVBJBRZ7GJGYQ, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.118629984 (93h38m6.549710115s) [noise=true , address=64.49.13.140:4513 , piece_id=UEYTYUQHVSXWHFXOT7S3IKT32GMSC3GMMJNIFX3YLFGQ3DBWUBWA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:13.204852475 (93h38m7.635932606s) [upload=97539]: Next returned nil segment
Aug 12 15:04:13.204867503 (93h38m7.635947624s) [upload=97539]: Waiting for error group managing segments...
Aug 12 15:04:13.509271413 (93h38m7.940351544s) [noise=true , address=66.23.193.175:4555 , piece_id=LVH76KSGCP2DYR46SYNIAQJKJVNPB3MHJPD23S6O57HAXMSWMWUQ, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:13.511884514 (93h38m7.942964635s) [noise=true , address=64.49.13.139:4469 , piece_id=BW34W6DNM6CVNFCFOQXYRDLPDVBM3JTLF6H2X2EDPJNANBN2Z2TA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:13.523389196 (93h38m7.954469327s) [noise=true , address=64.49.13.140:4513 , piece_id=UEYTYUQHVSXWHFXOT7S3IKT32GMSC3GMMJNIFX3YLFGQ3DBWUBWA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.084352774 (93h38m8.515432905s) [noise=true , address=104.36.82.23:4459 , piece_id=ZPKWXOP7FQHM5RTA3AKYRAGYWK6XNAOHWTKAWKD7ZECUDSIDGWTA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.088640538 (93h38m8.519720669s) [noise=true , address=45.91.116.14:4221 , piece_id=QPNRJZ4VHFJ7LPTQEWWLBOUQ7E7MLOYCCXC672WEEHR7VSCAMNYQ, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.126663759 (93h38m8.55774393s) [noise=true , address=104.36.82.37:4683 , piece_id=DQMJUTVPQSNZHZRM7MXIWTGP3CDCOSHUVVFMWJLKIJ7E4JEQGRSA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.139981460 (93h38m8.571061591s) [noise=true , address=104.36.82.16:4299 , piece_id=4S2N5PJ5GFL7WBH5XRYG7BWJKHLREVLZS4T3M4MXBFR4ORFUGZKA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.174526156 (93h38m8.605606287s) [noise=true , address=104.36.82.36:4632 , piece_id=PCKWOXRJZP34Z6XXCCRKT4MZNMUEUEXAJYYUXPXSLADTM7NA3S3Q, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.185237671 (93h38m8.616317802s) [noise=true , address=104.36.82.3:4785 , piece_id=QVTNW3AGAU6EIS4NCFDBP2AXOWLKVTG7ZWXCPRZ5KJJZZDAPLSUA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.187994166 (93h38m8.619074297s) [noise=true , address=104.36.82.59:4332 , piece_id=BS5RN6JER5QD5OH4AODEM5HMD55DAJENLRBUWR4TVJECHYBWFOPA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.243876298 (93h38m8.674956429s) [noise=true , address=104.36.82.58:4297 , piece_id=EUCQ5BPBXGUBHEPMJFV3EAQG4NTEIKIN4TDH7MAMGG4ZTJ3SFV2Q, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.248478533 (93h38m8.679558654s) [noise=true , address=104.36.82.44:4871 , piece_id=AEKFB3DFKC2XUM7EAZPDQXMWJRLSOSRBZM54M6HDFX5EZ5ABBHYQ, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.357504968 (93h38m8.788585119s) [noise=true , address=104.36.82.17:4339 , piece_id=4TG2TYDJRSUW6DUB6L4GGC3SHIS7JZFU2D3LISOTDJULEJY7OITA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.395476942 (93h38m8.826557073s) [noise=true , address=104.36.82.60:4347 , piece_id=SKPCL3M4DIV6WQX76OS26CPH2AVUURJZH5HH4MQCE4MGDFOZMYQQ, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.395502020 (93h38m8.826582151s) [seg_pos={0 0}, upload=97539]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:04:14.395594207 (93h38m8.826674338s) [noise=true , address=104.36.82.62:4441 , piece_id=KQHSNYZQXADUUY5EPY53WC2NIT4SN2JMQTXAJLJUVBJBRZ7GJGYQ, seg_pos={0 0}, upload=97539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VBayWisMK1n3cwypeiLzGuffonBTzYga7thAZ8pSqrusc7kow): protocol: expected piece hash; context canceled; EOF
Aug 12 15:04:14.395661976 (93h38m8.826742107s) [noise=true , address=79.127.220.101:4066 , piece_id=43V5U5NLZHEW5WGZQEBM443JDJKAVUD7STBUYRTIMB3HJKPYMDXA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF
Aug 12 15:04:14.395740116 (93h38m8.826820237s) [noise=true , address=104.36.82.47:4542 , piece_id=H3JHJVKQARKVYDTZ436UGKE76TS2C4ADZ2DJON3VJRD4GHLPT26Q, seg_pos={0 0}, upload=97539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FwaCA1FbzJbmRNzhQeVgygicJYHWkSS9fLnJbAG7KZPpokLU): protocol: write tcp 188.166.225.170:46732->104.36.82.47:4542: use of closed network connection; write tcp 188.166.225.170:46732->104.36.82.47:4542: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46732->104.36.82.47:4542: use of closed network connection
Aug 12 15:04:14.395764242 (93h38m8.826844373s) [noise=true , address=104.36.82.34:4559 , piece_id=VRS37NRIN2O3IGO4MRR675YAU7SNATURCF6IMJRPTVFWRF4XCIGA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXGQfMeXYCUuSh5TUe8pTwwd19wn68r9buS11N8aJdx6vZysf): protocol: write tcp 188.166.225.170:41088->104.36.82.34:4559: use of closed network connection; write tcp 188.166.225.170:41088->104.36.82.34:4559: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41088->104.36.82.34:4559: use of closed network connection
Aug 12 15:04:14.395779110 (93h38m8.826859241s) [seg_pos={0 0}, upload=97539]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:04:14.395833965 (93h38m8.826914096s) [upload=97539]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:04:14.395837753 (93h38m8.826917884s) [upload=97539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:04:14.700910913 (93h38m9.131991044s) [upload=97539]: Done uploading segments...
Aug 12 15:04:14.700930431 (93h38m9.132010562s) [upload=97539]: Upload finished. err: <nil>
Duration: 5.835585102s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......................X............X.................X..X..] duration:
7.2022589s
FAIL (2025-08-12 15:05:48 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 15:04:11.665990528 (93h38m6.097070659s) [upload=97539]: Starting upload
Aug 12 15:04:11.666030615 (93h38m6.097110746s) [upload=97539]: Done starting upload
Aug 12 15:04:11.666118292 (93h38m6.097198423s) [upload=97539]: Uploading segments...
Aug 12 15:04:11.666208154 (93h38m6.097288285s) [upload=97539]: Got next segment. Inline: false
Aug 12 15:04:11.666248711 (93h38m6.097328842s) [upload=97539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:04:11.666262328 (93h38m6.097342459s) [upload=97539]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:04:12.115380687 (93h38m6.546460818s) [seg_pos={0 0}, upload=97539]: Begin upload segment...
Aug 12 15:04:12.115437445 (93h38m6.546517577s) [seg_pos={0 0}, upload=97539]: Done begin upload segment.
Aug 12 15:04:12.115470660 (93h38m6.546550821s) [noise=true , address=104.36.82.17:4339 , piece_id=4TG2TYDJRSUW6DUB6L4GGC3SHIS7JZFU2D3LISOTDJULEJY7OITA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.115532528 (93h38m6.546612659s) [noise=true , address=104.36.82.37:4683 , piece_id=DQMJUTVPQSNZHZRM7MXIWTGP3CDCOSHUVVFMWJLKIJ7E4JEQGRSA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116051441 (93h38m6.547131572s) [noise=true , address=104.36.82.34:4559 , piece_id=VRS37NRIN2O3IGO4MRR675YAU7SNATURCF6IMJRPTVFWRF4XCIGA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116154307 (93h38m6.547234438s) [noise=true , address=104.36.82.16:4299 , piece_id=4S2N5PJ5GFL7WBH5XRYG7BWJKHLREVLZS4T3M4MXBFR4ORFUGZKA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116344862 (93h38m6.547424993s) [noise=true , address=104.36.82.44:4871 , piece_id=AEKFB3DFKC2XUM7EAZPDQXMWJRLSOSRBZM54M6HDFX5EZ5ABBHYQ, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116597755 (93h38m6.547677886s) [noise=true , address=104.36.82.58:4297 , piece_id=EUCQ5BPBXGUBHEPMJFV3EAQG4NTEIKIN4TDH7MAMGG4ZTJ3SFV2Q, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116760577 (93h38m6.547840708s) [noise=true , address=45.91.116.14:4221 , piece_id=QPNRJZ4VHFJ7LPTQEWWLBOUQ7E7MLOYCCXC672WEEHR7VSCAMNYQ, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116831653 (93h38m6.547911784s) [noise=true , address=104.36.82.59:4332 , piece_id=BS5RN6JER5QD5OH4AODEM5HMD55DAJENLRBUWR4TVJECHYBWFOPA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117065872 (93h38m6.548146003s) [noise=true , address=79.127.220.101:4066 , piece_id=43V5U5NLZHEW5WGZQEBM443JDJKAVUD7STBUYRTIMB3HJKPYMDXA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117202232 (93h38m6.548282363s) [noise=true , address=104.36.82.23:4459 , piece_id=ZPKWXOP7FQHM5RTA3AKYRAGYWK6XNAOHWTKAWKD7ZECUDSIDGWTA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117311862 (93h38m6.548392003s) [noise=true , address=104.36.82.3:4785 , piece_id=QVTNW3AGAU6EIS4NCFDBP2AXOWLKVTG7ZWXCPRZ5KJJZZDAPLSUA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117595355 (93h38m6.548675476s) [noise=true , address=104.36.82.60:4347 , piece_id=SKPCL3M4DIV6WQX76OS26CPH2AVUURJZH5HH4MQCE4MGDFOZMYQQ, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117602127 (93h38m6.548682259s) [noise=true , address=64.49.13.139:4469 , piece_id=BW34W6DNM6CVNFCFOQXYRDLPDVBM3JTLF6H2X2EDPJNANBN2Z2TA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117986022 (93h38m6.549066153s) [noise=true , address=66.23.193.175:4555 , piece_id=LVH76KSGCP2DYR46SYNIAQJKJVNPB3MHJPD23S6O57HAXMSWMWUQ, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.118036288 (93h38m6.549116419s) [noise=true , address=104.36.82.47:4542 , piece_id=H3JHJVKQARKVYDTZ436UGKE76TS2C4ADZ2DJON3VJRD4GHLPT26Q, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.118233365 (93h38m6.549313496s) [noise=true , address=104.36.82.36:4632 , piece_id=PCKWOXRJZP34Z6XXCCRKT4MZNMUEUEXAJYYUXPXSLADTM7NA3S3Q, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.118335010 (93h38m6.549415141s) [noise=true , address=104.36.82.62:4441 , piece_id=KQHSNYZQXADUUY5EPY53WC2NIT4SN2JMQTXAJLJUVBJBRZ7GJGYQ, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.118629984 (93h38m6.549710115s) [noise=true , address=64.49.13.140:4513 , piece_id=UEYTYUQHVSXWHFXOT7S3IKT32GMSC3GMMJNIFX3YLFGQ3DBWUBWA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:13.204852475 (93h38m7.635932606s) [upload=97539]: Next returned nil segment
Aug 12 15:04:13.204867503 (93h38m7.635947624s) [upload=97539]: Waiting for error group managing segments...
Aug 12 15:04:13.509271413 (93h38m7.940351544s) [noise=true , address=66.23.193.175:4555 , piece_id=LVH76KSGCP2DYR46SYNIAQJKJVNPB3MHJPD23S6O57HAXMSWMWUQ, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:13.511884514 (93h38m7.942964635s) [noise=true , address=64.49.13.139:4469 , piece_id=BW34W6DNM6CVNFCFOQXYRDLPDVBM3JTLF6H2X2EDPJNANBN2Z2TA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:13.523389196 (93h38m7.954469327s) [noise=true , address=64.49.13.140:4513 , piece_id=UEYTYUQHVSXWHFXOT7S3IKT32GMSC3GMMJNIFX3YLFGQ3DBWUBWA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.084352774 (93h38m8.515432905s) [noise=true , address=104.36.82.23:4459 , piece_id=ZPKWXOP7FQHM5RTA3AKYRAGYWK6XNAOHWTKAWKD7ZECUDSIDGWTA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.088640538 (93h38m8.519720669s) [noise=true , address=45.91.116.14:4221 , piece_id=QPNRJZ4VHFJ7LPTQEWWLBOUQ7E7MLOYCCXC672WEEHR7VSCAMNYQ, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.126663759 (93h38m8.55774393s) [noise=true , address=104.36.82.37:4683 , piece_id=DQMJUTVPQSNZHZRM7MXIWTGP3CDCOSHUVVFMWJLKIJ7E4JEQGRSA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.139981460 (93h38m8.571061591s) [noise=true , address=104.36.82.16:4299 , piece_id=4S2N5PJ5GFL7WBH5XRYG7BWJKHLREVLZS4T3M4MXBFR4ORFUGZKA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.174526156 (93h38m8.605606287s) [noise=true , address=104.36.82.36:4632 , piece_id=PCKWOXRJZP34Z6XXCCRKT4MZNMUEUEXAJYYUXPXSLADTM7NA3S3Q, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.185237671 (93h38m8.616317802s) [noise=true , address=104.36.82.3:4785 , piece_id=QVTNW3AGAU6EIS4NCFDBP2AXOWLKVTG7ZWXCPRZ5KJJZZDAPLSUA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.187994166 (93h38m8.619074297s) [noise=true , address=104.36.82.59:4332 , piece_id=BS5RN6JER5QD5OH4AODEM5HMD55DAJENLRBUWR4TVJECHYBWFOPA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.243876298 (93h38m8.674956429s) [noise=true , address=104.36.82.58:4297 , piece_id=EUCQ5BPBXGUBHEPMJFV3EAQG4NTEIKIN4TDH7MAMGG4ZTJ3SFV2Q, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.248478533 (93h38m8.679558654s) [noise=true , address=104.36.82.44:4871 , piece_id=AEKFB3DFKC2XUM7EAZPDQXMWJRLSOSRBZM54M6HDFX5EZ5ABBHYQ, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.357504968 (93h38m8.788585119s) [noise=true , address=104.36.82.17:4339 , piece_id=4TG2TYDJRSUW6DUB6L4GGC3SHIS7JZFU2D3LISOTDJULEJY7OITA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.395476942 (93h38m8.826557073s) [noise=true , address=104.36.82.60:4347 , piece_id=SKPCL3M4DIV6WQX76OS26CPH2AVUURJZH5HH4MQCE4MGDFOZMYQQ, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.395502020 (93h38m8.826582151s) [seg_pos={0 0}, upload=97539]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:04:14.395594207 (93h38m8.826674338s) [noise=true , address=104.36.82.62:4441 , piece_id=KQHSNYZQXADUUY5EPY53WC2NIT4SN2JMQTXAJLJUVBJBRZ7GJGYQ, seg_pos={0 0}, upload=97539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VBayWisMK1n3cwypeiLzGuffonBTzYga7thAZ8pSqrusc7kow): protocol: expected piece hash; context canceled; EOF
Aug 12 15:04:14.395661976 (93h38m8.826742107s) [noise=true , address=79.127.220.101:4066 , piece_id=43V5U5NLZHEW5WGZQEBM443JDJKAVUD7STBUYRTIMB3HJKPYMDXA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF
Aug 12 15:04:14.395740116 (93h38m8.826820237s) [noise=true , address=104.36.82.47:4542 , piece_id=H3JHJVKQARKVYDTZ436UGKE76TS2C4ADZ2DJON3VJRD4GHLPT26Q, seg_pos={0 0}, upload=97539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FwaCA1FbzJbmRNzhQeVgygicJYHWkSS9fLnJbAG7KZPpokLU): protocol: write tcp 188.166.225.170:46732->104.36.82.47:4542: use of closed network connection; write tcp 188.166.225.170:46732->104.36.82.47:4542: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46732->104.36.82.47:4542: use of closed network connection
Aug 12 15:04:14.395764242 (93h38m8.826844373s) [noise=true , address=104.36.82.34:4559 , piece_id=VRS37NRIN2O3IGO4MRR675YAU7SNATURCF6IMJRPTVFWRF4XCIGA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXGQfMeXYCUuSh5TUe8pTwwd19wn68r9buS11N8aJdx6vZysf): protocol: write tcp 188.166.225.170:41088->104.36.82.34:4559: use of closed network connection; write tcp 188.166.225.170:41088->104.36.82.34:4559: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41088->104.36.82.34:4559: use of closed network connection
Aug 12 15:04:14.395779110 (93h38m8.826859241s) [seg_pos={0 0}, upload=97539]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:04:14.395833965 (93h38m8.826914096s) [upload=97539]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:04:14.395837753 (93h38m8.826917884s) [upload=97539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:04:14.700910913 (93h38m9.131991044s) [upload=97539]: Done uploading segments...
Aug 12 15:04:14.700930431 (93h38m9.132010562s) [upload=97539]: Upload finished. err: <nil>
Duration: 7.202285952s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................................X..X....] duration:
2.101840943s
FAIL (2025-08-12 15:05:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 4e74452dc4a6cbb84c19c38ae09de2a14792ba0455f3fd49dd4b09585d5db40d != before 1807f36a3be378809fe937cebf225cac8f9699b81a1e5d17f82d72ac39a6a1a7 ======LOGS====== Aug 12 15:02:01.334418071 (93h35m55.765498202s) [upload=97502]: Starting upload Aug 12 15:02:01.334498996 (93h35m55.765579127s) [upload=97502]: Done starting upload Aug 12 15:02:01.334566566 (93h35m55.765646697s) [upload=97502]: Uploading segments... Aug 12 15:02:01.334618995 (93h35m55.765699126s) [upload=97502]: Got next segment. Inline: true Aug 12 15:02:01.334623204 (93h35m55.765703335s) [upload=97502]: Waiting for error group managing segments... Aug 12 15:02:01.334658531 (93h35m55.765738662s) [upload=97502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 15:02:01.334662258 (93h35m55.765742389s) [upload=97502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 15:02:01.334664613 (93h35m55.765744734s) [upload=97502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 15:02:01.612866971 (93h35m56.043947102s) [upload=97502]: Done uploading segments... Aug 12 15:02:01.612886870 (93h35m56.043967001s) [upload=97502]: Upload finished. err: <nil>
Duration: 2.101921196s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........................X............X.................X..X.] duration:
6.801215666s
FAIL (2025-08-12 15:05:27 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 15:04:11.665990528 (93h38m6.097070659s) [upload=97539]: Starting upload
Aug 12 15:04:11.666030615 (93h38m6.097110746s) [upload=97539]: Done starting upload
Aug 12 15:04:11.666118292 (93h38m6.097198423s) [upload=97539]: Uploading segments...
Aug 12 15:04:11.666208154 (93h38m6.097288285s) [upload=97539]: Got next segment. Inline: false
Aug 12 15:04:11.666248711 (93h38m6.097328842s) [upload=97539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:04:11.666262328 (93h38m6.097342459s) [upload=97539]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:04:12.115380687 (93h38m6.546460818s) [seg_pos={0 0}, upload=97539]: Begin upload segment...
Aug 12 15:04:12.115437445 (93h38m6.546517577s) [seg_pos={0 0}, upload=97539]: Done begin upload segment.
Aug 12 15:04:12.115470660 (93h38m6.546550821s) [noise=true , address=104.36.82.17:4339 , piece_id=4TG2TYDJRSUW6DUB6L4GGC3SHIS7JZFU2D3LISOTDJULEJY7OITA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.115532528 (93h38m6.546612659s) [noise=true , address=104.36.82.37:4683 , piece_id=DQMJUTVPQSNZHZRM7MXIWTGP3CDCOSHUVVFMWJLKIJ7E4JEQGRSA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116051441 (93h38m6.547131572s) [noise=true , address=104.36.82.34:4559 , piece_id=VRS37NRIN2O3IGO4MRR675YAU7SNATURCF6IMJRPTVFWRF4XCIGA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116154307 (93h38m6.547234438s) [noise=true , address=104.36.82.16:4299 , piece_id=4S2N5PJ5GFL7WBH5XRYG7BWJKHLREVLZS4T3M4MXBFR4ORFUGZKA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116344862 (93h38m6.547424993s) [noise=true , address=104.36.82.44:4871 , piece_id=AEKFB3DFKC2XUM7EAZPDQXMWJRLSOSRBZM54M6HDFX5EZ5ABBHYQ, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116597755 (93h38m6.547677886s) [noise=true , address=104.36.82.58:4297 , piece_id=EUCQ5BPBXGUBHEPMJFV3EAQG4NTEIKIN4TDH7MAMGG4ZTJ3SFV2Q, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116760577 (93h38m6.547840708s) [noise=true , address=45.91.116.14:4221 , piece_id=QPNRJZ4VHFJ7LPTQEWWLBOUQ7E7MLOYCCXC672WEEHR7VSCAMNYQ, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116831653 (93h38m6.547911784s) [noise=true , address=104.36.82.59:4332 , piece_id=BS5RN6JER5QD5OH4AODEM5HMD55DAJENLRBUWR4TVJECHYBWFOPA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117065872 (93h38m6.548146003s) [noise=true , address=79.127.220.101:4066 , piece_id=43V5U5NLZHEW5WGZQEBM443JDJKAVUD7STBUYRTIMB3HJKPYMDXA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117202232 (93h38m6.548282363s) [noise=true , address=104.36.82.23:4459 , piece_id=ZPKWXOP7FQHM5RTA3AKYRAGYWK6XNAOHWTKAWKD7ZECUDSIDGWTA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117311862 (93h38m6.548392003s) [noise=true , address=104.36.82.3:4785 , piece_id=QVTNW3AGAU6EIS4NCFDBP2AXOWLKVTG7ZWXCPRZ5KJJZZDAPLSUA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117595355 (93h38m6.548675476s) [noise=true , address=104.36.82.60:4347 , piece_id=SKPCL3M4DIV6WQX76OS26CPH2AVUURJZH5HH4MQCE4MGDFOZMYQQ, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117602127 (93h38m6.548682259s) [noise=true , address=64.49.13.139:4469 , piece_id=BW34W6DNM6CVNFCFOQXYRDLPDVBM3JTLF6H2X2EDPJNANBN2Z2TA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117986022 (93h38m6.549066153s) [noise=true , address=66.23.193.175:4555 , piece_id=LVH76KSGCP2DYR46SYNIAQJKJVNPB3MHJPD23S6O57HAXMSWMWUQ, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.118036288 (93h38m6.549116419s) [noise=true , address=104.36.82.47:4542 , piece_id=H3JHJVKQARKVYDTZ436UGKE76TS2C4ADZ2DJON3VJRD4GHLPT26Q, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.118233365 (93h38m6.549313496s) [noise=true , address=104.36.82.36:4632 , piece_id=PCKWOXRJZP34Z6XXCCRKT4MZNMUEUEXAJYYUXPXSLADTM7NA3S3Q, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.118335010 (93h38m6.549415141s) [noise=true , address=104.36.82.62:4441 , piece_id=KQHSNYZQXADUUY5EPY53WC2NIT4SN2JMQTXAJLJUVBJBRZ7GJGYQ, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.118629984 (93h38m6.549710115s) [noise=true , address=64.49.13.140:4513 , piece_id=UEYTYUQHVSXWHFXOT7S3IKT32GMSC3GMMJNIFX3YLFGQ3DBWUBWA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:13.204852475 (93h38m7.635932606s) [upload=97539]: Next returned nil segment
Aug 12 15:04:13.204867503 (93h38m7.635947624s) [upload=97539]: Waiting for error group managing segments...
Aug 12 15:04:13.509271413 (93h38m7.940351544s) [noise=true , address=66.23.193.175:4555 , piece_id=LVH76KSGCP2DYR46SYNIAQJKJVNPB3MHJPD23S6O57HAXMSWMWUQ, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:13.511884514 (93h38m7.942964635s) [noise=true , address=64.49.13.139:4469 , piece_id=BW34W6DNM6CVNFCFOQXYRDLPDVBM3JTLF6H2X2EDPJNANBN2Z2TA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:13.523389196 (93h38m7.954469327s) [noise=true , address=64.49.13.140:4513 , piece_id=UEYTYUQHVSXWHFXOT7S3IKT32GMSC3GMMJNIFX3YLFGQ3DBWUBWA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.084352774 (93h38m8.515432905s) [noise=true , address=104.36.82.23:4459 , piece_id=ZPKWXOP7FQHM5RTA3AKYRAGYWK6XNAOHWTKAWKD7ZECUDSIDGWTA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.088640538 (93h38m8.519720669s) [noise=true , address=45.91.116.14:4221 , piece_id=QPNRJZ4VHFJ7LPTQEWWLBOUQ7E7MLOYCCXC672WEEHR7VSCAMNYQ, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.126663759 (93h38m8.55774393s) [noise=true , address=104.36.82.37:4683 , piece_id=DQMJUTVPQSNZHZRM7MXIWTGP3CDCOSHUVVFMWJLKIJ7E4JEQGRSA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.139981460 (93h38m8.571061591s) [noise=true , address=104.36.82.16:4299 , piece_id=4S2N5PJ5GFL7WBH5XRYG7BWJKHLREVLZS4T3M4MXBFR4ORFUGZKA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.174526156 (93h38m8.605606287s) [noise=true , address=104.36.82.36:4632 , piece_id=PCKWOXRJZP34Z6XXCCRKT4MZNMUEUEXAJYYUXPXSLADTM7NA3S3Q, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.185237671 (93h38m8.616317802s) [noise=true , address=104.36.82.3:4785 , piece_id=QVTNW3AGAU6EIS4NCFDBP2AXOWLKVTG7ZWXCPRZ5KJJZZDAPLSUA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.187994166 (93h38m8.619074297s) [noise=true , address=104.36.82.59:4332 , piece_id=BS5RN6JER5QD5OH4AODEM5HMD55DAJENLRBUWR4TVJECHYBWFOPA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.243876298 (93h38m8.674956429s) [noise=true , address=104.36.82.58:4297 , piece_id=EUCQ5BPBXGUBHEPMJFV3EAQG4NTEIKIN4TDH7MAMGG4ZTJ3SFV2Q, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.248478533 (93h38m8.679558654s) [noise=true , address=104.36.82.44:4871 , piece_id=AEKFB3DFKC2XUM7EAZPDQXMWJRLSOSRBZM54M6HDFX5EZ5ABBHYQ, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.357504968 (93h38m8.788585119s) [noise=true , address=104.36.82.17:4339 , piece_id=4TG2TYDJRSUW6DUB6L4GGC3SHIS7JZFU2D3LISOTDJULEJY7OITA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.395476942 (93h38m8.826557073s) [noise=true , address=104.36.82.60:4347 , piece_id=SKPCL3M4DIV6WQX76OS26CPH2AVUURJZH5HH4MQCE4MGDFOZMYQQ, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.395502020 (93h38m8.826582151s) [seg_pos={0 0}, upload=97539]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:04:14.395594207 (93h38m8.826674338s) [noise=true , address=104.36.82.62:4441 , piece_id=KQHSNYZQXADUUY5EPY53WC2NIT4SN2JMQTXAJLJUVBJBRZ7GJGYQ, seg_pos={0 0}, upload=97539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VBayWisMK1n3cwypeiLzGuffonBTzYga7thAZ8pSqrusc7kow): protocol: expected piece hash; context canceled; EOF
Aug 12 15:04:14.395661976 (93h38m8.826742107s) [noise=true , address=79.127.220.101:4066 , piece_id=43V5U5NLZHEW5WGZQEBM443JDJKAVUD7STBUYRTIMB3HJKPYMDXA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF
Aug 12 15:04:14.395740116 (93h38m8.826820237s) [noise=true , address=104.36.82.47:4542 , piece_id=H3JHJVKQARKVYDTZ436UGKE76TS2C4ADZ2DJON3VJRD4GHLPT26Q, seg_pos={0 0}, upload=97539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FwaCA1FbzJbmRNzhQeVgygicJYHWkSS9fLnJbAG7KZPpokLU): protocol: write tcp 188.166.225.170:46732->104.36.82.47:4542: use of closed network connection; write tcp 188.166.225.170:46732->104.36.82.47:4542: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46732->104.36.82.47:4542: use of closed network connection
Aug 12 15:04:14.395764242 (93h38m8.826844373s) [noise=true , address=104.36.82.34:4559 , piece_id=VRS37NRIN2O3IGO4MRR675YAU7SNATURCF6IMJRPTVFWRF4XCIGA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXGQfMeXYCUuSh5TUe8pTwwd19wn68r9buS11N8aJdx6vZysf): protocol: write tcp 188.166.225.170:41088->104.36.82.34:4559: use of closed network connection; write tcp 188.166.225.170:41088->104.36.82.34:4559: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41088->104.36.82.34:4559: use of closed network connection
Aug 12 15:04:14.395779110 (93h38m8.826859241s) [seg_pos={0 0}, upload=97539]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:04:14.395833965 (93h38m8.826914096s) [upload=97539]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:04:14.395837753 (93h38m8.826917884s) [upload=97539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:04:14.700910913 (93h38m9.131991044s) [upload=97539]: Done uploading segments...
Aug 12 15:04:14.700930431 (93h38m9.132010562s) [upload=97539]: Upload finished. err: <nil>
Duration: 6.801241426s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................................X..X...] duration:
1.981280058s
FAIL (2025-08-12 15:04:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 4e74452dc4a6cbb84c19c38ae09de2a14792ba0455f3fd49dd4b09585d5db40d != before 1807f36a3be378809fe937cebf225cac8f9699b81a1e5d17f82d72ac39a6a1a7 ======LOGS====== Aug 12 15:02:01.334418071 (93h35m55.765498202s) [upload=97502]: Starting upload Aug 12 15:02:01.334498996 (93h35m55.765579127s) [upload=97502]: Done starting upload Aug 12 15:02:01.334566566 (93h35m55.765646697s) [upload=97502]: Uploading segments... Aug 12 15:02:01.334618995 (93h35m55.765699126s) [upload=97502]: Got next segment. Inline: true Aug 12 15:02:01.334623204 (93h35m55.765703335s) [upload=97502]: Waiting for error group managing segments... Aug 12 15:02:01.334658531 (93h35m55.765738662s) [upload=97502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 15:02:01.334662258 (93h35m55.765742389s) [upload=97502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 15:02:01.334664613 (93h35m55.765744734s) [upload=97502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 15:02:01.612866971 (93h35m56.043947102s) [upload=97502]: Done uploading segments... Aug 12 15:02:01.612886870 (93h35m56.043967001s) [upload=97502]: Upload finished. err: <nil>
Duration: 1.981311148s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........................X............X.................X..X] duration:
4.361544548s
FAIL (2025-08-12 15:04:15 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 15:04:11.665990528 (93h38m6.097070659s) [upload=97539]: Starting upload
Aug 12 15:04:11.666030615 (93h38m6.097110746s) [upload=97539]: Done starting upload
Aug 12 15:04:11.666118292 (93h38m6.097198423s) [upload=97539]: Uploading segments...
Aug 12 15:04:11.666208154 (93h38m6.097288285s) [upload=97539]: Got next segment. Inline: false
Aug 12 15:04:11.666248711 (93h38m6.097328842s) [upload=97539]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:04:11.666262328 (93h38m6.097342459s) [upload=97539]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:04:12.115380687 (93h38m6.546460818s) [seg_pos={0 0}, upload=97539]: Begin upload segment...
Aug 12 15:04:12.115437445 (93h38m6.546517577s) [seg_pos={0 0}, upload=97539]: Done begin upload segment.
Aug 12 15:04:12.115470660 (93h38m6.546550821s) [noise=true , address=104.36.82.17:4339 , piece_id=4TG2TYDJRSUW6DUB6L4GGC3SHIS7JZFU2D3LISOTDJULEJY7OITA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.115532528 (93h38m6.546612659s) [noise=true , address=104.36.82.37:4683 , piece_id=DQMJUTVPQSNZHZRM7MXIWTGP3CDCOSHUVVFMWJLKIJ7E4JEQGRSA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116051441 (93h38m6.547131572s) [noise=true , address=104.36.82.34:4559 , piece_id=VRS37NRIN2O3IGO4MRR675YAU7SNATURCF6IMJRPTVFWRF4XCIGA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116154307 (93h38m6.547234438s) [noise=true , address=104.36.82.16:4299 , piece_id=4S2N5PJ5GFL7WBH5XRYG7BWJKHLREVLZS4T3M4MXBFR4ORFUGZKA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116344862 (93h38m6.547424993s) [noise=true , address=104.36.82.44:4871 , piece_id=AEKFB3DFKC2XUM7EAZPDQXMWJRLSOSRBZM54M6HDFX5EZ5ABBHYQ, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116597755 (93h38m6.547677886s) [noise=true , address=104.36.82.58:4297 , piece_id=EUCQ5BPBXGUBHEPMJFV3EAQG4NTEIKIN4TDH7MAMGG4ZTJ3SFV2Q, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116760577 (93h38m6.547840708s) [noise=true , address=45.91.116.14:4221 , piece_id=QPNRJZ4VHFJ7LPTQEWWLBOUQ7E7MLOYCCXC672WEEHR7VSCAMNYQ, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.116831653 (93h38m6.547911784s) [noise=true , address=104.36.82.59:4332 , piece_id=BS5RN6JER5QD5OH4AODEM5HMD55DAJENLRBUWR4TVJECHYBWFOPA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117065872 (93h38m6.548146003s) [noise=true , address=79.127.220.101:4066 , piece_id=43V5U5NLZHEW5WGZQEBM443JDJKAVUD7STBUYRTIMB3HJKPYMDXA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117202232 (93h38m6.548282363s) [noise=true , address=104.36.82.23:4459 , piece_id=ZPKWXOP7FQHM5RTA3AKYRAGYWK6XNAOHWTKAWKD7ZECUDSIDGWTA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117311862 (93h38m6.548392003s) [noise=true , address=104.36.82.3:4785 , piece_id=QVTNW3AGAU6EIS4NCFDBP2AXOWLKVTG7ZWXCPRZ5KJJZZDAPLSUA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117595355 (93h38m6.548675476s) [noise=true , address=104.36.82.60:4347 , piece_id=SKPCL3M4DIV6WQX76OS26CPH2AVUURJZH5HH4MQCE4MGDFOZMYQQ, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117602127 (93h38m6.548682259s) [noise=true , address=64.49.13.139:4469 , piece_id=BW34W6DNM6CVNFCFOQXYRDLPDVBM3JTLF6H2X2EDPJNANBN2Z2TA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.117986022 (93h38m6.549066153s) [noise=true , address=66.23.193.175:4555 , piece_id=LVH76KSGCP2DYR46SYNIAQJKJVNPB3MHJPD23S6O57HAXMSWMWUQ, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.118036288 (93h38m6.549116419s) [noise=true , address=104.36.82.47:4542 , piece_id=H3JHJVKQARKVYDTZ436UGKE76TS2C4ADZ2DJON3VJRD4GHLPT26Q, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.118233365 (93h38m6.549313496s) [noise=true , address=104.36.82.36:4632 , piece_id=PCKWOXRJZP34Z6XXCCRKT4MZNMUEUEXAJYYUXPXSLADTM7NA3S3Q, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.118335010 (93h38m6.549415141s) [noise=true , address=104.36.82.62:4441 , piece_id=KQHSNYZQXADUUY5EPY53WC2NIT4SN2JMQTXAJLJUVBJBRZ7GJGYQ, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:12.118629984 (93h38m6.549710115s) [noise=true , address=64.49.13.140:4513 , piece_id=UEYTYUQHVSXWHFXOT7S3IKT32GMSC3GMMJNIFX3YLFGQ3DBWUBWA, seg_pos={0 0}, upload=97539]: Uploading piece...
Aug 12 15:04:13.204852475 (93h38m7.635932606s) [upload=97539]: Next returned nil segment
Aug 12 15:04:13.204867503 (93h38m7.635947624s) [upload=97539]: Waiting for error group managing segments...
Aug 12 15:04:13.509271413 (93h38m7.940351544s) [noise=true , address=66.23.193.175:4555 , piece_id=LVH76KSGCP2DYR46SYNIAQJKJVNPB3MHJPD23S6O57HAXMSWMWUQ, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:13.511884514 (93h38m7.942964635s) [noise=true , address=64.49.13.139:4469 , piece_id=BW34W6DNM6CVNFCFOQXYRDLPDVBM3JTLF6H2X2EDPJNANBN2Z2TA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:13.523389196 (93h38m7.954469327s) [noise=true , address=64.49.13.140:4513 , piece_id=UEYTYUQHVSXWHFXOT7S3IKT32GMSC3GMMJNIFX3YLFGQ3DBWUBWA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.084352774 (93h38m8.515432905s) [noise=true , address=104.36.82.23:4459 , piece_id=ZPKWXOP7FQHM5RTA3AKYRAGYWK6XNAOHWTKAWKD7ZECUDSIDGWTA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.088640538 (93h38m8.519720669s) [noise=true , address=45.91.116.14:4221 , piece_id=QPNRJZ4VHFJ7LPTQEWWLBOUQ7E7MLOYCCXC672WEEHR7VSCAMNYQ, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.126663759 (93h38m8.55774393s) [noise=true , address=104.36.82.37:4683 , piece_id=DQMJUTVPQSNZHZRM7MXIWTGP3CDCOSHUVVFMWJLKIJ7E4JEQGRSA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.139981460 (93h38m8.571061591s) [noise=true , address=104.36.82.16:4299 , piece_id=4S2N5PJ5GFL7WBH5XRYG7BWJKHLREVLZS4T3M4MXBFR4ORFUGZKA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.174526156 (93h38m8.605606287s) [noise=true , address=104.36.82.36:4632 , piece_id=PCKWOXRJZP34Z6XXCCRKT4MZNMUEUEXAJYYUXPXSLADTM7NA3S3Q, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.185237671 (93h38m8.616317802s) [noise=true , address=104.36.82.3:4785 , piece_id=QVTNW3AGAU6EIS4NCFDBP2AXOWLKVTG7ZWXCPRZ5KJJZZDAPLSUA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.187994166 (93h38m8.619074297s) [noise=true , address=104.36.82.59:4332 , piece_id=BS5RN6JER5QD5OH4AODEM5HMD55DAJENLRBUWR4TVJECHYBWFOPA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.243876298 (93h38m8.674956429s) [noise=true , address=104.36.82.58:4297 , piece_id=EUCQ5BPBXGUBHEPMJFV3EAQG4NTEIKIN4TDH7MAMGG4ZTJ3SFV2Q, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.248478533 (93h38m8.679558654s) [noise=true , address=104.36.82.44:4871 , piece_id=AEKFB3DFKC2XUM7EAZPDQXMWJRLSOSRBZM54M6HDFX5EZ5ABBHYQ, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.357504968 (93h38m8.788585119s) [noise=true , address=104.36.82.17:4339 , piece_id=4TG2TYDJRSUW6DUB6L4GGC3SHIS7JZFU2D3LISOTDJULEJY7OITA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.395476942 (93h38m8.826557073s) [noise=true , address=104.36.82.60:4347 , piece_id=SKPCL3M4DIV6WQX76OS26CPH2AVUURJZH5HH4MQCE4MGDFOZMYQQ, seg_pos={0 0}, upload=97539]: Done uploading piece. err: <nil>
Aug 12 15:04:14.395502020 (93h38m8.826582151s) [seg_pos={0 0}, upload=97539]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:04:14.395594207 (93h38m8.826674338s) [noise=true , address=104.36.82.62:4441 , piece_id=KQHSNYZQXADUUY5EPY53WC2NIT4SN2JMQTXAJLJUVBJBRZ7GJGYQ, seg_pos={0 0}, upload=97539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VBayWisMK1n3cwypeiLzGuffonBTzYga7thAZ8pSqrusc7kow): protocol: expected piece hash; context canceled; EOF
Aug 12 15:04:14.395661976 (93h38m8.826742107s) [noise=true , address=79.127.220.101:4066 , piece_id=43V5U5NLZHEW5WGZQEBM443JDJKAVUD7STBUYRTIMB3HJKPYMDXA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NgizfYgzwduPieTvc5nD8pxh2utMEHaFtDzjM5byMvvYynzS7): protocol: expected piece hash; context canceled; EOF
Aug 12 15:04:14.395740116 (93h38m8.826820237s) [noise=true , address=104.36.82.47:4542 , piece_id=H3JHJVKQARKVYDTZ436UGKE76TS2C4ADZ2DJON3VJRD4GHLPT26Q, seg_pos={0 0}, upload=97539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FwaCA1FbzJbmRNzhQeVgygicJYHWkSS9fLnJbAG7KZPpokLU): protocol: write tcp 188.166.225.170:46732->104.36.82.47:4542: use of closed network connection; write tcp 188.166.225.170:46732->104.36.82.47:4542: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46732->104.36.82.47:4542: use of closed network connection
Aug 12 15:04:14.395764242 (93h38m8.826844373s) [noise=true , address=104.36.82.34:4559 , piece_id=VRS37NRIN2O3IGO4MRR675YAU7SNATURCF6IMJRPTVFWRF4XCIGA, seg_pos={0 0}, upload=97539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXGQfMeXYCUuSh5TUe8pTwwd19wn68r9buS11N8aJdx6vZysf): protocol: write tcp 188.166.225.170:41088->104.36.82.34:4559: use of closed network connection; write tcp 188.166.225.170:41088->104.36.82.34:4559: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41088->104.36.82.34:4559: use of closed network connection
Aug 12 15:04:14.395779110 (93h38m8.826859241s) [seg_pos={0 0}, upload=97539]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:04:14.395833965 (93h38m8.826914096s) [upload=97539]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:04:14.395837753 (93h38m8.826917884s) [upload=97539]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:04:14.700910913 (93h38m9.131991044s) [upload=97539]: Done uploading segments...
Aug 12 15:04:14.700930431 (93h38m9.132010562s) [upload=97539]: Upload finished. err: <nil>
Duration: 4.361573243s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................................X..X..] duration:
1.844398896s
FAIL (2025-08-12 15:04:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 4e74452dc4a6cbb84c19c38ae09de2a14792ba0455f3fd49dd4b09585d5db40d != before 1807f36a3be378809fe937cebf225cac8f9699b81a1e5d17f82d72ac39a6a1a7 ======LOGS====== Aug 12 15:02:01.334418071 (93h35m55.765498202s) [upload=97502]: Starting upload Aug 12 15:02:01.334498996 (93h35m55.765579127s) [upload=97502]: Done starting upload Aug 12 15:02:01.334566566 (93h35m55.765646697s) [upload=97502]: Uploading segments... Aug 12 15:02:01.334618995 (93h35m55.765699126s) [upload=97502]: Got next segment. Inline: true Aug 12 15:02:01.334623204 (93h35m55.765703335s) [upload=97502]: Waiting for error group managing segments... Aug 12 15:02:01.334658531 (93h35m55.765738662s) [upload=97502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 15:02:01.334662258 (93h35m55.765742389s) [upload=97502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 15:02:01.334664613 (93h35m55.765744734s) [upload=97502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 15:02:01.612866971 (93h35m56.043947102s) [upload=97502]: Done uploading segments... Aug 12 15:02:01.612886870 (93h35m56.043967001s) [upload=97502]: Upload finished. err: <nil>
Duration: 1.844425027s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................X............X.................X..] duration:
6.981460789s
FAIL (2025-08-12 15:03:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 15:01:26.368920538 (93h35m20.800000669s) [upload=97493]: Starting upload
Aug 12 15:01:26.368991163 (93h35m20.800071284s) [upload=97493]: Done starting upload
Aug 12 15:01:26.369056809 (93h35m20.80013695s) [upload=97493]: Uploading segments...
Aug 12 15:01:26.369169664 (93h35m20.800249795s) [upload=97493]: Got next segment. Inline: false
Aug 12 15:01:26.369221925 (93h35m20.800302056s) [upload=97493]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:01:26.369226734 (93h35m20.800306865s) [upload=97493]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:01:26.822529129 (93h35m21.25360927s) [seg_pos={0 0}, upload=97493]: Begin upload segment...
Aug 12 15:01:26.822591820 (93h35m21.253671951s) [seg_pos={0 0}, upload=97493]: Done begin upload segment.
Aug 12 15:01:26.822616686 (93h35m21.253696827s) [noise=true , address=104.36.82.51:4054 , piece_id=I3UMEPPFLCY25TGLWXPSQZCKFKX6PBCSIA3A6M3SKBFUVXRZN4QQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.822629582 (93h35m21.253709713s) [noise=true , address=104.36.82.13:4192 , piece_id=L7PW4CKH26NN3EDHALABVHUHESLK6ASSNSY4SCHUMM6J3M4PVY5Q, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.822680549 (93h35m21.25376068s) [noise=true , address=104.36.82.60:4343 , piece_id=MDBL7DLJWML5GOUZBY6VXAGNDO2YSR2PS2AKUY44DJW2L3TDEQDA, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.822970243 (93h35m21.254050414s) [noise=true , address=79.127.220.101:4064 , piece_id=B3UDD62AWCFJVZOICNLEE5I54X3WZY2OERFBMOS5ELJXX6J346YQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.823432728 (93h35m21.254512889s) [noise=true , address=104.36.82.62:4420 , piece_id=GX2W3MVM7MHHHISFL6SJN622RG262DHFJ2ORF6ZU67TX7DNBL4DQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.823584900 (93h35m21.254665061s) [noise=true , address=104.36.82.44:4899 , piece_id=DJCURPMNBUYMXOYMPT2LEHU2PVHQIBNV75WMDBDFMAVVL6AO3UAQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.823887689 (93h35m21.25496783s) [noise=true , address=77.90.31.10:4523 , piece_id=VZRIGFFYRQUPTMV3GRGSR46E5XPA2MMTUQ2ROL76H2J3YBLC4SHQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.823958995 (93h35m21.255039126s) [noise=true , address=104.36.82.36:4625 , piece_id=7G4PVYFPS2BHBABGKC5YGD3UDYBFLYUIQTQ6L7SZBHRXN74PTHWQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.824452018 (93h35m21.255532149s) [noise=true , address=104.36.82.23:4467 , piece_id=A6KQFAXBS6XOPT2YL4IS3ZQNM6WR7RES3AZWZJ6D4ZFUBHCCSGFA, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.824829441 (93h35m21.255909572s) [noise=true , address=64.49.13.27:4967 , piece_id=I36U7ASIL6G5PVPN3KGR63G7ZZI5X7S7XLWWYERTNGQBQFQ6GHIQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.825177066 (93h35m21.256257197s) [noise=true , address=64.49.13.140:4505 , piece_id=TWIZAVJMJ2NNDCZZZQMEO2RPKWQCOLSL2EDRO7IFJD2XNWLLHX5A, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.825582411 (93h35m21.256662552s) [noise=true , address=77.90.31.12:4593 , piece_id=6DVTDXLPTUENXCUQECFJW5ACGEB5Q4LTYGEPPB5BNBBDQIXCMDHA, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.825945205 (93h35m21.257025336s) [noise=true , address=104.36.82.8:4003 , piece_id=OHQK6BPMKBL65RPEHNYSRY3UGUOZZYPZP5RNTSLJH7SNVLWOKLLQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.826248075 (93h35m21.257328216s) [noise=true , address=104.36.82.58:4278 , piece_id=Z6R74M7WZDWYZ7F2FTMSK436D7CCNS6BXE4OULITDZAGKFOVMPRA, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.826584258 (93h35m21.257664389s) [noise=true , address=104.36.82.35:4595 , piece_id=BC4GYZQ65K5O7GEZ22VLJZS7D7RUAUKAAAWNHTIUTCAXFIADN2FQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.826900433 (93h35m21.257980564s) [noise=true , address=66.23.193.175:4556 , piece_id=ESYW5RKVRYQVQ5E7X5PN3CLRMMD2JH52TBAABKKIDMHTJBETLB5Q, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.827206137 (93h35m21.258286278s) [noise=true , address=104.36.82.38:4714 , piece_id=IEHINNYDCXRJTUWN23QCLWBAAD37T2USMLBK4QU3SAI2JVRN56MQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.827543363 (93h35m21.258623494s) [noise=true , address=79.127.201.215:4339 , piece_id=LUJWSRNKEHVNLZHFZODSIVN3JYKNRFV2XURCLBNX5H4SC7WDYTOQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:27.933120459 (93h35m22.36420059s) [upload=97493]: Next returned nil segment
Aug 12 15:01:27.933133884 (93h35m22.364214005s) [upload=97493]: Waiting for error group managing segments...
Aug 12 15:01:28.238514083 (93h35m22.669594214s) [noise=true , address=66.23.193.175:4556 , piece_id=ESYW5RKVRYQVQ5E7X5PN3CLRMMD2JH52TBAABKKIDMHTJBETLB5Q, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.264853991 (93h35m22.695934122s) [noise=true , address=64.49.13.140:4505 , piece_id=TWIZAVJMJ2NNDCZZZQMEO2RPKWQCOLSL2EDRO7IFJD2XNWLLHX5A, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.315992316 (93h35m22.747072447s) [noise=true , address=64.49.13.27:4967 , piece_id=I36U7ASIL6G5PVPN3KGR63G7ZZI5X7S7XLWWYERTNGQBQFQ6GHIQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.799326435 (93h35m23.230406566s) [noise=true , address=104.36.82.8:4003 , piece_id=OHQK6BPMKBL65RPEHNYSRY3UGUOZZYPZP5RNTSLJH7SNVLWOKLLQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.852936730 (93h35m23.284016861s) [noise=true , address=104.36.82.36:4625 , piece_id=7G4PVYFPS2BHBABGKC5YGD3UDYBFLYUIQTQ6L7SZBHRXN74PTHWQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.862997771 (93h35m23.294077902s) [noise=true , address=104.36.82.23:4467 , piece_id=A6KQFAXBS6XOPT2YL4IS3ZQNM6WR7RES3AZWZJ6D4ZFUBHCCSGFA, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.863970302 (93h35m23.295050433s) [noise=true , address=104.36.82.35:4595 , piece_id=BC4GYZQ65K5O7GEZ22VLJZS7D7RUAUKAAAWNHTIUTCAXFIADN2FQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.886095033 (93h35m23.317175164s) [noise=true , address=104.36.82.44:4899 , piece_id=DJCURPMNBUYMXOYMPT2LEHU2PVHQIBNV75WMDBDFMAVVL6AO3UAQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.890302854 (93h35m23.321382985s) [noise=true , address=104.36.82.58:4278 , piece_id=Z6R74M7WZDWYZ7F2FTMSK436D7CCNS6BXE4OULITDZAGKFOVMPRA, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.908055482 (93h35m23.339135613s) [noise=true , address=77.90.31.12:4593 , piece_id=6DVTDXLPTUENXCUQECFJW5ACGEB5Q4LTYGEPPB5BNBBDQIXCMDHA, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.934711693 (93h35m23.365791824s) [noise=true , address=104.36.82.13:4192 , piece_id=L7PW4CKH26NN3EDHALABVHUHESLK6ASSNSY4SCHUMM6J3M4PVY5Q, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.960332926 (93h35m23.391413057s) [noise=true , address=104.36.82.62:4420 , piece_id=GX2W3MVM7MHHHISFL6SJN622RG262DHFJ2ORF6ZU67TX7DNBL4DQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.983488722 (93h35m23.414568853s) [noise=true , address=104.36.82.38:4714 , piece_id=IEHINNYDCXRJTUWN23QCLWBAAD37T2USMLBK4QU3SAI2JVRN56MQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:29.042331258 (93h35m23.473411389s) [noise=true , address=104.36.82.51:4054 , piece_id=I3UMEPPFLCY25TGLWXPSQZCKFKX6PBCSIA3A6M3SKBFUVXRZN4QQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:29.042369091 (93h35m23.473449232s) [seg_pos={0 0}, upload=97493]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:01:29.042530990 (93h35m23.473611121s) [noise=true , address=79.127.201.215:4339 , piece_id=LUJWSRNKEHVNLZHFZODSIVN3JYKNRFV2XURCLBNX5H4SC7WDYTOQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vNk3EQzMohodu6TGCkt9UGUunnNUyXpMQCXak64JGicyc4Xyo): protocol: expected piece hash; context canceled; EOF
Aug 12 15:01:29.042723919 (93h35m23.47380405s) [noise=true , address=104.36.82.60:4343 , piece_id=MDBL7DLJWML5GOUZBY6VXAGNDO2YSR2PS2AKUY44DJW2L3TDEQDA, seg_pos={0 0}, upload=97493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf): protocol: read tcp 188.166.225.170:43242->104.36.82.60:4343: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:01:29.042799283 (93h35m23.473879414s) [noise=true , address=79.127.220.101:4064 , piece_id=B3UDD62AWCFJVZOICNLEE5I54X3WZY2OERFBMOS5ELJXX6J346YQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR6PSfT1N7kcFL8s7he9BZpXBechW7HELcP7yA91mr6iF9CkA): protocol: expected piece hash; context canceled; EOF
Aug 12 15:01:29.042836145 (93h35m23.473916276s) [noise=true , address=77.90.31.10:4523 , piece_id=VZRIGFFYRQUPTMV3GRGSR46E5XPA2MMTUQ2ROL76H2J3YBLC4SHQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF
Aug 12 15:01:29.042848648 (93h35m23.473928779s) [seg_pos={0 0}, upload=97493]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:01:29.042991351 (93h35m23.474071482s) [upload=97493]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:01:29.042997472 (93h35m23.474077603s) [upload=97493]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:01:29.342427738 (93h35m23.773507879s) [upload=97493]: Done uploading segments...
Aug 12 15:01:29.342449068 (93h35m23.773529199s) [upload=97493]: Upload finished. err: <nil>
Duration: 6.981489082s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................................X..X.] duration:
1.874853266s
FAIL (2025-08-12 15:03:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 4e74452dc4a6cbb84c19c38ae09de2a14792ba0455f3fd49dd4b09585d5db40d != before 1807f36a3be378809fe937cebf225cac8f9699b81a1e5d17f82d72ac39a6a1a7 ======LOGS====== Aug 12 15:02:01.334418071 (93h35m55.765498202s) [upload=97502]: Starting upload Aug 12 15:02:01.334498996 (93h35m55.765579127s) [upload=97502]: Done starting upload Aug 12 15:02:01.334566566 (93h35m55.765646697s) [upload=97502]: Uploading segments... Aug 12 15:02:01.334618995 (93h35m55.765699126s) [upload=97502]: Got next segment. Inline: true Aug 12 15:02:01.334623204 (93h35m55.765703335s) [upload=97502]: Waiting for error group managing segments... Aug 12 15:02:01.334658531 (93h35m55.765738662s) [upload=97502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 15:02:01.334662258 (93h35m55.765742389s) [upload=97502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 15:02:01.334664613 (93h35m55.765744734s) [upload=97502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 15:02:01.612866971 (93h35m56.043947102s) [upload=97502]: Done uploading segments... Aug 12 15:02:01.612886870 (93h35m56.043967001s) [upload=97502]: Upload finished. err: <nil>
Duration: 1.874884946s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................X............X.................X.] duration:
7.02882593s
FAIL (2025-08-12 15:02:30 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 15:01:26.368920538 (93h35m20.800000669s) [upload=97493]: Starting upload
Aug 12 15:01:26.368991163 (93h35m20.800071284s) [upload=97493]: Done starting upload
Aug 12 15:01:26.369056809 (93h35m20.80013695s) [upload=97493]: Uploading segments...
Aug 12 15:01:26.369169664 (93h35m20.800249795s) [upload=97493]: Got next segment. Inline: false
Aug 12 15:01:26.369221925 (93h35m20.800302056s) [upload=97493]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:01:26.369226734 (93h35m20.800306865s) [upload=97493]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:01:26.822529129 (93h35m21.25360927s) [seg_pos={0 0}, upload=97493]: Begin upload segment...
Aug 12 15:01:26.822591820 (93h35m21.253671951s) [seg_pos={0 0}, upload=97493]: Done begin upload segment.
Aug 12 15:01:26.822616686 (93h35m21.253696827s) [noise=true , address=104.36.82.51:4054 , piece_id=I3UMEPPFLCY25TGLWXPSQZCKFKX6PBCSIA3A6M3SKBFUVXRZN4QQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.822629582 (93h35m21.253709713s) [noise=true , address=104.36.82.13:4192 , piece_id=L7PW4CKH26NN3EDHALABVHUHESLK6ASSNSY4SCHUMM6J3M4PVY5Q, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.822680549 (93h35m21.25376068s) [noise=true , address=104.36.82.60:4343 , piece_id=MDBL7DLJWML5GOUZBY6VXAGNDO2YSR2PS2AKUY44DJW2L3TDEQDA, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.822970243 (93h35m21.254050414s) [noise=true , address=79.127.220.101:4064 , piece_id=B3UDD62AWCFJVZOICNLEE5I54X3WZY2OERFBMOS5ELJXX6J346YQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.823432728 (93h35m21.254512889s) [noise=true , address=104.36.82.62:4420 , piece_id=GX2W3MVM7MHHHISFL6SJN622RG262DHFJ2ORF6ZU67TX7DNBL4DQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.823584900 (93h35m21.254665061s) [noise=true , address=104.36.82.44:4899 , piece_id=DJCURPMNBUYMXOYMPT2LEHU2PVHQIBNV75WMDBDFMAVVL6AO3UAQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.823887689 (93h35m21.25496783s) [noise=true , address=77.90.31.10:4523 , piece_id=VZRIGFFYRQUPTMV3GRGSR46E5XPA2MMTUQ2ROL76H2J3YBLC4SHQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.823958995 (93h35m21.255039126s) [noise=true , address=104.36.82.36:4625 , piece_id=7G4PVYFPS2BHBABGKC5YGD3UDYBFLYUIQTQ6L7SZBHRXN74PTHWQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.824452018 (93h35m21.255532149s) [noise=true , address=104.36.82.23:4467 , piece_id=A6KQFAXBS6XOPT2YL4IS3ZQNM6WR7RES3AZWZJ6D4ZFUBHCCSGFA, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.824829441 (93h35m21.255909572s) [noise=true , address=64.49.13.27:4967 , piece_id=I36U7ASIL6G5PVPN3KGR63G7ZZI5X7S7XLWWYERTNGQBQFQ6GHIQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.825177066 (93h35m21.256257197s) [noise=true , address=64.49.13.140:4505 , piece_id=TWIZAVJMJ2NNDCZZZQMEO2RPKWQCOLSL2EDRO7IFJD2XNWLLHX5A, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.825582411 (93h35m21.256662552s) [noise=true , address=77.90.31.12:4593 , piece_id=6DVTDXLPTUENXCUQECFJW5ACGEB5Q4LTYGEPPB5BNBBDQIXCMDHA, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.825945205 (93h35m21.257025336s) [noise=true , address=104.36.82.8:4003 , piece_id=OHQK6BPMKBL65RPEHNYSRY3UGUOZZYPZP5RNTSLJH7SNVLWOKLLQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.826248075 (93h35m21.257328216s) [noise=true , address=104.36.82.58:4278 , piece_id=Z6R74M7WZDWYZ7F2FTMSK436D7CCNS6BXE4OULITDZAGKFOVMPRA, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.826584258 (93h35m21.257664389s) [noise=true , address=104.36.82.35:4595 , piece_id=BC4GYZQ65K5O7GEZ22VLJZS7D7RUAUKAAAWNHTIUTCAXFIADN2FQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.826900433 (93h35m21.257980564s) [noise=true , address=66.23.193.175:4556 , piece_id=ESYW5RKVRYQVQ5E7X5PN3CLRMMD2JH52TBAABKKIDMHTJBETLB5Q, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.827206137 (93h35m21.258286278s) [noise=true , address=104.36.82.38:4714 , piece_id=IEHINNYDCXRJTUWN23QCLWBAAD37T2USMLBK4QU3SAI2JVRN56MQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.827543363 (93h35m21.258623494s) [noise=true , address=79.127.201.215:4339 , piece_id=LUJWSRNKEHVNLZHFZODSIVN3JYKNRFV2XURCLBNX5H4SC7WDYTOQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:27.933120459 (93h35m22.36420059s) [upload=97493]: Next returned nil segment
Aug 12 15:01:27.933133884 (93h35m22.364214005s) [upload=97493]: Waiting for error group managing segments...
Aug 12 15:01:28.238514083 (93h35m22.669594214s) [noise=true , address=66.23.193.175:4556 , piece_id=ESYW5RKVRYQVQ5E7X5PN3CLRMMD2JH52TBAABKKIDMHTJBETLB5Q, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.264853991 (93h35m22.695934122s) [noise=true , address=64.49.13.140:4505 , piece_id=TWIZAVJMJ2NNDCZZZQMEO2RPKWQCOLSL2EDRO7IFJD2XNWLLHX5A, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.315992316 (93h35m22.747072447s) [noise=true , address=64.49.13.27:4967 , piece_id=I36U7ASIL6G5PVPN3KGR63G7ZZI5X7S7XLWWYERTNGQBQFQ6GHIQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.799326435 (93h35m23.230406566s) [noise=true , address=104.36.82.8:4003 , piece_id=OHQK6BPMKBL65RPEHNYSRY3UGUOZZYPZP5RNTSLJH7SNVLWOKLLQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.852936730 (93h35m23.284016861s) [noise=true , address=104.36.82.36:4625 , piece_id=7G4PVYFPS2BHBABGKC5YGD3UDYBFLYUIQTQ6L7SZBHRXN74PTHWQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.862997771 (93h35m23.294077902s) [noise=true , address=104.36.82.23:4467 , piece_id=A6KQFAXBS6XOPT2YL4IS3ZQNM6WR7RES3AZWZJ6D4ZFUBHCCSGFA, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.863970302 (93h35m23.295050433s) [noise=true , address=104.36.82.35:4595 , piece_id=BC4GYZQ65K5O7GEZ22VLJZS7D7RUAUKAAAWNHTIUTCAXFIADN2FQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.886095033 (93h35m23.317175164s) [noise=true , address=104.36.82.44:4899 , piece_id=DJCURPMNBUYMXOYMPT2LEHU2PVHQIBNV75WMDBDFMAVVL6AO3UAQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.890302854 (93h35m23.321382985s) [noise=true , address=104.36.82.58:4278 , piece_id=Z6R74M7WZDWYZ7F2FTMSK436D7CCNS6BXE4OULITDZAGKFOVMPRA, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.908055482 (93h35m23.339135613s) [noise=true , address=77.90.31.12:4593 , piece_id=6DVTDXLPTUENXCUQECFJW5ACGEB5Q4LTYGEPPB5BNBBDQIXCMDHA, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.934711693 (93h35m23.365791824s) [noise=true , address=104.36.82.13:4192 , piece_id=L7PW4CKH26NN3EDHALABVHUHESLK6ASSNSY4SCHUMM6J3M4PVY5Q, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.960332926 (93h35m23.391413057s) [noise=true , address=104.36.82.62:4420 , piece_id=GX2W3MVM7MHHHISFL6SJN622RG262DHFJ2ORF6ZU67TX7DNBL4DQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.983488722 (93h35m23.414568853s) [noise=true , address=104.36.82.38:4714 , piece_id=IEHINNYDCXRJTUWN23QCLWBAAD37T2USMLBK4QU3SAI2JVRN56MQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:29.042331258 (93h35m23.473411389s) [noise=true , address=104.36.82.51:4054 , piece_id=I3UMEPPFLCY25TGLWXPSQZCKFKX6PBCSIA3A6M3SKBFUVXRZN4QQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:29.042369091 (93h35m23.473449232s) [seg_pos={0 0}, upload=97493]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:01:29.042530990 (93h35m23.473611121s) [noise=true , address=79.127.201.215:4339 , piece_id=LUJWSRNKEHVNLZHFZODSIVN3JYKNRFV2XURCLBNX5H4SC7WDYTOQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vNk3EQzMohodu6TGCkt9UGUunnNUyXpMQCXak64JGicyc4Xyo): protocol: expected piece hash; context canceled; EOF
Aug 12 15:01:29.042723919 (93h35m23.47380405s) [noise=true , address=104.36.82.60:4343 , piece_id=MDBL7DLJWML5GOUZBY6VXAGNDO2YSR2PS2AKUY44DJW2L3TDEQDA, seg_pos={0 0}, upload=97493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf): protocol: read tcp 188.166.225.170:43242->104.36.82.60:4343: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:01:29.042799283 (93h35m23.473879414s) [noise=true , address=79.127.220.101:4064 , piece_id=B3UDD62AWCFJVZOICNLEE5I54X3WZY2OERFBMOS5ELJXX6J346YQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR6PSfT1N7kcFL8s7he9BZpXBechW7HELcP7yA91mr6iF9CkA): protocol: expected piece hash; context canceled; EOF
Aug 12 15:01:29.042836145 (93h35m23.473916276s) [noise=true , address=77.90.31.10:4523 , piece_id=VZRIGFFYRQUPTMV3GRGSR46E5XPA2MMTUQ2ROL76H2J3YBLC4SHQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF
Aug 12 15:01:29.042848648 (93h35m23.473928779s) [seg_pos={0 0}, upload=97493]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:01:29.042991351 (93h35m23.474071482s) [upload=97493]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:01:29.042997472 (93h35m23.474077603s) [upload=97493]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:01:29.342427738 (93h35m23.773507879s) [upload=97493]: Done uploading segments...
Aug 12 15:01:29.342449068 (93h35m23.773529199s) [upload=97493]: Upload finished. err: <nil>
Duration: 7.028853924s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................................................X..X] duration:
1.61447602s
FAIL (2025-08-12 15:02:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 4e74452dc4a6cbb84c19c38ae09de2a14792ba0455f3fd49dd4b09585d5db40d != before 1807f36a3be378809fe937cebf225cac8f9699b81a1e5d17f82d72ac39a6a1a7 ======LOGS====== Aug 12 15:02:01.334418071 (93h35m55.765498202s) [upload=97502]: Starting upload Aug 12 15:02:01.334498996 (93h35m55.765579127s) [upload=97502]: Done starting upload Aug 12 15:02:01.334566566 (93h35m55.765646697s) [upload=97502]: Uploading segments... Aug 12 15:02:01.334618995 (93h35m55.765699126s) [upload=97502]: Got next segment. Inline: true Aug 12 15:02:01.334623204 (93h35m55.765703335s) [upload=97502]: Waiting for error group managing segments... Aug 12 15:02:01.334658531 (93h35m55.765738662s) [upload=97502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 15:02:01.334662258 (93h35m55.765742389s) [upload=97502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 15:02:01.334664613 (93h35m55.765744734s) [upload=97502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 15:02:01.612866971 (93h35m56.043947102s) [upload=97502]: Done uploading segments... Aug 12 15:02:01.612886870 (93h35m56.043967001s) [upload=97502]: Upload finished. err: <nil>
Duration: 1.614499264s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............................X............X.................X] duration:
4.140491811s
FAIL (2025-08-12 15:01:29 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 15:01:26.368920538 (93h35m20.800000669s) [upload=97493]: Starting upload
Aug 12 15:01:26.368991163 (93h35m20.800071284s) [upload=97493]: Done starting upload
Aug 12 15:01:26.369056809 (93h35m20.80013695s) [upload=97493]: Uploading segments...
Aug 12 15:01:26.369169664 (93h35m20.800249795s) [upload=97493]: Got next segment. Inline: false
Aug 12 15:01:26.369221925 (93h35m20.800302056s) [upload=97493]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:01:26.369226734 (93h35m20.800306865s) [upload=97493]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:01:26.822529129 (93h35m21.25360927s) [seg_pos={0 0}, upload=97493]: Begin upload segment...
Aug 12 15:01:26.822591820 (93h35m21.253671951s) [seg_pos={0 0}, upload=97493]: Done begin upload segment.
Aug 12 15:01:26.822616686 (93h35m21.253696827s) [noise=true , address=104.36.82.51:4054 , piece_id=I3UMEPPFLCY25TGLWXPSQZCKFKX6PBCSIA3A6M3SKBFUVXRZN4QQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.822629582 (93h35m21.253709713s) [noise=true , address=104.36.82.13:4192 , piece_id=L7PW4CKH26NN3EDHALABVHUHESLK6ASSNSY4SCHUMM6J3M4PVY5Q, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.822680549 (93h35m21.25376068s) [noise=true , address=104.36.82.60:4343 , piece_id=MDBL7DLJWML5GOUZBY6VXAGNDO2YSR2PS2AKUY44DJW2L3TDEQDA, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.822970243 (93h35m21.254050414s) [noise=true , address=79.127.220.101:4064 , piece_id=B3UDD62AWCFJVZOICNLEE5I54X3WZY2OERFBMOS5ELJXX6J346YQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.823432728 (93h35m21.254512889s) [noise=true , address=104.36.82.62:4420 , piece_id=GX2W3MVM7MHHHISFL6SJN622RG262DHFJ2ORF6ZU67TX7DNBL4DQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.823584900 (93h35m21.254665061s) [noise=true , address=104.36.82.44:4899 , piece_id=DJCURPMNBUYMXOYMPT2LEHU2PVHQIBNV75WMDBDFMAVVL6AO3UAQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.823887689 (93h35m21.25496783s) [noise=true , address=77.90.31.10:4523 , piece_id=VZRIGFFYRQUPTMV3GRGSR46E5XPA2MMTUQ2ROL76H2J3YBLC4SHQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.823958995 (93h35m21.255039126s) [noise=true , address=104.36.82.36:4625 , piece_id=7G4PVYFPS2BHBABGKC5YGD3UDYBFLYUIQTQ6L7SZBHRXN74PTHWQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.824452018 (93h35m21.255532149s) [noise=true , address=104.36.82.23:4467 , piece_id=A6KQFAXBS6XOPT2YL4IS3ZQNM6WR7RES3AZWZJ6D4ZFUBHCCSGFA, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.824829441 (93h35m21.255909572s) [noise=true , address=64.49.13.27:4967 , piece_id=I36U7ASIL6G5PVPN3KGR63G7ZZI5X7S7XLWWYERTNGQBQFQ6GHIQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.825177066 (93h35m21.256257197s) [noise=true , address=64.49.13.140:4505 , piece_id=TWIZAVJMJ2NNDCZZZQMEO2RPKWQCOLSL2EDRO7IFJD2XNWLLHX5A, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.825582411 (93h35m21.256662552s) [noise=true , address=77.90.31.12:4593 , piece_id=6DVTDXLPTUENXCUQECFJW5ACGEB5Q4LTYGEPPB5BNBBDQIXCMDHA, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.825945205 (93h35m21.257025336s) [noise=true , address=104.36.82.8:4003 , piece_id=OHQK6BPMKBL65RPEHNYSRY3UGUOZZYPZP5RNTSLJH7SNVLWOKLLQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.826248075 (93h35m21.257328216s) [noise=true , address=104.36.82.58:4278 , piece_id=Z6R74M7WZDWYZ7F2FTMSK436D7CCNS6BXE4OULITDZAGKFOVMPRA, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.826584258 (93h35m21.257664389s) [noise=true , address=104.36.82.35:4595 , piece_id=BC4GYZQ65K5O7GEZ22VLJZS7D7RUAUKAAAWNHTIUTCAXFIADN2FQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.826900433 (93h35m21.257980564s) [noise=true , address=66.23.193.175:4556 , piece_id=ESYW5RKVRYQVQ5E7X5PN3CLRMMD2JH52TBAABKKIDMHTJBETLB5Q, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.827206137 (93h35m21.258286278s) [noise=true , address=104.36.82.38:4714 , piece_id=IEHINNYDCXRJTUWN23QCLWBAAD37T2USMLBK4QU3SAI2JVRN56MQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:26.827543363 (93h35m21.258623494s) [noise=true , address=79.127.201.215:4339 , piece_id=LUJWSRNKEHVNLZHFZODSIVN3JYKNRFV2XURCLBNX5H4SC7WDYTOQ, seg_pos={0 0}, upload=97493]: Uploading piece...
Aug 12 15:01:27.933120459 (93h35m22.36420059s) [upload=97493]: Next returned nil segment
Aug 12 15:01:27.933133884 (93h35m22.364214005s) [upload=97493]: Waiting for error group managing segments...
Aug 12 15:01:28.238514083 (93h35m22.669594214s) [noise=true , address=66.23.193.175:4556 , piece_id=ESYW5RKVRYQVQ5E7X5PN3CLRMMD2JH52TBAABKKIDMHTJBETLB5Q, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.264853991 (93h35m22.695934122s) [noise=true , address=64.49.13.140:4505 , piece_id=TWIZAVJMJ2NNDCZZZQMEO2RPKWQCOLSL2EDRO7IFJD2XNWLLHX5A, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.315992316 (93h35m22.747072447s) [noise=true , address=64.49.13.27:4967 , piece_id=I36U7ASIL6G5PVPN3KGR63G7ZZI5X7S7XLWWYERTNGQBQFQ6GHIQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.799326435 (93h35m23.230406566s) [noise=true , address=104.36.82.8:4003 , piece_id=OHQK6BPMKBL65RPEHNYSRY3UGUOZZYPZP5RNTSLJH7SNVLWOKLLQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.852936730 (93h35m23.284016861s) [noise=true , address=104.36.82.36:4625 , piece_id=7G4PVYFPS2BHBABGKC5YGD3UDYBFLYUIQTQ6L7SZBHRXN74PTHWQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.862997771 (93h35m23.294077902s) [noise=true , address=104.36.82.23:4467 , piece_id=A6KQFAXBS6XOPT2YL4IS3ZQNM6WR7RES3AZWZJ6D4ZFUBHCCSGFA, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.863970302 (93h35m23.295050433s) [noise=true , address=104.36.82.35:4595 , piece_id=BC4GYZQ65K5O7GEZ22VLJZS7D7RUAUKAAAWNHTIUTCAXFIADN2FQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.886095033 (93h35m23.317175164s) [noise=true , address=104.36.82.44:4899 , piece_id=DJCURPMNBUYMXOYMPT2LEHU2PVHQIBNV75WMDBDFMAVVL6AO3UAQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.890302854 (93h35m23.321382985s) [noise=true , address=104.36.82.58:4278 , piece_id=Z6R74M7WZDWYZ7F2FTMSK436D7CCNS6BXE4OULITDZAGKFOVMPRA, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.908055482 (93h35m23.339135613s) [noise=true , address=77.90.31.12:4593 , piece_id=6DVTDXLPTUENXCUQECFJW5ACGEB5Q4LTYGEPPB5BNBBDQIXCMDHA, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.934711693 (93h35m23.365791824s) [noise=true , address=104.36.82.13:4192 , piece_id=L7PW4CKH26NN3EDHALABVHUHESLK6ASSNSY4SCHUMM6J3M4PVY5Q, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.960332926 (93h35m23.391413057s) [noise=true , address=104.36.82.62:4420 , piece_id=GX2W3MVM7MHHHISFL6SJN622RG262DHFJ2ORF6ZU67TX7DNBL4DQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:28.983488722 (93h35m23.414568853s) [noise=true , address=104.36.82.38:4714 , piece_id=IEHINNYDCXRJTUWN23QCLWBAAD37T2USMLBK4QU3SAI2JVRN56MQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:29.042331258 (93h35m23.473411389s) [noise=true , address=104.36.82.51:4054 , piece_id=I3UMEPPFLCY25TGLWXPSQZCKFKX6PBCSIA3A6M3SKBFUVXRZN4QQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: <nil>
Aug 12 15:01:29.042369091 (93h35m23.473449232s) [seg_pos={0 0}, upload=97493]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:01:29.042530990 (93h35m23.473611121s) [noise=true , address=79.127.201.215:4339 , piece_id=LUJWSRNKEHVNLZHFZODSIVN3JYKNRFV2XURCLBNX5H4SC7WDYTOQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vNk3EQzMohodu6TGCkt9UGUunnNUyXpMQCXak64JGicyc4Xyo): protocol: expected piece hash; context canceled; EOF
Aug 12 15:01:29.042723919 (93h35m23.47380405s) [noise=true , address=104.36.82.60:4343 , piece_id=MDBL7DLJWML5GOUZBY6VXAGNDO2YSR2PS2AKUY44DJW2L3TDEQDA, seg_pos={0 0}, upload=97493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf): protocol: read tcp 188.166.225.170:43242->104.36.82.60:4343: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:01:29.042799283 (93h35m23.473879414s) [noise=true , address=79.127.220.101:4064 , piece_id=B3UDD62AWCFJVZOICNLEE5I54X3WZY2OERFBMOS5ELJXX6J346YQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR6PSfT1N7kcFL8s7he9BZpXBechW7HELcP7yA91mr6iF9CkA): protocol: expected piece hash; context canceled; EOF
Aug 12 15:01:29.042836145 (93h35m23.473916276s) [noise=true , address=77.90.31.10:4523 , piece_id=VZRIGFFYRQUPTMV3GRGSR46E5XPA2MMTUQ2ROL76H2J3YBLC4SHQ, seg_pos={0 0}, upload=97493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF
Aug 12 15:01:29.042848648 (93h35m23.473928779s) [seg_pos={0 0}, upload=97493]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:01:29.042991351 (93h35m23.474071482s) [upload=97493]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:01:29.042997472 (93h35m23.474077603s) [upload=97493]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:01:29.342427738 (93h35m23.773507879s) [upload=97493]: Done uploading segments...
Aug 12 15:01:29.342449068 (93h35m23.773529199s) [upload=97493]: Upload finished. err: <nil>
Duration: 4.140536777s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
1.986415006s
FAIL (2025-08-12 15:01:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 12 14:59:37.838205232 (93h33m32.269285363s) [upload=97460]: Starting upload
Aug 12 14:59:37.838248856 (93h33m32.269328987s) [upload=97460]: Done starting upload
Aug 12 14:59:37.838294624 (93h33m32.269374755s) [upload=97460]: Uploading segments...
Aug 12 14:59:37.838340301 (93h33m32.269420422s) [upload=97460]: Got next segment. Inline: true
Aug 12 14:59:37.838343879 (93h33m32.269424s) [upload=97460]: Waiting for error group managing segments...
Aug 12 14:59:37.838374968 (93h33m32.269455099s) [upload=97460]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:59:37.838379086 (93h33m32.269459207s) [upload=97460]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 14:59:37.838381721 (93h33m32.269461852s) [upload=97460]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:59:38.131502776 (93h33m32.562582907s) [upload=97460]: Done uploading segments...
Aug 12 14:59:38.131533685 (93h33m32.562613806s) [upload=97460]: Upload finished. err: <nil>
Duration: 1.986460184s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
1.896289296s
FAIL (2025-08-12 15:00:39 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 12 14:59:37.838205232 (93h33m32.269285363s) [upload=97460]: Starting upload
Aug 12 14:59:37.838248856 (93h33m32.269328987s) [upload=97460]: Done starting upload
Aug 12 14:59:37.838294624 (93h33m32.269374755s) [upload=97460]: Uploading segments...
Aug 12 14:59:37.838340301 (93h33m32.269420422s) [upload=97460]: Got next segment. Inline: true
Aug 12 14:59:37.838343879 (93h33m32.269424s) [upload=97460]: Waiting for error group managing segments...
Aug 12 14:59:37.838374968 (93h33m32.269455099s) [upload=97460]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:59:37.838379086 (93h33m32.269459207s) [upload=97460]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 14:59:37.838381721 (93h33m32.269461852s) [upload=97460]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:59:38.131502776 (93h33m32.562582907s) [upload=97460]: Done uploading segments...
Aug 12 14:59:38.131533685 (93h33m32.562613806s) [upload=97460]: Upload finished. err: <nil>
Duration: 1.896326367s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X............................X............X.................] duration:
6.151938631s
FAIL (2025-08-12 15:00:31 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:46:57.924548428 (93h20m52.355628559s) [upload=97244]: Starting upload
Aug 12 14:46:57.924597912 (93h20m52.355678044s) [upload=97244]: Done starting upload
Aug 12 14:46:57.924686101 (93h20m52.355766232s) [upload=97244]: Uploading segments...
Aug 12 14:46:57.924802413 (93h20m52.355882544s) [upload=97244]: Got next segment. Inline: false
Aug 12 14:46:57.924831960 (93h20m52.355912091s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:46:57.924836418 (93h20m52.355916549s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:46:58.421034079 (93h20m52.85211427s) [seg_pos={0 0}, upload=97244]: Begin upload segment...
Aug 12 14:46:58.421104814 (93h20m52.852184985s) [seg_pos={0 0}, upload=97244]: Done begin upload segment.
Aug 12 14:46:58.421137337 (93h20m52.852217508s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421156032 (93h20m52.852236183s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421240904 (93h20m52.852321065s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422100981 (93h20m52.853181162s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422121699 (93h20m52.853201841s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422701420 (93h20m52.853781551s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422713542 (93h20m52.853793693s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423256251 (93h20m52.854336382s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423677006 (93h20m52.854757147s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424097701 (93h20m52.855177842s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424551269 (93h20m52.85563141s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424994797 (93h20m52.856074928s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425376417 (93h20m52.856456548s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425699776 (93h20m52.856779917s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.426998130 (93h20m52.858078261s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.427769887 (93h20m52.858850018s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.428073748 (93h20m52.859153889s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.429050167 (93h20m52.860130298s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:59.614614268 (93h20m54.045694399s) [upload=97244]: Next returned nil segment
Aug 12 14:46:59.614630349 (93h20m54.04571048s) [upload=97244]: Waiting for error group managing segments...
Aug 12 14:46:59.919657162 (93h20m54.350737294s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:46:59.970918834 (93h20m54.401998965s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.389939738 (93h20m54.821019869s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.392389675 (93h20m54.823469806s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.404026140 (93h20m54.835106271s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.424626395 (93h20m54.855706526s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.448466771 (93h20m54.879546902s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.464837894 (93h20m54.895918025s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.486210978 (93h20m54.917291119s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.496331062 (93h20m54.927411193s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.518790413 (93h20m54.949870544s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.539714178 (93h20m54.970794309s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.563779413 (93h20m54.994859544s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741387681 (93h20m55.172467812s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741420123 (93h20m55.172500254s) [seg_pos={0 0}, upload=97244]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:47:00.741592052 (93h20m55.172672183s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741631777 (93h20m55.172711908s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tn1Sd8Gk3eHSmToBnPGjCyaAdQpUQrhiGe5cuecwBCpd7kEyT): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741680521 (93h20m55.172760652s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Egk1BCBmtjUZcwJKpoQjfrubA2czJKMEai5bzDqkPmXTRhaB6): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741733332 (93h20m55.172813473s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741747449 (93h20m55.17282758s) [seg_pos={0 0}, upload=97244]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:47:00.741852279 (93h20m55.17293242s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:47:00.741858261 (93h20m55.172938392s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:47:01.066168749 (93h20m55.49724888s) [upload=97244]: Done uploading segments...
Aug 12 14:47:01.066187886 (93h20m55.497268017s) [upload=97244]: Upload finished. err: <nil>
Duration: 6.151959501s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X............................X............X................] duration:
5.948641304s
FAIL (2025-08-12 15:00:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:46:57.924548428 (93h20m52.355628559s) [upload=97244]: Starting upload
Aug 12 14:46:57.924597912 (93h20m52.355678044s) [upload=97244]: Done starting upload
Aug 12 14:46:57.924686101 (93h20m52.355766232s) [upload=97244]: Uploading segments...
Aug 12 14:46:57.924802413 (93h20m52.355882544s) [upload=97244]: Got next segment. Inline: false
Aug 12 14:46:57.924831960 (93h20m52.355912091s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:46:57.924836418 (93h20m52.355916549s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:46:58.421034079 (93h20m52.85211427s) [seg_pos={0 0}, upload=97244]: Begin upload segment...
Aug 12 14:46:58.421104814 (93h20m52.852184985s) [seg_pos={0 0}, upload=97244]: Done begin upload segment.
Aug 12 14:46:58.421137337 (93h20m52.852217508s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421156032 (93h20m52.852236183s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421240904 (93h20m52.852321065s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422100981 (93h20m52.853181162s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422121699 (93h20m52.853201841s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422701420 (93h20m52.853781551s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422713542 (93h20m52.853793693s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423256251 (93h20m52.854336382s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423677006 (93h20m52.854757147s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424097701 (93h20m52.855177842s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424551269 (93h20m52.85563141s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424994797 (93h20m52.856074928s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425376417 (93h20m52.856456548s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425699776 (93h20m52.856779917s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.426998130 (93h20m52.858078261s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.427769887 (93h20m52.858850018s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.428073748 (93h20m52.859153889s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.429050167 (93h20m52.860130298s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:59.614614268 (93h20m54.045694399s) [upload=97244]: Next returned nil segment
Aug 12 14:46:59.614630349 (93h20m54.04571048s) [upload=97244]: Waiting for error group managing segments...
Aug 12 14:46:59.919657162 (93h20m54.350737294s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:46:59.970918834 (93h20m54.401998965s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.389939738 (93h20m54.821019869s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.392389675 (93h20m54.823469806s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.404026140 (93h20m54.835106271s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.424626395 (93h20m54.855706526s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.448466771 (93h20m54.879546902s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.464837894 (93h20m54.895918025s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.486210978 (93h20m54.917291119s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.496331062 (93h20m54.927411193s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.518790413 (93h20m54.949870544s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.539714178 (93h20m54.970794309s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.563779413 (93h20m54.994859544s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741387681 (93h20m55.172467812s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741420123 (93h20m55.172500254s) [seg_pos={0 0}, upload=97244]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:47:00.741592052 (93h20m55.172672183s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741631777 (93h20m55.172711908s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tn1Sd8Gk3eHSmToBnPGjCyaAdQpUQrhiGe5cuecwBCpd7kEyT): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741680521 (93h20m55.172760652s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Egk1BCBmtjUZcwJKpoQjfrubA2czJKMEai5bzDqkPmXTRhaB6): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741733332 (93h20m55.172813473s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741747449 (93h20m55.17282758s) [seg_pos={0 0}, upload=97244]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:47:00.741852279 (93h20m55.17293242s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:47:00.741858261 (93h20m55.172938392s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:47:01.066168749 (93h20m55.49724888s) [upload=97244]: Done uploading segments...
Aug 12 14:47:01.066187886 (93h20m55.497268017s) [upload=97244]: Upload finished. err: <nil>
Duration: 5.948672905s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1.626910491s
FAIL (2025-08-12 14:59:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 12 14:59:37.838205232 (93h33m32.269285363s) [upload=97460]: Starting upload
Aug 12 14:59:37.838248856 (93h33m32.269328987s) [upload=97460]: Done starting upload
Aug 12 14:59:37.838294624 (93h33m32.269374755s) [upload=97460]: Uploading segments...
Aug 12 14:59:37.838340301 (93h33m32.269420422s) [upload=97460]: Got next segment. Inline: true
Aug 12 14:59:37.838343879 (93h33m32.269424s) [upload=97460]: Waiting for error group managing segments...
Aug 12 14:59:37.838374968 (93h33m32.269455099s) [upload=97460]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:59:37.838379086 (93h33m32.269459207s) [upload=97460]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 14:59:37.838381721 (93h33m32.269461852s) [upload=97460]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:59:38.131502776 (93h33m32.562582907s) [upload=97460]: Done uploading segments...
Aug 12 14:59:38.131533685 (93h33m32.562613806s) [upload=97460]: Upload finished. err: <nil>
Duration: 1.626928836s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X............................X............X...............] duration:
6.503609238s
FAIL (2025-08-12 14:59:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:46:57.924548428 (93h20m52.355628559s) [upload=97244]: Starting upload
Aug 12 14:46:57.924597912 (93h20m52.355678044s) [upload=97244]: Done starting upload
Aug 12 14:46:57.924686101 (93h20m52.355766232s) [upload=97244]: Uploading segments...
Aug 12 14:46:57.924802413 (93h20m52.355882544s) [upload=97244]: Got next segment. Inline: false
Aug 12 14:46:57.924831960 (93h20m52.355912091s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:46:57.924836418 (93h20m52.355916549s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:46:58.421034079 (93h20m52.85211427s) [seg_pos={0 0}, upload=97244]: Begin upload segment...
Aug 12 14:46:58.421104814 (93h20m52.852184985s) [seg_pos={0 0}, upload=97244]: Done begin upload segment.
Aug 12 14:46:58.421137337 (93h20m52.852217508s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421156032 (93h20m52.852236183s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421240904 (93h20m52.852321065s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422100981 (93h20m52.853181162s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422121699 (93h20m52.853201841s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422701420 (93h20m52.853781551s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422713542 (93h20m52.853793693s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423256251 (93h20m52.854336382s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423677006 (93h20m52.854757147s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424097701 (93h20m52.855177842s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424551269 (93h20m52.85563141s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424994797 (93h20m52.856074928s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425376417 (93h20m52.856456548s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425699776 (93h20m52.856779917s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.426998130 (93h20m52.858078261s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.427769887 (93h20m52.858850018s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.428073748 (93h20m52.859153889s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.429050167 (93h20m52.860130298s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:59.614614268 (93h20m54.045694399s) [upload=97244]: Next returned nil segment
Aug 12 14:46:59.614630349 (93h20m54.04571048s) [upload=97244]: Waiting for error group managing segments...
Aug 12 14:46:59.919657162 (93h20m54.350737294s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:46:59.970918834 (93h20m54.401998965s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.389939738 (93h20m54.821019869s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.392389675 (93h20m54.823469806s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.404026140 (93h20m54.835106271s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.424626395 (93h20m54.855706526s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.448466771 (93h20m54.879546902s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.464837894 (93h20m54.895918025s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.486210978 (93h20m54.917291119s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.496331062 (93h20m54.927411193s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.518790413 (93h20m54.949870544s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.539714178 (93h20m54.970794309s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.563779413 (93h20m54.994859544s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741387681 (93h20m55.172467812s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741420123 (93h20m55.172500254s) [seg_pos={0 0}, upload=97244]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:47:00.741592052 (93h20m55.172672183s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741631777 (93h20m55.172711908s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tn1Sd8Gk3eHSmToBnPGjCyaAdQpUQrhiGe5cuecwBCpd7kEyT): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741680521 (93h20m55.172760652s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Egk1BCBmtjUZcwJKpoQjfrubA2czJKMEai5bzDqkPmXTRhaB6): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741733332 (93h20m55.172813473s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741747449 (93h20m55.17282758s) [seg_pos={0 0}, upload=97244]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:47:00.741852279 (93h20m55.17293242s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:47:00.741858261 (93h20m55.172938392s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:47:01.066168749 (93h20m55.49724888s) [upload=97244]: Done uploading segments...
Aug 12 14:47:01.066187886 (93h20m55.497268017s) [upload=97244]: Upload finished. err: <nil>
Duration: 6.503641869s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X............................X............X..............] duration:
6.094606991s
FAIL (2025-08-12 14:58:22 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:46:57.924548428 (93h20m52.355628559s) [upload=97244]: Starting upload
Aug 12 14:46:57.924597912 (93h20m52.355678044s) [upload=97244]: Done starting upload
Aug 12 14:46:57.924686101 (93h20m52.355766232s) [upload=97244]: Uploading segments...
Aug 12 14:46:57.924802413 (93h20m52.355882544s) [upload=97244]: Got next segment. Inline: false
Aug 12 14:46:57.924831960 (93h20m52.355912091s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:46:57.924836418 (93h20m52.355916549s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:46:58.421034079 (93h20m52.85211427s) [seg_pos={0 0}, upload=97244]: Begin upload segment...
Aug 12 14:46:58.421104814 (93h20m52.852184985s) [seg_pos={0 0}, upload=97244]: Done begin upload segment.
Aug 12 14:46:58.421137337 (93h20m52.852217508s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421156032 (93h20m52.852236183s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421240904 (93h20m52.852321065s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422100981 (93h20m52.853181162s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422121699 (93h20m52.853201841s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422701420 (93h20m52.853781551s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422713542 (93h20m52.853793693s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423256251 (93h20m52.854336382s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423677006 (93h20m52.854757147s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424097701 (93h20m52.855177842s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424551269 (93h20m52.85563141s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424994797 (93h20m52.856074928s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425376417 (93h20m52.856456548s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425699776 (93h20m52.856779917s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.426998130 (93h20m52.858078261s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.427769887 (93h20m52.858850018s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.428073748 (93h20m52.859153889s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.429050167 (93h20m52.860130298s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:59.614614268 (93h20m54.045694399s) [upload=97244]: Next returned nil segment
Aug 12 14:46:59.614630349 (93h20m54.04571048s) [upload=97244]: Waiting for error group managing segments...
Aug 12 14:46:59.919657162 (93h20m54.350737294s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:46:59.970918834 (93h20m54.401998965s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.389939738 (93h20m54.821019869s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.392389675 (93h20m54.823469806s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.404026140 (93h20m54.835106271s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.424626395 (93h20m54.855706526s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.448466771 (93h20m54.879546902s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.464837894 (93h20m54.895918025s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.486210978 (93h20m54.917291119s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.496331062 (93h20m54.927411193s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.518790413 (93h20m54.949870544s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.539714178 (93h20m54.970794309s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.563779413 (93h20m54.994859544s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741387681 (93h20m55.172467812s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741420123 (93h20m55.172500254s) [seg_pos={0 0}, upload=97244]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:47:00.741592052 (93h20m55.172672183s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741631777 (93h20m55.172711908s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tn1Sd8Gk3eHSmToBnPGjCyaAdQpUQrhiGe5cuecwBCpd7kEyT): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741680521 (93h20m55.172760652s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Egk1BCBmtjUZcwJKpoQjfrubA2czJKMEai5bzDqkPmXTRhaB6): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741733332 (93h20m55.172813473s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741747449 (93h20m55.17282758s) [seg_pos={0 0}, upload=97244]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:47:00.741852279 (93h20m55.17293242s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:47:00.741858261 (93h20m55.172938392s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:47:01.066168749 (93h20m55.49724888s) [upload=97244]: Done uploading segments...
Aug 12 14:47:01.066187886 (93h20m55.497268017s) [upload=97244]: Upload finished. err: <nil>
Duration: 6.094638922s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
1.838989421s
FAIL (2025-08-12 14:57:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.839015932s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X............................X............X.............] duration:
6.238540222s
FAIL (2025-08-12 14:57:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:46:57.924548428 (93h20m52.355628559s) [upload=97244]: Starting upload
Aug 12 14:46:57.924597912 (93h20m52.355678044s) [upload=97244]: Done starting upload
Aug 12 14:46:57.924686101 (93h20m52.355766232s) [upload=97244]: Uploading segments...
Aug 12 14:46:57.924802413 (93h20m52.355882544s) [upload=97244]: Got next segment. Inline: false
Aug 12 14:46:57.924831960 (93h20m52.355912091s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:46:57.924836418 (93h20m52.355916549s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:46:58.421034079 (93h20m52.85211427s) [seg_pos={0 0}, upload=97244]: Begin upload segment...
Aug 12 14:46:58.421104814 (93h20m52.852184985s) [seg_pos={0 0}, upload=97244]: Done begin upload segment.
Aug 12 14:46:58.421137337 (93h20m52.852217508s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421156032 (93h20m52.852236183s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421240904 (93h20m52.852321065s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422100981 (93h20m52.853181162s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422121699 (93h20m52.853201841s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422701420 (93h20m52.853781551s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422713542 (93h20m52.853793693s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423256251 (93h20m52.854336382s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423677006 (93h20m52.854757147s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424097701 (93h20m52.855177842s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424551269 (93h20m52.85563141s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424994797 (93h20m52.856074928s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425376417 (93h20m52.856456548s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425699776 (93h20m52.856779917s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.426998130 (93h20m52.858078261s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.427769887 (93h20m52.858850018s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.428073748 (93h20m52.859153889s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.429050167 (93h20m52.860130298s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:59.614614268 (93h20m54.045694399s) [upload=97244]: Next returned nil segment
Aug 12 14:46:59.614630349 (93h20m54.04571048s) [upload=97244]: Waiting for error group managing segments...
Aug 12 14:46:59.919657162 (93h20m54.350737294s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:46:59.970918834 (93h20m54.401998965s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.389939738 (93h20m54.821019869s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.392389675 (93h20m54.823469806s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.404026140 (93h20m54.835106271s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.424626395 (93h20m54.855706526s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.448466771 (93h20m54.879546902s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.464837894 (93h20m54.895918025s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.486210978 (93h20m54.917291119s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.496331062 (93h20m54.927411193s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.518790413 (93h20m54.949870544s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.539714178 (93h20m54.970794309s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.563779413 (93h20m54.994859544s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741387681 (93h20m55.172467812s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741420123 (93h20m55.172500254s) [seg_pos={0 0}, upload=97244]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:47:00.741592052 (93h20m55.172672183s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741631777 (93h20m55.172711908s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tn1Sd8Gk3eHSmToBnPGjCyaAdQpUQrhiGe5cuecwBCpd7kEyT): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741680521 (93h20m55.172760652s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Egk1BCBmtjUZcwJKpoQjfrubA2czJKMEai5bzDqkPmXTRhaB6): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741733332 (93h20m55.172813473s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741747449 (93h20m55.17282758s) [seg_pos={0 0}, upload=97244]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:47:00.741852279 (93h20m55.17293242s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:47:00.741858261 (93h20m55.172938392s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:47:01.066168749 (93h20m55.49724888s) [upload=97244]: Done uploading segments...
Aug 12 14:47:01.066187886 (93h20m55.497268017s) [upload=97244]: Upload finished. err: <nil>
Duration: 6.23856449s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.025660898s
FAIL (2025-08-12 14:56:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.025695615s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X............................X............X............] duration:
5.97485968s
FAIL (2025-08-12 14:56:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:46:57.924548428 (93h20m52.355628559s) [upload=97244]: Starting upload
Aug 12 14:46:57.924597912 (93h20m52.355678044s) [upload=97244]: Done starting upload
Aug 12 14:46:57.924686101 (93h20m52.355766232s) [upload=97244]: Uploading segments...
Aug 12 14:46:57.924802413 (93h20m52.355882544s) [upload=97244]: Got next segment. Inline: false
Aug 12 14:46:57.924831960 (93h20m52.355912091s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:46:57.924836418 (93h20m52.355916549s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:46:58.421034079 (93h20m52.85211427s) [seg_pos={0 0}, upload=97244]: Begin upload segment...
Aug 12 14:46:58.421104814 (93h20m52.852184985s) [seg_pos={0 0}, upload=97244]: Done begin upload segment.
Aug 12 14:46:58.421137337 (93h20m52.852217508s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421156032 (93h20m52.852236183s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421240904 (93h20m52.852321065s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422100981 (93h20m52.853181162s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422121699 (93h20m52.853201841s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422701420 (93h20m52.853781551s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422713542 (93h20m52.853793693s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423256251 (93h20m52.854336382s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423677006 (93h20m52.854757147s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424097701 (93h20m52.855177842s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424551269 (93h20m52.85563141s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424994797 (93h20m52.856074928s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425376417 (93h20m52.856456548s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425699776 (93h20m52.856779917s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.426998130 (93h20m52.858078261s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.427769887 (93h20m52.858850018s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.428073748 (93h20m52.859153889s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.429050167 (93h20m52.860130298s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:59.614614268 (93h20m54.045694399s) [upload=97244]: Next returned nil segment
Aug 12 14:46:59.614630349 (93h20m54.04571048s) [upload=97244]: Waiting for error group managing segments...
Aug 12 14:46:59.919657162 (93h20m54.350737294s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:46:59.970918834 (93h20m54.401998965s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.389939738 (93h20m54.821019869s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.392389675 (93h20m54.823469806s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.404026140 (93h20m54.835106271s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.424626395 (93h20m54.855706526s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.448466771 (93h20m54.879546902s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.464837894 (93h20m54.895918025s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.486210978 (93h20m54.917291119s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.496331062 (93h20m54.927411193s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.518790413 (93h20m54.949870544s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.539714178 (93h20m54.970794309s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.563779413 (93h20m54.994859544s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741387681 (93h20m55.172467812s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741420123 (93h20m55.172500254s) [seg_pos={0 0}, upload=97244]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:47:00.741592052 (93h20m55.172672183s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741631777 (93h20m55.172711908s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tn1Sd8Gk3eHSmToBnPGjCyaAdQpUQrhiGe5cuecwBCpd7kEyT): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741680521 (93h20m55.172760652s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Egk1BCBmtjUZcwJKpoQjfrubA2czJKMEai5bzDqkPmXTRhaB6): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741733332 (93h20m55.172813473s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741747449 (93h20m55.17282758s) [seg_pos={0 0}, upload=97244]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:47:00.741852279 (93h20m55.17293242s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:47:00.741858261 (93h20m55.172938392s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:47:01.066168749 (93h20m55.49724888s) [upload=97244]: Done uploading segments...
Aug 12 14:47:01.066187886 (93h20m55.497268017s) [upload=97244]: Upload finished. err: <nil>
Duration: 5.974903955s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.165680153s
FAIL (2025-08-12 14:56:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.165706323s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X............................X............X...........] duration:
5.760417565s
FAIL (2025-08-12 14:55:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:46:57.924548428 (93h20m52.355628559s) [upload=97244]: Starting upload
Aug 12 14:46:57.924597912 (93h20m52.355678044s) [upload=97244]: Done starting upload
Aug 12 14:46:57.924686101 (93h20m52.355766232s) [upload=97244]: Uploading segments...
Aug 12 14:46:57.924802413 (93h20m52.355882544s) [upload=97244]: Got next segment. Inline: false
Aug 12 14:46:57.924831960 (93h20m52.355912091s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:46:57.924836418 (93h20m52.355916549s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:46:58.421034079 (93h20m52.85211427s) [seg_pos={0 0}, upload=97244]: Begin upload segment...
Aug 12 14:46:58.421104814 (93h20m52.852184985s) [seg_pos={0 0}, upload=97244]: Done begin upload segment.
Aug 12 14:46:58.421137337 (93h20m52.852217508s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421156032 (93h20m52.852236183s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421240904 (93h20m52.852321065s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422100981 (93h20m52.853181162s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422121699 (93h20m52.853201841s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422701420 (93h20m52.853781551s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422713542 (93h20m52.853793693s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423256251 (93h20m52.854336382s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423677006 (93h20m52.854757147s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424097701 (93h20m52.855177842s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424551269 (93h20m52.85563141s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424994797 (93h20m52.856074928s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425376417 (93h20m52.856456548s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425699776 (93h20m52.856779917s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.426998130 (93h20m52.858078261s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.427769887 (93h20m52.858850018s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.428073748 (93h20m52.859153889s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.429050167 (93h20m52.860130298s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:59.614614268 (93h20m54.045694399s) [upload=97244]: Next returned nil segment
Aug 12 14:46:59.614630349 (93h20m54.04571048s) [upload=97244]: Waiting for error group managing segments...
Aug 12 14:46:59.919657162 (93h20m54.350737294s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:46:59.970918834 (93h20m54.401998965s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.389939738 (93h20m54.821019869s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.392389675 (93h20m54.823469806s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.404026140 (93h20m54.835106271s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.424626395 (93h20m54.855706526s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.448466771 (93h20m54.879546902s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.464837894 (93h20m54.895918025s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.486210978 (93h20m54.917291119s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.496331062 (93h20m54.927411193s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.518790413 (93h20m54.949870544s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.539714178 (93h20m54.970794309s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.563779413 (93h20m54.994859544s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741387681 (93h20m55.172467812s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741420123 (93h20m55.172500254s) [seg_pos={0 0}, upload=97244]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:47:00.741592052 (93h20m55.172672183s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741631777 (93h20m55.172711908s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tn1Sd8Gk3eHSmToBnPGjCyaAdQpUQrhiGe5cuecwBCpd7kEyT): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741680521 (93h20m55.172760652s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Egk1BCBmtjUZcwJKpoQjfrubA2czJKMEai5bzDqkPmXTRhaB6): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741733332 (93h20m55.172813473s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741747449 (93h20m55.17282758s) [seg_pos={0 0}, upload=97244]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:47:00.741852279 (93h20m55.17293242s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:47:00.741858261 (93h20m55.172938392s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:47:01.066168749 (93h20m55.49724888s) [upload=97244]: Done uploading segments...
Aug 12 14:47:01.066187886 (93h20m55.497268017s) [upload=97244]: Upload finished. err: <nil>
Duration: 5.760442051s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X............................X............X..........] duration:
6.023095372s
FAIL (2025-08-12 14:55:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:46:57.924548428 (93h20m52.355628559s) [upload=97244]: Starting upload
Aug 12 14:46:57.924597912 (93h20m52.355678044s) [upload=97244]: Done starting upload
Aug 12 14:46:57.924686101 (93h20m52.355766232s) [upload=97244]: Uploading segments...
Aug 12 14:46:57.924802413 (93h20m52.355882544s) [upload=97244]: Got next segment. Inline: false
Aug 12 14:46:57.924831960 (93h20m52.355912091s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:46:57.924836418 (93h20m52.355916549s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:46:58.421034079 (93h20m52.85211427s) [seg_pos={0 0}, upload=97244]: Begin upload segment...
Aug 12 14:46:58.421104814 (93h20m52.852184985s) [seg_pos={0 0}, upload=97244]: Done begin upload segment.
Aug 12 14:46:58.421137337 (93h20m52.852217508s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421156032 (93h20m52.852236183s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421240904 (93h20m52.852321065s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422100981 (93h20m52.853181162s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422121699 (93h20m52.853201841s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422701420 (93h20m52.853781551s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422713542 (93h20m52.853793693s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423256251 (93h20m52.854336382s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423677006 (93h20m52.854757147s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424097701 (93h20m52.855177842s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424551269 (93h20m52.85563141s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424994797 (93h20m52.856074928s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425376417 (93h20m52.856456548s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425699776 (93h20m52.856779917s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.426998130 (93h20m52.858078261s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.427769887 (93h20m52.858850018s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.428073748 (93h20m52.859153889s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.429050167 (93h20m52.860130298s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:59.614614268 (93h20m54.045694399s) [upload=97244]: Next returned nil segment
Aug 12 14:46:59.614630349 (93h20m54.04571048s) [upload=97244]: Waiting for error group managing segments...
Aug 12 14:46:59.919657162 (93h20m54.350737294s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:46:59.970918834 (93h20m54.401998965s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.389939738 (93h20m54.821019869s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.392389675 (93h20m54.823469806s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.404026140 (93h20m54.835106271s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.424626395 (93h20m54.855706526s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.448466771 (93h20m54.879546902s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.464837894 (93h20m54.895918025s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.486210978 (93h20m54.917291119s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.496331062 (93h20m54.927411193s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.518790413 (93h20m54.949870544s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.539714178 (93h20m54.970794309s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.563779413 (93h20m54.994859544s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741387681 (93h20m55.172467812s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741420123 (93h20m55.172500254s) [seg_pos={0 0}, upload=97244]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:47:00.741592052 (93h20m55.172672183s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741631777 (93h20m55.172711908s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tn1Sd8Gk3eHSmToBnPGjCyaAdQpUQrhiGe5cuecwBCpd7kEyT): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741680521 (93h20m55.172760652s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Egk1BCBmtjUZcwJKpoQjfrubA2czJKMEai5bzDqkPmXTRhaB6): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741733332 (93h20m55.172813473s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741747449 (93h20m55.17282758s) [seg_pos={0 0}, upload=97244]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:47:00.741852279 (93h20m55.17293242s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:47:00.741858261 (93h20m55.172938392s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:47:01.066168749 (93h20m55.49724888s) [upload=97244]: Done uploading segments...
Aug 12 14:47:01.066187886 (93h20m55.497268017s) [upload=97244]: Upload finished. err: <nil>
Duration: 6.023120158s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
1.996642325s
FAIL (2025-08-12 14:55:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.996671231s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
1.847772278s
FAIL (2025-08-12 14:54:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.847798388s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X............................X............X.........] duration:
6.282177776s
FAIL (2025-08-12 14:54:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:46:57.924548428 (93h20m52.355628559s) [upload=97244]: Starting upload
Aug 12 14:46:57.924597912 (93h20m52.355678044s) [upload=97244]: Done starting upload
Aug 12 14:46:57.924686101 (93h20m52.355766232s) [upload=97244]: Uploading segments...
Aug 12 14:46:57.924802413 (93h20m52.355882544s) [upload=97244]: Got next segment. Inline: false
Aug 12 14:46:57.924831960 (93h20m52.355912091s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:46:57.924836418 (93h20m52.355916549s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:46:58.421034079 (93h20m52.85211427s) [seg_pos={0 0}, upload=97244]: Begin upload segment...
Aug 12 14:46:58.421104814 (93h20m52.852184985s) [seg_pos={0 0}, upload=97244]: Done begin upload segment.
Aug 12 14:46:58.421137337 (93h20m52.852217508s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421156032 (93h20m52.852236183s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421240904 (93h20m52.852321065s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422100981 (93h20m52.853181162s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422121699 (93h20m52.853201841s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422701420 (93h20m52.853781551s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422713542 (93h20m52.853793693s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423256251 (93h20m52.854336382s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423677006 (93h20m52.854757147s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424097701 (93h20m52.855177842s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424551269 (93h20m52.85563141s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424994797 (93h20m52.856074928s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425376417 (93h20m52.856456548s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425699776 (93h20m52.856779917s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.426998130 (93h20m52.858078261s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.427769887 (93h20m52.858850018s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.428073748 (93h20m52.859153889s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.429050167 (93h20m52.860130298s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:59.614614268 (93h20m54.045694399s) [upload=97244]: Next returned nil segment
Aug 12 14:46:59.614630349 (93h20m54.04571048s) [upload=97244]: Waiting for error group managing segments...
Aug 12 14:46:59.919657162 (93h20m54.350737294s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:46:59.970918834 (93h20m54.401998965s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.389939738 (93h20m54.821019869s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.392389675 (93h20m54.823469806s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.404026140 (93h20m54.835106271s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.424626395 (93h20m54.855706526s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.448466771 (93h20m54.879546902s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.464837894 (93h20m54.895918025s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.486210978 (93h20m54.917291119s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.496331062 (93h20m54.927411193s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.518790413 (93h20m54.949870544s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.539714178 (93h20m54.970794309s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.563779413 (93h20m54.994859544s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741387681 (93h20m55.172467812s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741420123 (93h20m55.172500254s) [seg_pos={0 0}, upload=97244]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:47:00.741592052 (93h20m55.172672183s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741631777 (93h20m55.172711908s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tn1Sd8Gk3eHSmToBnPGjCyaAdQpUQrhiGe5cuecwBCpd7kEyT): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741680521 (93h20m55.172760652s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Egk1BCBmtjUZcwJKpoQjfrubA2czJKMEai5bzDqkPmXTRhaB6): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741733332 (93h20m55.172813473s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741747449 (93h20m55.17282758s) [seg_pos={0 0}, upload=97244]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:47:00.741852279 (93h20m55.17293242s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:47:00.741858261 (93h20m55.172938392s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:47:01.066168749 (93h20m55.49724888s) [upload=97244]: Done uploading segments...
Aug 12 14:47:01.066187886 (93h20m55.497268017s) [upload=97244]: Upload finished. err: <nil>
Duration: 6.282203526s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
1.876112801s
FAIL (2025-08-12 14:53:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.876132768s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X............................X............X........] duration:
6.025527057s
FAIL (2025-08-12 14:53:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:46:57.924548428 (93h20m52.355628559s) [upload=97244]: Starting upload
Aug 12 14:46:57.924597912 (93h20m52.355678044s) [upload=97244]: Done starting upload
Aug 12 14:46:57.924686101 (93h20m52.355766232s) [upload=97244]: Uploading segments...
Aug 12 14:46:57.924802413 (93h20m52.355882544s) [upload=97244]: Got next segment. Inline: false
Aug 12 14:46:57.924831960 (93h20m52.355912091s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:46:57.924836418 (93h20m52.355916549s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:46:58.421034079 (93h20m52.85211427s) [seg_pos={0 0}, upload=97244]: Begin upload segment...
Aug 12 14:46:58.421104814 (93h20m52.852184985s) [seg_pos={0 0}, upload=97244]: Done begin upload segment.
Aug 12 14:46:58.421137337 (93h20m52.852217508s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421156032 (93h20m52.852236183s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421240904 (93h20m52.852321065s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422100981 (93h20m52.853181162s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422121699 (93h20m52.853201841s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422701420 (93h20m52.853781551s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422713542 (93h20m52.853793693s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423256251 (93h20m52.854336382s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423677006 (93h20m52.854757147s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424097701 (93h20m52.855177842s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424551269 (93h20m52.85563141s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424994797 (93h20m52.856074928s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425376417 (93h20m52.856456548s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425699776 (93h20m52.856779917s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.426998130 (93h20m52.858078261s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.427769887 (93h20m52.858850018s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.428073748 (93h20m52.859153889s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.429050167 (93h20m52.860130298s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:59.614614268 (93h20m54.045694399s) [upload=97244]: Next returned nil segment
Aug 12 14:46:59.614630349 (93h20m54.04571048s) [upload=97244]: Waiting for error group managing segments...
Aug 12 14:46:59.919657162 (93h20m54.350737294s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:46:59.970918834 (93h20m54.401998965s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.389939738 (93h20m54.821019869s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.392389675 (93h20m54.823469806s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.404026140 (93h20m54.835106271s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.424626395 (93h20m54.855706526s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.448466771 (93h20m54.879546902s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.464837894 (93h20m54.895918025s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.486210978 (93h20m54.917291119s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.496331062 (93h20m54.927411193s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.518790413 (93h20m54.949870544s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.539714178 (93h20m54.970794309s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.563779413 (93h20m54.994859544s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741387681 (93h20m55.172467812s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741420123 (93h20m55.172500254s) [seg_pos={0 0}, upload=97244]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:47:00.741592052 (93h20m55.172672183s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741631777 (93h20m55.172711908s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tn1Sd8Gk3eHSmToBnPGjCyaAdQpUQrhiGe5cuecwBCpd7kEyT): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741680521 (93h20m55.172760652s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Egk1BCBmtjUZcwJKpoQjfrubA2czJKMEai5bzDqkPmXTRhaB6): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741733332 (93h20m55.172813473s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741747449 (93h20m55.17282758s) [seg_pos={0 0}, upload=97244]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:47:00.741852279 (93h20m55.17293242s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:47:00.741858261 (93h20m55.172938392s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:47:01.066168749 (93h20m55.49724888s) [upload=97244]: Done uploading segments...
Aug 12 14:47:01.066187886 (93h20m55.497268017s) [upload=97244]: Upload finished. err: <nil>
Duration: 6.025553767s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
1.861058559s
FAIL (2025-08-12 14:52:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.861094736s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X............................X............X.......] duration:
6.510907145s
FAIL (2025-08-12 14:52:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:46:57.924548428 (93h20m52.355628559s) [upload=97244]: Starting upload
Aug 12 14:46:57.924597912 (93h20m52.355678044s) [upload=97244]: Done starting upload
Aug 12 14:46:57.924686101 (93h20m52.355766232s) [upload=97244]: Uploading segments...
Aug 12 14:46:57.924802413 (93h20m52.355882544s) [upload=97244]: Got next segment. Inline: false
Aug 12 14:46:57.924831960 (93h20m52.355912091s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:46:57.924836418 (93h20m52.355916549s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:46:58.421034079 (93h20m52.85211427s) [seg_pos={0 0}, upload=97244]: Begin upload segment...
Aug 12 14:46:58.421104814 (93h20m52.852184985s) [seg_pos={0 0}, upload=97244]: Done begin upload segment.
Aug 12 14:46:58.421137337 (93h20m52.852217508s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421156032 (93h20m52.852236183s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421240904 (93h20m52.852321065s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422100981 (93h20m52.853181162s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422121699 (93h20m52.853201841s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422701420 (93h20m52.853781551s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422713542 (93h20m52.853793693s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423256251 (93h20m52.854336382s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423677006 (93h20m52.854757147s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424097701 (93h20m52.855177842s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424551269 (93h20m52.85563141s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424994797 (93h20m52.856074928s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425376417 (93h20m52.856456548s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425699776 (93h20m52.856779917s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.426998130 (93h20m52.858078261s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.427769887 (93h20m52.858850018s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.428073748 (93h20m52.859153889s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.429050167 (93h20m52.860130298s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:59.614614268 (93h20m54.045694399s) [upload=97244]: Next returned nil segment
Aug 12 14:46:59.614630349 (93h20m54.04571048s) [upload=97244]: Waiting for error group managing segments...
Aug 12 14:46:59.919657162 (93h20m54.350737294s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:46:59.970918834 (93h20m54.401998965s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.389939738 (93h20m54.821019869s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.392389675 (93h20m54.823469806s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.404026140 (93h20m54.835106271s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.424626395 (93h20m54.855706526s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.448466771 (93h20m54.879546902s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.464837894 (93h20m54.895918025s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.486210978 (93h20m54.917291119s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.496331062 (93h20m54.927411193s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.518790413 (93h20m54.949870544s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.539714178 (93h20m54.970794309s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.563779413 (93h20m54.994859544s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741387681 (93h20m55.172467812s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741420123 (93h20m55.172500254s) [seg_pos={0 0}, upload=97244]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:47:00.741592052 (93h20m55.172672183s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741631777 (93h20m55.172711908s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tn1Sd8Gk3eHSmToBnPGjCyaAdQpUQrhiGe5cuecwBCpd7kEyT): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741680521 (93h20m55.172760652s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Egk1BCBmtjUZcwJKpoQjfrubA2czJKMEai5bzDqkPmXTRhaB6): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741733332 (93h20m55.172813473s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741747449 (93h20m55.17282758s) [seg_pos={0 0}, upload=97244]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:47:00.741852279 (93h20m55.17293242s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:47:00.741858261 (93h20m55.172938392s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:47:01.066168749 (93h20m55.49724888s) [upload=97244]: Done uploading segments...
Aug 12 14:47:01.066187886 (93h20m55.497268017s) [upload=97244]: Upload finished. err: <nil>
Duration: 6.510938485s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.181718642s
FAIL (2025-08-12 14:51:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.181744281s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X............................X............X......] duration:
6.558413292s
FAIL (2025-08-12 14:51:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:46:57.924548428 (93h20m52.355628559s) [upload=97244]: Starting upload
Aug 12 14:46:57.924597912 (93h20m52.355678044s) [upload=97244]: Done starting upload
Aug 12 14:46:57.924686101 (93h20m52.355766232s) [upload=97244]: Uploading segments...
Aug 12 14:46:57.924802413 (93h20m52.355882544s) [upload=97244]: Got next segment. Inline: false
Aug 12 14:46:57.924831960 (93h20m52.355912091s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:46:57.924836418 (93h20m52.355916549s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:46:58.421034079 (93h20m52.85211427s) [seg_pos={0 0}, upload=97244]: Begin upload segment...
Aug 12 14:46:58.421104814 (93h20m52.852184985s) [seg_pos={0 0}, upload=97244]: Done begin upload segment.
Aug 12 14:46:58.421137337 (93h20m52.852217508s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421156032 (93h20m52.852236183s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421240904 (93h20m52.852321065s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422100981 (93h20m52.853181162s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422121699 (93h20m52.853201841s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422701420 (93h20m52.853781551s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422713542 (93h20m52.853793693s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423256251 (93h20m52.854336382s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423677006 (93h20m52.854757147s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424097701 (93h20m52.855177842s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424551269 (93h20m52.85563141s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424994797 (93h20m52.856074928s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425376417 (93h20m52.856456548s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425699776 (93h20m52.856779917s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.426998130 (93h20m52.858078261s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.427769887 (93h20m52.858850018s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.428073748 (93h20m52.859153889s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.429050167 (93h20m52.860130298s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:59.614614268 (93h20m54.045694399s) [upload=97244]: Next returned nil segment
Aug 12 14:46:59.614630349 (93h20m54.04571048s) [upload=97244]: Waiting for error group managing segments...
Aug 12 14:46:59.919657162 (93h20m54.350737294s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:46:59.970918834 (93h20m54.401998965s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.389939738 (93h20m54.821019869s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.392389675 (93h20m54.823469806s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.404026140 (93h20m54.835106271s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.424626395 (93h20m54.855706526s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.448466771 (93h20m54.879546902s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.464837894 (93h20m54.895918025s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.486210978 (93h20m54.917291119s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.496331062 (93h20m54.927411193s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.518790413 (93h20m54.949870544s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.539714178 (93h20m54.970794309s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.563779413 (93h20m54.994859544s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741387681 (93h20m55.172467812s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741420123 (93h20m55.172500254s) [seg_pos={0 0}, upload=97244]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:47:00.741592052 (93h20m55.172672183s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741631777 (93h20m55.172711908s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tn1Sd8Gk3eHSmToBnPGjCyaAdQpUQrhiGe5cuecwBCpd7kEyT): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741680521 (93h20m55.172760652s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Egk1BCBmtjUZcwJKpoQjfrubA2czJKMEai5bzDqkPmXTRhaB6): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741733332 (93h20m55.172813473s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741747449 (93h20m55.17282758s) [seg_pos={0 0}, upload=97244]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:47:00.741852279 (93h20m55.17293242s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:47:00.741858261 (93h20m55.172938392s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:47:01.066168749 (93h20m55.49724888s) [upload=97244]: Done uploading segments...
Aug 12 14:47:01.066187886 (93h20m55.497268017s) [upload=97244]: Upload finished. err: <nil>
Duration: 6.55844332s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
1.853053761s
FAIL (2025-08-12 14:50:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.853078949s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X............................X............X.....] duration:
5.969764437s
FAIL (2025-08-12 14:50:08 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:46:57.924548428 (93h20m52.355628559s) [upload=97244]: Starting upload
Aug 12 14:46:57.924597912 (93h20m52.355678044s) [upload=97244]: Done starting upload
Aug 12 14:46:57.924686101 (93h20m52.355766232s) [upload=97244]: Uploading segments...
Aug 12 14:46:57.924802413 (93h20m52.355882544s) [upload=97244]: Got next segment. Inline: false
Aug 12 14:46:57.924831960 (93h20m52.355912091s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:46:57.924836418 (93h20m52.355916549s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:46:58.421034079 (93h20m52.85211427s) [seg_pos={0 0}, upload=97244]: Begin upload segment...
Aug 12 14:46:58.421104814 (93h20m52.852184985s) [seg_pos={0 0}, upload=97244]: Done begin upload segment.
Aug 12 14:46:58.421137337 (93h20m52.852217508s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421156032 (93h20m52.852236183s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421240904 (93h20m52.852321065s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422100981 (93h20m52.853181162s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422121699 (93h20m52.853201841s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422701420 (93h20m52.853781551s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422713542 (93h20m52.853793693s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423256251 (93h20m52.854336382s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423677006 (93h20m52.854757147s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424097701 (93h20m52.855177842s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424551269 (93h20m52.85563141s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424994797 (93h20m52.856074928s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425376417 (93h20m52.856456548s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425699776 (93h20m52.856779917s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.426998130 (93h20m52.858078261s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.427769887 (93h20m52.858850018s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.428073748 (93h20m52.859153889s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.429050167 (93h20m52.860130298s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:59.614614268 (93h20m54.045694399s) [upload=97244]: Next returned nil segment
Aug 12 14:46:59.614630349 (93h20m54.04571048s) [upload=97244]: Waiting for error group managing segments...
Aug 12 14:46:59.919657162 (93h20m54.350737294s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:46:59.970918834 (93h20m54.401998965s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.389939738 (93h20m54.821019869s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.392389675 (93h20m54.823469806s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.404026140 (93h20m54.835106271s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.424626395 (93h20m54.855706526s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.448466771 (93h20m54.879546902s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.464837894 (93h20m54.895918025s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.486210978 (93h20m54.917291119s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.496331062 (93h20m54.927411193s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.518790413 (93h20m54.949870544s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.539714178 (93h20m54.970794309s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.563779413 (93h20m54.994859544s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741387681 (93h20m55.172467812s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741420123 (93h20m55.172500254s) [seg_pos={0 0}, upload=97244]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:47:00.741592052 (93h20m55.172672183s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741631777 (93h20m55.172711908s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tn1Sd8Gk3eHSmToBnPGjCyaAdQpUQrhiGe5cuecwBCpd7kEyT): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741680521 (93h20m55.172760652s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Egk1BCBmtjUZcwJKpoQjfrubA2czJKMEai5bzDqkPmXTRhaB6): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741733332 (93h20m55.172813473s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741747449 (93h20m55.17282758s) [seg_pos={0 0}, upload=97244]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:47:00.741852279 (93h20m55.17293242s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:47:00.741858261 (93h20m55.172938392s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:47:01.066168749 (93h20m55.49724888s) [upload=97244]: Done uploading segments...
Aug 12 14:47:01.066187886 (93h20m55.497268017s) [upload=97244]: Upload finished. err: <nil>
Duration: 5.969796217s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
1.905468158s
FAIL (2025-08-12 14:49:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.905498898s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X............................X............X....] duration:
6.063476629s
FAIL (2025-08-12 14:49:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:46:57.924548428 (93h20m52.355628559s) [upload=97244]: Starting upload
Aug 12 14:46:57.924597912 (93h20m52.355678044s) [upload=97244]: Done starting upload
Aug 12 14:46:57.924686101 (93h20m52.355766232s) [upload=97244]: Uploading segments...
Aug 12 14:46:57.924802413 (93h20m52.355882544s) [upload=97244]: Got next segment. Inline: false
Aug 12 14:46:57.924831960 (93h20m52.355912091s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:46:57.924836418 (93h20m52.355916549s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:46:58.421034079 (93h20m52.85211427s) [seg_pos={0 0}, upload=97244]: Begin upload segment...
Aug 12 14:46:58.421104814 (93h20m52.852184985s) [seg_pos={0 0}, upload=97244]: Done begin upload segment.
Aug 12 14:46:58.421137337 (93h20m52.852217508s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421156032 (93h20m52.852236183s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421240904 (93h20m52.852321065s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422100981 (93h20m52.853181162s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422121699 (93h20m52.853201841s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422701420 (93h20m52.853781551s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422713542 (93h20m52.853793693s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423256251 (93h20m52.854336382s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423677006 (93h20m52.854757147s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424097701 (93h20m52.855177842s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424551269 (93h20m52.85563141s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424994797 (93h20m52.856074928s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425376417 (93h20m52.856456548s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425699776 (93h20m52.856779917s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.426998130 (93h20m52.858078261s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.427769887 (93h20m52.858850018s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.428073748 (93h20m52.859153889s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.429050167 (93h20m52.860130298s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:59.614614268 (93h20m54.045694399s) [upload=97244]: Next returned nil segment
Aug 12 14:46:59.614630349 (93h20m54.04571048s) [upload=97244]: Waiting for error group managing segments...
Aug 12 14:46:59.919657162 (93h20m54.350737294s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:46:59.970918834 (93h20m54.401998965s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.389939738 (93h20m54.821019869s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.392389675 (93h20m54.823469806s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.404026140 (93h20m54.835106271s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.424626395 (93h20m54.855706526s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.448466771 (93h20m54.879546902s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.464837894 (93h20m54.895918025s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.486210978 (93h20m54.917291119s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.496331062 (93h20m54.927411193s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.518790413 (93h20m54.949870544s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.539714178 (93h20m54.970794309s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.563779413 (93h20m54.994859544s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741387681 (93h20m55.172467812s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741420123 (93h20m55.172500254s) [seg_pos={0 0}, upload=97244]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:47:00.741592052 (93h20m55.172672183s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741631777 (93h20m55.172711908s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tn1Sd8Gk3eHSmToBnPGjCyaAdQpUQrhiGe5cuecwBCpd7kEyT): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741680521 (93h20m55.172760652s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Egk1BCBmtjUZcwJKpoQjfrubA2czJKMEai5bzDqkPmXTRhaB6): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741733332 (93h20m55.172813473s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741747449 (93h20m55.17282758s) [seg_pos={0 0}, upload=97244]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:47:00.741852279 (93h20m55.17293242s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:47:00.741858261 (93h20m55.172938392s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:47:01.066168749 (93h20m55.49724888s) [upload=97244]: Done uploading segments...
Aug 12 14:47:01.066187886 (93h20m55.497268017s) [upload=97244]: Upload finished. err: <nil>
Duration: 6.063514201s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
1.99996849s
FAIL (2025-08-12 14:49:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.000045607s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
1.897874992s
FAIL (2025-08-12 14:48:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.897899678s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X............................X............X...] duration:
5.86699323s
FAIL (2025-08-12 14:48:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:46:57.924548428 (93h20m52.355628559s) [upload=97244]: Starting upload
Aug 12 14:46:57.924597912 (93h20m52.355678044s) [upload=97244]: Done starting upload
Aug 12 14:46:57.924686101 (93h20m52.355766232s) [upload=97244]: Uploading segments...
Aug 12 14:46:57.924802413 (93h20m52.355882544s) [upload=97244]: Got next segment. Inline: false
Aug 12 14:46:57.924831960 (93h20m52.355912091s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:46:57.924836418 (93h20m52.355916549s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:46:58.421034079 (93h20m52.85211427s) [seg_pos={0 0}, upload=97244]: Begin upload segment...
Aug 12 14:46:58.421104814 (93h20m52.852184985s) [seg_pos={0 0}, upload=97244]: Done begin upload segment.
Aug 12 14:46:58.421137337 (93h20m52.852217508s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421156032 (93h20m52.852236183s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421240904 (93h20m52.852321065s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422100981 (93h20m52.853181162s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422121699 (93h20m52.853201841s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422701420 (93h20m52.853781551s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422713542 (93h20m52.853793693s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423256251 (93h20m52.854336382s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423677006 (93h20m52.854757147s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424097701 (93h20m52.855177842s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424551269 (93h20m52.85563141s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424994797 (93h20m52.856074928s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425376417 (93h20m52.856456548s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425699776 (93h20m52.856779917s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.426998130 (93h20m52.858078261s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.427769887 (93h20m52.858850018s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.428073748 (93h20m52.859153889s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.429050167 (93h20m52.860130298s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:59.614614268 (93h20m54.045694399s) [upload=97244]: Next returned nil segment
Aug 12 14:46:59.614630349 (93h20m54.04571048s) [upload=97244]: Waiting for error group managing segments...
Aug 12 14:46:59.919657162 (93h20m54.350737294s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:46:59.970918834 (93h20m54.401998965s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.389939738 (93h20m54.821019869s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.392389675 (93h20m54.823469806s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.404026140 (93h20m54.835106271s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.424626395 (93h20m54.855706526s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.448466771 (93h20m54.879546902s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.464837894 (93h20m54.895918025s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.486210978 (93h20m54.917291119s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.496331062 (93h20m54.927411193s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.518790413 (93h20m54.949870544s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.539714178 (93h20m54.970794309s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.563779413 (93h20m54.994859544s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741387681 (93h20m55.172467812s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741420123 (93h20m55.172500254s) [seg_pos={0 0}, upload=97244]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:47:00.741592052 (93h20m55.172672183s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741631777 (93h20m55.172711908s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tn1Sd8Gk3eHSmToBnPGjCyaAdQpUQrhiGe5cuecwBCpd7kEyT): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741680521 (93h20m55.172760652s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Egk1BCBmtjUZcwJKpoQjfrubA2czJKMEai5bzDqkPmXTRhaB6): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741733332 (93h20m55.172813473s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741747449 (93h20m55.17282758s) [seg_pos={0 0}, upload=97244]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:47:00.741852279 (93h20m55.17293242s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:47:00.741858261 (93h20m55.172938392s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:47:01.066168749 (93h20m55.49724888s) [upload=97244]: Done uploading segments...
Aug 12 14:47:01.066187886 (93h20m55.497268017s) [upload=97244]: Upload finished. err: <nil>
Duration: 5.867107528s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X............................X............X..] duration:
6.219472322s
FAIL (2025-08-12 14:48:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:46:57.924548428 (93h20m52.355628559s) [upload=97244]: Starting upload
Aug 12 14:46:57.924597912 (93h20m52.355678044s) [upload=97244]: Done starting upload
Aug 12 14:46:57.924686101 (93h20m52.355766232s) [upload=97244]: Uploading segments...
Aug 12 14:46:57.924802413 (93h20m52.355882544s) [upload=97244]: Got next segment. Inline: false
Aug 12 14:46:57.924831960 (93h20m52.355912091s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:46:57.924836418 (93h20m52.355916549s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:46:58.421034079 (93h20m52.85211427s) [seg_pos={0 0}, upload=97244]: Begin upload segment...
Aug 12 14:46:58.421104814 (93h20m52.852184985s) [seg_pos={0 0}, upload=97244]: Done begin upload segment.
Aug 12 14:46:58.421137337 (93h20m52.852217508s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421156032 (93h20m52.852236183s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421240904 (93h20m52.852321065s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422100981 (93h20m52.853181162s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422121699 (93h20m52.853201841s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422701420 (93h20m52.853781551s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422713542 (93h20m52.853793693s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423256251 (93h20m52.854336382s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423677006 (93h20m52.854757147s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424097701 (93h20m52.855177842s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424551269 (93h20m52.85563141s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424994797 (93h20m52.856074928s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425376417 (93h20m52.856456548s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425699776 (93h20m52.856779917s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.426998130 (93h20m52.858078261s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.427769887 (93h20m52.858850018s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.428073748 (93h20m52.859153889s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.429050167 (93h20m52.860130298s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:59.614614268 (93h20m54.045694399s) [upload=97244]: Next returned nil segment
Aug 12 14:46:59.614630349 (93h20m54.04571048s) [upload=97244]: Waiting for error group managing segments...
Aug 12 14:46:59.919657162 (93h20m54.350737294s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:46:59.970918834 (93h20m54.401998965s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.389939738 (93h20m54.821019869s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.392389675 (93h20m54.823469806s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.404026140 (93h20m54.835106271s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.424626395 (93h20m54.855706526s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.448466771 (93h20m54.879546902s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.464837894 (93h20m54.895918025s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.486210978 (93h20m54.917291119s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.496331062 (93h20m54.927411193s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.518790413 (93h20m54.949870544s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.539714178 (93h20m54.970794309s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.563779413 (93h20m54.994859544s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741387681 (93h20m55.172467812s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741420123 (93h20m55.172500254s) [seg_pos={0 0}, upload=97244]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:47:00.741592052 (93h20m55.172672183s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741631777 (93h20m55.172711908s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tn1Sd8Gk3eHSmToBnPGjCyaAdQpUQrhiGe5cuecwBCpd7kEyT): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741680521 (93h20m55.172760652s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Egk1BCBmtjUZcwJKpoQjfrubA2czJKMEai5bzDqkPmXTRhaB6): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741733332 (93h20m55.172813473s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741747449 (93h20m55.17282758s) [seg_pos={0 0}, upload=97244]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:47:00.741852279 (93h20m55.17293242s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:47:00.741858261 (93h20m55.172938392s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:47:01.066168749 (93h20m55.49724888s) [upload=97244]: Done uploading segments...
Aug 12 14:47:01.066187886 (93h20m55.497268017s) [upload=97244]: Upload finished. err: <nil>
Duration: 6.219494765s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X............................X............X.] duration:
6.044211957s
FAIL (2025-08-12 14:47:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:46:57.924548428 (93h20m52.355628559s) [upload=97244]: Starting upload
Aug 12 14:46:57.924597912 (93h20m52.355678044s) [upload=97244]: Done starting upload
Aug 12 14:46:57.924686101 (93h20m52.355766232s) [upload=97244]: Uploading segments...
Aug 12 14:46:57.924802413 (93h20m52.355882544s) [upload=97244]: Got next segment. Inline: false
Aug 12 14:46:57.924831960 (93h20m52.355912091s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:46:57.924836418 (93h20m52.355916549s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:46:58.421034079 (93h20m52.85211427s) [seg_pos={0 0}, upload=97244]: Begin upload segment...
Aug 12 14:46:58.421104814 (93h20m52.852184985s) [seg_pos={0 0}, upload=97244]: Done begin upload segment.
Aug 12 14:46:58.421137337 (93h20m52.852217508s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421156032 (93h20m52.852236183s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421240904 (93h20m52.852321065s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422100981 (93h20m52.853181162s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422121699 (93h20m52.853201841s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422701420 (93h20m52.853781551s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422713542 (93h20m52.853793693s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423256251 (93h20m52.854336382s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423677006 (93h20m52.854757147s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424097701 (93h20m52.855177842s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424551269 (93h20m52.85563141s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424994797 (93h20m52.856074928s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425376417 (93h20m52.856456548s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425699776 (93h20m52.856779917s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.426998130 (93h20m52.858078261s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.427769887 (93h20m52.858850018s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.428073748 (93h20m52.859153889s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.429050167 (93h20m52.860130298s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:59.614614268 (93h20m54.045694399s) [upload=97244]: Next returned nil segment
Aug 12 14:46:59.614630349 (93h20m54.04571048s) [upload=97244]: Waiting for error group managing segments...
Aug 12 14:46:59.919657162 (93h20m54.350737294s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:46:59.970918834 (93h20m54.401998965s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.389939738 (93h20m54.821019869s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.392389675 (93h20m54.823469806s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.404026140 (93h20m54.835106271s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.424626395 (93h20m54.855706526s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.448466771 (93h20m54.879546902s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.464837894 (93h20m54.895918025s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.486210978 (93h20m54.917291119s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.496331062 (93h20m54.927411193s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.518790413 (93h20m54.949870544s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.539714178 (93h20m54.970794309s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.563779413 (93h20m54.994859544s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741387681 (93h20m55.172467812s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741420123 (93h20m55.172500254s) [seg_pos={0 0}, upload=97244]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:47:00.741592052 (93h20m55.172672183s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741631777 (93h20m55.172711908s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tn1Sd8Gk3eHSmToBnPGjCyaAdQpUQrhiGe5cuecwBCpd7kEyT): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741680521 (93h20m55.172760652s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Egk1BCBmtjUZcwJKpoQjfrubA2czJKMEai5bzDqkPmXTRhaB6): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741733332 (93h20m55.172813473s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741747449 (93h20m55.17282758s) [seg_pos={0 0}, upload=97244]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:47:00.741852279 (93h20m55.17293242s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:47:00.741858261 (93h20m55.172938392s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:47:01.066168749 (93h20m55.49724888s) [upload=97244]: Done uploading segments...
Aug 12 14:47:01.066187886 (93h20m55.497268017s) [upload=97244]: Upload finished. err: <nil>
Duration: 6.044240811s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
1.840824273s
FAIL (2025-08-12 14:47:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.840860181s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X............................X............X] duration:
4.290589956s
FAIL (2025-08-12 14:47:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:46:57.924548428 (93h20m52.355628559s) [upload=97244]: Starting upload
Aug 12 14:46:57.924597912 (93h20m52.355678044s) [upload=97244]: Done starting upload
Aug 12 14:46:57.924686101 (93h20m52.355766232s) [upload=97244]: Uploading segments...
Aug 12 14:46:57.924802413 (93h20m52.355882544s) [upload=97244]: Got next segment. Inline: false
Aug 12 14:46:57.924831960 (93h20m52.355912091s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:46:57.924836418 (93h20m52.355916549s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:46:58.421034079 (93h20m52.85211427s) [seg_pos={0 0}, upload=97244]: Begin upload segment...
Aug 12 14:46:58.421104814 (93h20m52.852184985s) [seg_pos={0 0}, upload=97244]: Done begin upload segment.
Aug 12 14:46:58.421137337 (93h20m52.852217508s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421156032 (93h20m52.852236183s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.421240904 (93h20m52.852321065s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422100981 (93h20m52.853181162s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422121699 (93h20m52.853201841s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422701420 (93h20m52.853781551s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.422713542 (93h20m52.853793693s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423256251 (93h20m52.854336382s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.423677006 (93h20m52.854757147s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424097701 (93h20m52.855177842s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424551269 (93h20m52.85563141s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.424994797 (93h20m52.856074928s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425376417 (93h20m52.856456548s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.425699776 (93h20m52.856779917s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.426998130 (93h20m52.858078261s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.427769887 (93h20m52.858850018s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.428073748 (93h20m52.859153889s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:58.429050167 (93h20m52.860130298s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Uploading piece...
Aug 12 14:46:59.614614268 (93h20m54.045694399s) [upload=97244]: Next returned nil segment
Aug 12 14:46:59.614630349 (93h20m54.04571048s) [upload=97244]: Waiting for error group managing segments...
Aug 12 14:46:59.919657162 (93h20m54.350737294s) [noise=true , address=66.23.193.175:4558 , piece_id=6KZNNZ4XZSNSOBML2LNR277ZNA6IZKHTD6RZZ2YSDROCRJSHMTCA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:46:59.970918834 (93h20m54.401998965s) [noise=true , address=64.49.13.26:4947 , piece_id=2PWVIH43ZELAHHHRSXACS6RATTDWSXSDS25JWUZDLBU2MCSDEWOQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.389939738 (93h20m54.821019869s) [noise=true , address=104.36.82.17:4350 , piece_id=VBWTDVBHV5ITOFCHWYCMMTYPVQBPTVACHQJJNLU5T3HZOYJGMBWA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.392389675 (93h20m54.823469806s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NI57NC3LJMOYVDWS73FEXRR67EWMMK3Y5MRTDFP4DNYTOS37CQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.404026140 (93h20m54.835106271s) [noise=true , address=104.36.82.59:4335 , piece_id=7YGXEL64LN3VBDDNKEOCCTR3HQJW2H7IFDK6MYZNEBE33CBFNMEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.424626395 (93h20m54.855706526s) [noise=true , address=77.90.31.19:4858 , piece_id=OJHUQSVER7NCQCT7GGJBI5UI4SUDJD7C5HFBECYBRB5GIWJQKQ7Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.448466771 (93h20m54.879546902s) [noise=true , address=104.36.82.46:4507 , piece_id=UU42SMSIXLH73PK2KBWRVPEFQ7NKMPWDALXUS3PXKDNKH5GJTHLQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.464837894 (93h20m54.895918025s) [noise=true , address=104.36.82.37:4679 , piece_id=ZHMLEIKBSF7TTRX5MUDXROJQTYQ3MAHP3EDBHSOZZQK33GDRYNHQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.486210978 (93h20m54.917291119s) [noise=true , address=104.36.82.44:4892 , piece_id=ZMMJI4VIMG6G6SSJQMLWCD2TI5O5PHE46MAA7V5ADQDH4L5MPBEA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.496331062 (93h20m54.927411193s) [noise=true , address=104.36.82.22:4536 , piece_id=NTLLRDB2ETJEWDA4NKBINZ5QKGVI5EQCVWFQWV6B5CJ6JMR3AXFQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.518790413 (93h20m54.949870544s) [noise=true , address=104.36.82.39:4746 , piece_id=Y26Z66HTKG5GI7HUV3YUYFFIGFKE2S3ZW6VTICXHCLOT2V3DCKKA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.539714178 (93h20m54.970794309s) [noise=true , address=104.36.82.35:4612 , piece_id=XWO3L4LWBFVUCXKOVFLOJH3FOOZJRZRYBLFIL23DXG5CDFTMH4JA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.563779413 (93h20m54.994859544s) [noise=true , address=104.36.82.18:4398 , piece_id=AUDJCXQNTJLJVQPGJSWLDJVS3WNMSDYM2G4TOQVATWHCEVUTI3GQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741387681 (93h20m55.172467812s) [noise=true , address=104.36.82.58:4270 , piece_id=WHJSRYZBXOIPXIHKPNJSWLF7P25VYA7NZV6YMZ2GRUFMEFV6IIUA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: <nil>
Aug 12 14:47:00.741420123 (93h20m55.172500254s) [seg_pos={0 0}, upload=97244]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:47:00.741592052 (93h20m55.172672183s) [noise=true , address=79.127.201.215:4355 , piece_id=5FS2B7356HWS7M2AB3VTIOENX6Y64YJPI2A23UQYPPHEPPE33CPA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741631777 (93h20m55.172711908s) [noise=true , address=104.36.82.34:4549 , piece_id=AYLQYRNXQV5C6EQ3HBZV6EFRBWOKFNTKKKH6ZCTUNN3HZLBALU4Q, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tn1Sd8Gk3eHSmToBnPGjCyaAdQpUQrhiGe5cuecwBCpd7kEyT): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741680521 (93h20m55.172760652s) [noise=true , address=104.36.82.42:4813 , piece_id=YITTYVQXGPCJIGJ2C2NN24TUTB7ZACMWZG32KNSYHQTBVU53IVDA, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Egk1BCBmtjUZcwJKpoQjfrubA2czJKMEai5bzDqkPmXTRhaB6): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741733332 (93h20m55.172813473s) [noise=true , address=104.36.82.23:4450 , piece_id=JTYLXBX6GOTTMB5J6O7OV3UXNM7VQPUH656ABUBIL4YRG3CRD5WQ, seg_pos={0 0}, upload=97244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms): protocol: expected piece hash; context canceled; EOF
Aug 12 14:47:00.741747449 (93h20m55.17282758s) [seg_pos={0 0}, upload=97244]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:47:00.741852279 (93h20m55.17293242s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:47:00.741858261 (93h20m55.172938392s) [upload=97244]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:47:01.066168749 (93h20m55.49724888s) [upload=97244]: Done uploading segments...
Aug 12 14:47:01.066187886 (93h20m55.497268017s) [upload=97244]: Upload finished. err: <nil>
Duration: 4.290615614s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X............................X............] duration:
5.989937261s
FAIL (2025-08-12 14:46:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:37:29.051314805 (93h11m23.482394936s) [upload=97079]: Starting upload
Aug 12 14:37:29.051364380 (93h11m23.482444582s) [upload=97079]: Done starting upload
Aug 12 14:37:29.051502765 (93h11m23.482582886s) [upload=97079]: Uploading segments...
Aug 12 14:37:29.051610732 (93h11m23.482690863s) [upload=97079]: Got next segment. Inline: false
Aug 12 14:37:29.051644957 (93h11m23.482725088s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:37:29.051649746 (93h11m23.482729867s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:37:29.510656349 (93h11m23.94173647s) [seg_pos={0 0}, upload=97079]: Begin upload segment...
Aug 12 14:37:29.510705834 (93h11m23.941785965s) [seg_pos={0 0}, upload=97079]: Done begin upload segment.
Aug 12 14:37:29.510727776 (93h11m23.941807907s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.510790315 (93h11m23.941870436s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511086833 (93h11m23.942166954s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511184289 (93h11m23.94226443s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511356198 (93h11m23.94243633s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511457011 (93h11m23.942537142s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511627939 (93h11m23.94270807s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511691550 (93h11m23.942771671s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511907664 (93h11m23.942987795s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511952178 (93h11m23.943032309s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512149506 (93h11m23.943229638s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512378204 (93h11m23.943458335s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512588296 (93h11m23.943668417s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512807105 (93h11m23.943887226s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513016875 (93h11m23.944097007s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513204605 (93h11m23.944284736s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513558041 (93h11m23.944638172s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513764647 (93h11m23.944844778s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:30.649002235 (93h11m25.080082366s) [upload=97079]: Next returned nil segment
Aug 12 14:37:30.649022454 (93h11m25.080102575s) [upload=97079]: Waiting for error group managing segments...
Aug 12 14:37:30.947134639 (93h11m25.37821476s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.440859942 (93h11m25.871940073s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.496749930 (93h11m25.927830061s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.541422134 (93h11m25.972502265s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.580203817 (93h11m26.011283948s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.583141328 (93h11m26.014221479s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.597293436 (93h11m26.028373557s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.622883399 (93h11m26.05396353s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.626115432 (93h11m26.057195563s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.627583221 (93h11m26.058663352s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.636836476 (93h11m26.067916607s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.653931264 (93h11m26.085011396s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.686519708 (93h11m26.117599839s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028207740 (93h11m26.459287871s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028241624 (93h11m26.459321745s) [seg_pos={0 0}, upload=97079]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:37:32.028461575 (93h11m26.459541706s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028502192 (93h11m26.459582323s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028530376 (93h11m26.459610507s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xnx9shwwZAcWVV6aPj2ikukj8nbKiFsBs1hiS89zSkRQqNMJD): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028586043 (93h11m26.459666174s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection
Aug 12 14:37:32.028596994 (93h11m26.459677125s) [seg_pos={0 0}, upload=97079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:37:32.028673550 (93h11m26.459753701s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:37:32.028680664 (93h11m26.459760805s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:37:32.390432274 (93h11m26.821512415s) [upload=97079]: Done uploading segments...
Aug 12 14:37:32.390454978 (93h11m26.821535109s) [upload=97079]: Upload finished. err: <nil>
Duration: 5.989967969s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|