Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
1.803483777s
FAIL (2025-08-17 11:10:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.803510447s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................X.....................X....] duration:
5.947459439s
FAIL (2025-08-17 11:10:05 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 20f5c17b2a389b9a9a6a81aff30dadb177934992b24c9d05baa0c51475dd21e0 != before 8b13de1f5f56970ea2e7d9a698c60caac3dc1bd6a827bf7b7c912b5dd3e98ecb
======LOGS======
Aug 17 11:06:42.789551667 (209h40m37.220631798s) [upload=218079]: Starting upload
Aug 17 11:06:42.789611722 (209h40m37.220691853s) [upload=218079]: Done starting upload
Aug 17 11:06:42.789745057 (209h40m37.220825178s) [upload=218079]: Uploading segments...
Aug 17 11:06:42.789853595 (209h40m37.220933726s) [upload=218079]: Got next segment. Inline: false
Aug 17 11:06:42.789887530 (209h40m37.220967661s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:06:42.789892639 (209h40m37.22097277s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:06:43.234438112 (209h40m37.665518253s) [seg_pos={0 0}, upload=218079]: Begin upload segment...
Aug 17 11:06:43.234490963 (209h40m37.665571104s) [seg_pos={0 0}, upload=218079]: Done begin upload segment.
Aug 17 11:06:43.234521061 (209h40m37.665601192s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234545547 (209h40m37.665625678s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234969138 (209h40m37.666049269s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235054572 (209h40m37.666134703s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235327434 (209h40m37.666407565s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235379594 (209h40m37.666459745s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235676392 (209h40m37.666756523s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235976846 (209h40m37.667056977s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236324812 (209h40m37.667404943s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236650345 (209h40m37.667730476s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236786415 (209h40m37.667866546s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237074065 (209h40m37.668154196s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237306060 (209h40m37.668386181s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237546209 (209h40m37.66862633s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237839450 (209h40m37.668919591s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238167688 (209h40m37.669247819s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238458875 (209h40m37.669539006s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238828913 (209h40m37.669909044s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:44.350616309 (209h40m38.78169644s) [upload=218079]: Next returned nil segment
Aug 17 11:06:44.350632009 (209h40m38.78171213s) [upload=218079]: Waiting for error group managing segments...
Aug 17 11:06:44.631489305 (209h40m39.062569436s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.133456966 (209h40m39.564537097s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.140679206 (209h40m39.571759337s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.149959422 (209h40m39.581039553s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.167132351 (209h40m39.598212472s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.172737595 (209h40m39.603817726s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.179154353 (209h40m39.610234484s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.208512857 (209h40m39.639592988s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.209183810 (209h40m39.640263931s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.211553555 (209h40m39.642633686s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.247839483 (209h40m39.678919605s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.255155823 (209h40m39.686235944s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.265339658 (209h40m39.696419789s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267134211 (209h40m39.698214342s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267154821 (209h40m39.698234942s) [seg_pos={0 0}, upload=218079]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:06:45.267356376 (209h40m39.698436507s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267436229 (209h40m39.69851635s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niTsTaHjA6LoMMrkEsSnLcRDhZtVAjxsbXUXVeXzhUp3FPbWh): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267490623 (209h40m39.698570754s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSTyRJ62wcMHx8K7uwqp5e8L8yhxH7V3YtBHnYu6QJ3K3bXpQ): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267530660 (209h40m39.698610792s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267549546 (209h40m39.698629687s) [seg_pos={0 0}, upload=218079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:06:45.267651070 (209h40m39.698731202s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:06:45.267658484 (209h40m39.698738615s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:06:45.562813217 (209h40m39.993893348s) [upload=218079]: Done uploading segments...
Aug 17 11:06:45.562831963 (209h40m39.993912094s) [upload=218079]: Upload finished. err: <nil>
Duration: 5.947486851s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
1.853315212s
FAIL (2025-08-17 11:09:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.853340721s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................X.....................X...] duration:
5.952794169s
FAIL (2025-08-17 11:08:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 20f5c17b2a389b9a9a6a81aff30dadb177934992b24c9d05baa0c51475dd21e0 != before 8b13de1f5f56970ea2e7d9a698c60caac3dc1bd6a827bf7b7c912b5dd3e98ecb
======LOGS======
Aug 17 11:06:42.789551667 (209h40m37.220631798s) [upload=218079]: Starting upload
Aug 17 11:06:42.789611722 (209h40m37.220691853s) [upload=218079]: Done starting upload
Aug 17 11:06:42.789745057 (209h40m37.220825178s) [upload=218079]: Uploading segments...
Aug 17 11:06:42.789853595 (209h40m37.220933726s) [upload=218079]: Got next segment. Inline: false
Aug 17 11:06:42.789887530 (209h40m37.220967661s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:06:42.789892639 (209h40m37.22097277s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:06:43.234438112 (209h40m37.665518253s) [seg_pos={0 0}, upload=218079]: Begin upload segment...
Aug 17 11:06:43.234490963 (209h40m37.665571104s) [seg_pos={0 0}, upload=218079]: Done begin upload segment.
Aug 17 11:06:43.234521061 (209h40m37.665601192s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234545547 (209h40m37.665625678s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234969138 (209h40m37.666049269s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235054572 (209h40m37.666134703s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235327434 (209h40m37.666407565s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235379594 (209h40m37.666459745s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235676392 (209h40m37.666756523s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235976846 (209h40m37.667056977s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236324812 (209h40m37.667404943s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236650345 (209h40m37.667730476s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236786415 (209h40m37.667866546s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237074065 (209h40m37.668154196s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237306060 (209h40m37.668386181s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237546209 (209h40m37.66862633s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237839450 (209h40m37.668919591s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238167688 (209h40m37.669247819s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238458875 (209h40m37.669539006s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238828913 (209h40m37.669909044s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:44.350616309 (209h40m38.78169644s) [upload=218079]: Next returned nil segment
Aug 17 11:06:44.350632009 (209h40m38.78171213s) [upload=218079]: Waiting for error group managing segments...
Aug 17 11:06:44.631489305 (209h40m39.062569436s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.133456966 (209h40m39.564537097s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.140679206 (209h40m39.571759337s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.149959422 (209h40m39.581039553s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.167132351 (209h40m39.598212472s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.172737595 (209h40m39.603817726s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.179154353 (209h40m39.610234484s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.208512857 (209h40m39.639592988s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.209183810 (209h40m39.640263931s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.211553555 (209h40m39.642633686s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.247839483 (209h40m39.678919605s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.255155823 (209h40m39.686235944s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.265339658 (209h40m39.696419789s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267134211 (209h40m39.698214342s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267154821 (209h40m39.698234942s) [seg_pos={0 0}, upload=218079]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:06:45.267356376 (209h40m39.698436507s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267436229 (209h40m39.69851635s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niTsTaHjA6LoMMrkEsSnLcRDhZtVAjxsbXUXVeXzhUp3FPbWh): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267490623 (209h40m39.698570754s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSTyRJ62wcMHx8K7uwqp5e8L8yhxH7V3YtBHnYu6QJ3K3bXpQ): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267530660 (209h40m39.698610792s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267549546 (209h40m39.698629687s) [seg_pos={0 0}, upload=218079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:06:45.267651070 (209h40m39.698731202s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:06:45.267658484 (209h40m39.698738615s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:06:45.562813217 (209h40m39.993893348s) [upload=218079]: Done uploading segments...
Aug 17 11:06:45.562831963 (209h40m39.993912094s) [upload=218079]: Upload finished. err: <nil>
Duration: 5.95282095s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
1.829443142s
FAIL (2025-08-17 11:08:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.829469904s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................X.....................X..] duration:
5.956168587s
FAIL (2025-08-17 11:08:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 20f5c17b2a389b9a9a6a81aff30dadb177934992b24c9d05baa0c51475dd21e0 != before 8b13de1f5f56970ea2e7d9a698c60caac3dc1bd6a827bf7b7c912b5dd3e98ecb
======LOGS======
Aug 17 11:06:42.789551667 (209h40m37.220631798s) [upload=218079]: Starting upload
Aug 17 11:06:42.789611722 (209h40m37.220691853s) [upload=218079]: Done starting upload
Aug 17 11:06:42.789745057 (209h40m37.220825178s) [upload=218079]: Uploading segments...
Aug 17 11:06:42.789853595 (209h40m37.220933726s) [upload=218079]: Got next segment. Inline: false
Aug 17 11:06:42.789887530 (209h40m37.220967661s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:06:42.789892639 (209h40m37.22097277s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:06:43.234438112 (209h40m37.665518253s) [seg_pos={0 0}, upload=218079]: Begin upload segment...
Aug 17 11:06:43.234490963 (209h40m37.665571104s) [seg_pos={0 0}, upload=218079]: Done begin upload segment.
Aug 17 11:06:43.234521061 (209h40m37.665601192s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234545547 (209h40m37.665625678s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234969138 (209h40m37.666049269s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235054572 (209h40m37.666134703s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235327434 (209h40m37.666407565s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235379594 (209h40m37.666459745s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235676392 (209h40m37.666756523s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235976846 (209h40m37.667056977s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236324812 (209h40m37.667404943s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236650345 (209h40m37.667730476s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236786415 (209h40m37.667866546s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237074065 (209h40m37.668154196s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237306060 (209h40m37.668386181s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237546209 (209h40m37.66862633s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237839450 (209h40m37.668919591s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238167688 (209h40m37.669247819s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238458875 (209h40m37.669539006s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238828913 (209h40m37.669909044s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:44.350616309 (209h40m38.78169644s) [upload=218079]: Next returned nil segment
Aug 17 11:06:44.350632009 (209h40m38.78171213s) [upload=218079]: Waiting for error group managing segments...
Aug 17 11:06:44.631489305 (209h40m39.062569436s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.133456966 (209h40m39.564537097s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.140679206 (209h40m39.571759337s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.149959422 (209h40m39.581039553s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.167132351 (209h40m39.598212472s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.172737595 (209h40m39.603817726s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.179154353 (209h40m39.610234484s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.208512857 (209h40m39.639592988s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.209183810 (209h40m39.640263931s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.211553555 (209h40m39.642633686s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.247839483 (209h40m39.678919605s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.255155823 (209h40m39.686235944s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.265339658 (209h40m39.696419789s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267134211 (209h40m39.698214342s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267154821 (209h40m39.698234942s) [seg_pos={0 0}, upload=218079]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:06:45.267356376 (209h40m39.698436507s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267436229 (209h40m39.69851635s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niTsTaHjA6LoMMrkEsSnLcRDhZtVAjxsbXUXVeXzhUp3FPbWh): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267490623 (209h40m39.698570754s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSTyRJ62wcMHx8K7uwqp5e8L8yhxH7V3YtBHnYu6QJ3K3bXpQ): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267530660 (209h40m39.698610792s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267549546 (209h40m39.698629687s) [seg_pos={0 0}, upload=218079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:06:45.267651070 (209h40m39.698731202s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:06:45.267658484 (209h40m39.698738615s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:06:45.562813217 (209h40m39.993893348s) [upload=218079]: Done uploading segments...
Aug 17 11:06:45.562831963 (209h40m39.993912094s) [upload=218079]: Upload finished. err: <nil>
Duration: 5.95621734s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.289694725s
FAIL (2025-08-17 11:08:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.289719323s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X.....................X.] duration:
5.747317065s
FAIL (2025-08-17 11:07:19 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 20f5c17b2a389b9a9a6a81aff30dadb177934992b24c9d05baa0c51475dd21e0 != before 8b13de1f5f56970ea2e7d9a698c60caac3dc1bd6a827bf7b7c912b5dd3e98ecb
======LOGS======
Aug 17 11:06:42.789551667 (209h40m37.220631798s) [upload=218079]: Starting upload
Aug 17 11:06:42.789611722 (209h40m37.220691853s) [upload=218079]: Done starting upload
Aug 17 11:06:42.789745057 (209h40m37.220825178s) [upload=218079]: Uploading segments...
Aug 17 11:06:42.789853595 (209h40m37.220933726s) [upload=218079]: Got next segment. Inline: false
Aug 17 11:06:42.789887530 (209h40m37.220967661s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:06:42.789892639 (209h40m37.22097277s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:06:43.234438112 (209h40m37.665518253s) [seg_pos={0 0}, upload=218079]: Begin upload segment...
Aug 17 11:06:43.234490963 (209h40m37.665571104s) [seg_pos={0 0}, upload=218079]: Done begin upload segment.
Aug 17 11:06:43.234521061 (209h40m37.665601192s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234545547 (209h40m37.665625678s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234969138 (209h40m37.666049269s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235054572 (209h40m37.666134703s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235327434 (209h40m37.666407565s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235379594 (209h40m37.666459745s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235676392 (209h40m37.666756523s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235976846 (209h40m37.667056977s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236324812 (209h40m37.667404943s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236650345 (209h40m37.667730476s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236786415 (209h40m37.667866546s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237074065 (209h40m37.668154196s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237306060 (209h40m37.668386181s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237546209 (209h40m37.66862633s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237839450 (209h40m37.668919591s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238167688 (209h40m37.669247819s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238458875 (209h40m37.669539006s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238828913 (209h40m37.669909044s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:44.350616309 (209h40m38.78169644s) [upload=218079]: Next returned nil segment
Aug 17 11:06:44.350632009 (209h40m38.78171213s) [upload=218079]: Waiting for error group managing segments...
Aug 17 11:06:44.631489305 (209h40m39.062569436s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.133456966 (209h40m39.564537097s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.140679206 (209h40m39.571759337s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.149959422 (209h40m39.581039553s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.167132351 (209h40m39.598212472s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.172737595 (209h40m39.603817726s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.179154353 (209h40m39.610234484s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.208512857 (209h40m39.639592988s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.209183810 (209h40m39.640263931s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.211553555 (209h40m39.642633686s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.247839483 (209h40m39.678919605s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.255155823 (209h40m39.686235944s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.265339658 (209h40m39.696419789s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267134211 (209h40m39.698214342s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267154821 (209h40m39.698234942s) [seg_pos={0 0}, upload=218079]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:06:45.267356376 (209h40m39.698436507s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267436229 (209h40m39.69851635s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niTsTaHjA6LoMMrkEsSnLcRDhZtVAjxsbXUXVeXzhUp3FPbWh): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267490623 (209h40m39.698570754s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSTyRJ62wcMHx8K7uwqp5e8L8yhxH7V3YtBHnYu6QJ3K3bXpQ): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267530660 (209h40m39.698610792s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267549546 (209h40m39.698629687s) [seg_pos={0 0}, upload=218079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:06:45.267651070 (209h40m39.698731202s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:06:45.267658484 (209h40m39.698738615s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:06:45.562813217 (209h40m39.993893348s) [upload=218079]: Done uploading segments...
Aug 17 11:06:45.562831963 (209h40m39.993912094s) [upload=218079]: Upload finished. err: <nil>
Duration: 5.747345499s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
1.906420336s
FAIL (2025-08-17 11:06:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.906440684s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X.....................X] duration:
5.723063156s
FAIL (2025-08-17 11:06:47 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 20f5c17b2a389b9a9a6a81aff30dadb177934992b24c9d05baa0c51475dd21e0 != before 8b13de1f5f56970ea2e7d9a698c60caac3dc1bd6a827bf7b7c912b5dd3e98ecb
======LOGS======
Aug 17 11:06:42.789551667 (209h40m37.220631798s) [upload=218079]: Starting upload
Aug 17 11:06:42.789611722 (209h40m37.220691853s) [upload=218079]: Done starting upload
Aug 17 11:06:42.789745057 (209h40m37.220825178s) [upload=218079]: Uploading segments...
Aug 17 11:06:42.789853595 (209h40m37.220933726s) [upload=218079]: Got next segment. Inline: false
Aug 17 11:06:42.789887530 (209h40m37.220967661s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:06:42.789892639 (209h40m37.22097277s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:06:43.234438112 (209h40m37.665518253s) [seg_pos={0 0}, upload=218079]: Begin upload segment...
Aug 17 11:06:43.234490963 (209h40m37.665571104s) [seg_pos={0 0}, upload=218079]: Done begin upload segment.
Aug 17 11:06:43.234521061 (209h40m37.665601192s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234545547 (209h40m37.665625678s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234969138 (209h40m37.666049269s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235054572 (209h40m37.666134703s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235327434 (209h40m37.666407565s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235379594 (209h40m37.666459745s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235676392 (209h40m37.666756523s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235976846 (209h40m37.667056977s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236324812 (209h40m37.667404943s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236650345 (209h40m37.667730476s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236786415 (209h40m37.667866546s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237074065 (209h40m37.668154196s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237306060 (209h40m37.668386181s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237546209 (209h40m37.66862633s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237839450 (209h40m37.668919591s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238167688 (209h40m37.669247819s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238458875 (209h40m37.669539006s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238828913 (209h40m37.669909044s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:44.350616309 (209h40m38.78169644s) [upload=218079]: Next returned nil segment
Aug 17 11:06:44.350632009 (209h40m38.78171213s) [upload=218079]: Waiting for error group managing segments...
Aug 17 11:06:44.631489305 (209h40m39.062569436s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.133456966 (209h40m39.564537097s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.140679206 (209h40m39.571759337s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.149959422 (209h40m39.581039553s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.167132351 (209h40m39.598212472s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.172737595 (209h40m39.603817726s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.179154353 (209h40m39.610234484s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.208512857 (209h40m39.639592988s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.209183810 (209h40m39.640263931s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.211553555 (209h40m39.642633686s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.247839483 (209h40m39.678919605s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.255155823 (209h40m39.686235944s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.265339658 (209h40m39.696419789s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267134211 (209h40m39.698214342s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267154821 (209h40m39.698234942s) [seg_pos={0 0}, upload=218079]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:06:45.267356376 (209h40m39.698436507s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267436229 (209h40m39.69851635s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niTsTaHjA6LoMMrkEsSnLcRDhZtVAjxsbXUXVeXzhUp3FPbWh): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267490623 (209h40m39.698570754s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSTyRJ62wcMHx8K7uwqp5e8L8yhxH7V3YtBHnYu6QJ3K3bXpQ): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267530660 (209h40m39.698610792s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267549546 (209h40m39.698629687s) [seg_pos={0 0}, upload=218079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:06:45.267651070 (209h40m39.698731202s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:06:45.267658484 (209h40m39.698738615s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:06:45.562813217 (209h40m39.993893348s) [upload=218079]: Done uploading segments...
Aug 17 11:06:45.562831963 (209h40m39.993912094s) [upload=218079]: Upload finished. err: <nil>
Duration: 5.723091681s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
1.988183132s
FAIL (2025-08-17 11:06:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.988203832s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
5.886562896s
FAIL (2025-08-17 11:06:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.886594746s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.022631133s
FAIL (2025-08-17 11:05:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.022659166s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
5.729040837s
FAIL (2025-08-17 11:05:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.729070053s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.841603088s
FAIL (2025-08-17 11:05:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.841634888s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.297335674s
FAIL (2025-08-17 11:05:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.297367123s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
5.765450828s
FAIL (2025-08-17 11:04:30 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.765474815s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.062433388s
FAIL (2025-08-17 11:04:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.062459128s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.119590108s
FAIL (2025-08-17 11:03:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.119613294s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.655800772s
FAIL (2025-08-17 11:03:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.655832261s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.348646674s
FAIL (2025-08-17 11:02:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.348682944s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.737450856s
FAIL (2025-08-17 11:02:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.737474791s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.841774265s
FAIL (2025-08-17 11:01:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.841802719s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
5.763355451s
FAIL (2025-08-17 11:01:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.763381642s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
5.685873553s
FAIL (2025-08-17 11:00:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.685895565s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.235188151s
FAIL (2025-08-17 11:00:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.235206195s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
6.451431623s
FAIL (2025-08-17 11:00:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 6.451452263s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.977889918s
FAIL (2025-08-17 10:59:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.977919253s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
5.725114211s
FAIL (2025-08-17 10:59:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.725148577s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.854013421s
FAIL (2025-08-17 10:58:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.854035363s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X......................................................X....] duration:
1.863100471s
FAIL (2025-08-17 10:58:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.863130808s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
5.568880841s
FAIL (2025-08-17 10:58:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.568916058s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
5.714607754s
FAIL (2025-08-17 10:57:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.714624567s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [XX......................................................X...] duration:
1.829558482s
FAIL (2025-08-17 10:57:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.829582427s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [XXX......................................................X..] duration:
1.855340331s
FAIL (2025-08-17 10:57:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.855365298s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.XXX......................................................X.] duration:
1.833138804s
FAIL (2025-08-17 10:56:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.833167568s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
5.815129517s
FAIL (2025-08-17 10:56:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.815157459s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..XXX......................................................X] duration:
857.67348ms
FAIL (2025-08-17 10:56:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 857.690734ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
5.468020775s
FAIL (2025-08-17 10:56:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.468036276s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...XXX......................................................] duration:
1.883186371s
FAIL (2025-08-17 10:55:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.883213042s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....XXX.....................................................] duration:
1.800151927s
FAIL (2025-08-17 10:55:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.800171855s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
5.911842629s
FAIL (2025-08-17 10:55:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.911870492s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....XXX....................................................] duration:
1.853684052s
FAIL (2025-08-17 10:55:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.853713069s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
5.575553859s
FAIL (2025-08-17 10:55:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.575576862s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......XXX...................................................] duration:
1.88991157s
FAIL (2025-08-17 10:54:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.889941698s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
5.505673698s
FAIL (2025-08-17 10:54:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.505702214s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......XXX..................................................] duration:
1.861629097s
FAIL (2025-08-17 10:53:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.861645258s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
5.821434081s
FAIL (2025-08-17 10:53:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.821462255s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X.......XXX.................................................] duration:
1.819348105s
FAIL (2025-08-17 10:52:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.819380548s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
5.5153478s
FAIL (2025-08-17 10:52:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.515386775s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|