Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X.......................................X...........X...] duration:
5.708675594s
FAIL (2025-08-18 01:59:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 01:57:40.059769044 (224h31m34.490849175s) [upload=233531]: Starting upload Aug 18 01:57:40.059830432 (224h31m34.490910563s) [upload=233531]: Done starting upload Aug 18 01:57:40.059971521 (224h31m34.491051652s) [upload=233531]: Uploading segments... Aug 18 01:57:40.060109576 (224h31m34.491189707s) [upload=233531]: Got next segment. Inline: false Aug 18 01:57:40.060139793 (224h31m34.491219914s) [upload=233531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:57:40.060144482 (224h31m34.491224613s) [upload=233531]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 01:57:40.329080021 (224h31m34.760160212s) [upload=233531]: Next segment err: metaclient: Too Many Requests Aug 18 01:57:40.329179039 (224h31m34.760259192s) [upload=233531]: Done uploading segments... Aug 18 01:57:40.329199058 (224h31m34.760279199s) [upload=233531]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.708707455s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.....................XX.....X..X...................X...X....] duration:
1.905323613s
FAIL (2025-08-18 01:59:01 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 01:56:06.774084834 (224h30m1.205164975s) [upload=233496]: Starting upload Aug 18 01:56:06.774176439 (224h30m1.20525657s) [upload=233496]: Done starting upload Aug 18 01:56:06.774251723 (224h30m1.205331844s) [upload=233496]: Uploading segments... Aug 18 01:56:06.774313891 (224h30m1.205394023s) [upload=233496]: Got next segment. Inline: true Aug 18 01:56:06.774319081 (224h30m1.205399212s) [upload=233496]: Waiting for error group managing segments... Aug 18 01:56:06.774362986 (224h30m1.205443107s) [upload=233496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:56:06.774369037 (224h30m1.205449168s) [upload=233496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 01:56:06.774371632 (224h30m1.205451763s) [upload=233496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 01:56:07.267528183 (224h30m1.698608314s) [upload=233496]: Done uploading segments... Aug 18 01:56:07.267545005 (224h30m1.698625126s) [upload=233496]: Upload finished. err: <nil>
Duration: 1.905349393s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X.......................................X...........X..] duration:
5.76456569s
FAIL (2025-08-18 01:58:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 01:57:40.059769044 (224h31m34.490849175s) [upload=233531]: Starting upload Aug 18 01:57:40.059830432 (224h31m34.490910563s) [upload=233531]: Done starting upload Aug 18 01:57:40.059971521 (224h31m34.491051652s) [upload=233531]: Uploading segments... Aug 18 01:57:40.060109576 (224h31m34.491189707s) [upload=233531]: Got next segment. Inline: false Aug 18 01:57:40.060139793 (224h31m34.491219914s) [upload=233531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:57:40.060144482 (224h31m34.491224613s) [upload=233531]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 01:57:40.329080021 (224h31m34.760160212s) [upload=233531]: Next segment err: metaclient: Too Many Requests Aug 18 01:57:40.329179039 (224h31m34.760259192s) [upload=233531]: Done uploading segments... Aug 18 01:57:40.329199058 (224h31m34.760279199s) [upload=233531]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.764590067s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [......................XX.....X..X...................X...X...] duration:
1.912917307s
FAIL (2025-08-18 01:58:37 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 01:56:06.774084834 (224h30m1.205164975s) [upload=233496]: Starting upload Aug 18 01:56:06.774176439 (224h30m1.20525657s) [upload=233496]: Done starting upload Aug 18 01:56:06.774251723 (224h30m1.205331844s) [upload=233496]: Uploading segments... Aug 18 01:56:06.774313891 (224h30m1.205394023s) [upload=233496]: Got next segment. Inline: true Aug 18 01:56:06.774319081 (224h30m1.205399212s) [upload=233496]: Waiting for error group managing segments... Aug 18 01:56:06.774362986 (224h30m1.205443107s) [upload=233496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:56:06.774369037 (224h30m1.205449168s) [upload=233496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 01:56:06.774371632 (224h30m1.205451763s) [upload=233496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 01:56:07.267528183 (224h30m1.698608314s) [upload=233496]: Done uploading segments... Aug 18 01:56:07.267545005 (224h30m1.698625126s) [upload=233496]: Upload finished. err: <nil>
Duration: 1.912951683s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X.......................................X...........X.] duration:
5.869019608s
FAIL (2025-08-18 01:58:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 01:57:40.059769044 (224h31m34.490849175s) [upload=233531]: Starting upload Aug 18 01:57:40.059830432 (224h31m34.490910563s) [upload=233531]: Done starting upload Aug 18 01:57:40.059971521 (224h31m34.491051652s) [upload=233531]: Uploading segments... Aug 18 01:57:40.060109576 (224h31m34.491189707s) [upload=233531]: Got next segment. Inline: false Aug 18 01:57:40.060139793 (224h31m34.491219914s) [upload=233531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:57:40.060144482 (224h31m34.491224613s) [upload=233531]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 01:57:40.329080021 (224h31m34.760160212s) [upload=233531]: Next segment err: metaclient: Too Many Requests Aug 18 01:57:40.329179039 (224h31m34.760259192s) [upload=233531]: Done uploading segments... Aug 18 01:57:40.329199058 (224h31m34.760279199s) [upload=233531]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.869046339s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X.......................................X...........X] duration:
937.597418ms
FAIL (2025-08-18 01:57:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 01:57:40.059769044 (224h31m34.490849175s) [upload=233531]: Starting upload Aug 18 01:57:40.059830432 (224h31m34.490910563s) [upload=233531]: Done starting upload Aug 18 01:57:40.059971521 (224h31m34.491051652s) [upload=233531]: Uploading segments... Aug 18 01:57:40.060109576 (224h31m34.491189707s) [upload=233531]: Got next segment. Inline: false Aug 18 01:57:40.060139793 (224h31m34.491219914s) [upload=233531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:57:40.060144482 (224h31m34.491224613s) [upload=233531]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 01:57:40.329080021 (224h31m34.760160212s) [upload=233531]: Next segment err: metaclient: Too Many Requests Aug 18 01:57:40.329179039 (224h31m34.760259192s) [upload=233531]: Done uploading segments... Aug 18 01:57:40.329199058 (224h31m34.760279199s) [upload=233531]: Upload finished. err: metaclient: Too Many Requests
Duration: 937.615311ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.......................XX.....X..X...................X...X..] duration:
1.915392673s
FAIL (2025-08-18 01:57:34 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 01:56:06.774084834 (224h30m1.205164975s) [upload=233496]: Starting upload Aug 18 01:56:06.774176439 (224h30m1.20525657s) [upload=233496]: Done starting upload Aug 18 01:56:06.774251723 (224h30m1.205331844s) [upload=233496]: Uploading segments... Aug 18 01:56:06.774313891 (224h30m1.205394023s) [upload=233496]: Got next segment. Inline: true Aug 18 01:56:06.774319081 (224h30m1.205399212s) [upload=233496]: Waiting for error group managing segments... Aug 18 01:56:06.774362986 (224h30m1.205443107s) [upload=233496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:56:06.774369037 (224h30m1.205449168s) [upload=233496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 01:56:06.774371632 (224h30m1.205451763s) [upload=233496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 01:56:07.267528183 (224h30m1.698608314s) [upload=233496]: Done uploading segments... Aug 18 01:56:07.267545005 (224h30m1.698625126s) [upload=233496]: Upload finished. err: <nil>
Duration: 1.91541803s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X.......................................X...........] duration:
5.719657018s
FAIL (2025-08-18 01:57:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 01:49:36.672171641 (224h23m31.103251772s) [upload=233381]: Starting upload
Aug 18 01:49:36.672234732 (224h23m31.103314863s) [upload=233381]: Done starting upload
Aug 18 01:49:36.672373758 (224h23m31.103453899s) [upload=233381]: Uploading segments...
Aug 18 01:49:36.672529816 (224h23m31.103609967s) [upload=233381]: Got next segment. Inline: false
Aug 18 01:49:36.672585603 (224h23m31.103665754s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 01:49:36.672592166 (224h23m31.103672297s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 01:49:37.143520003 (224h23m31.574600134s) [seg_pos={0 0}, upload=233381]: Begin upload segment...
Aug 18 01:49:37.143570901 (224h23m31.574651032s) [seg_pos={0 0}, upload=233381]: Done begin upload segment.
Aug 18 01:49:37.143593234 (224h23m31.574673355s) [noise=true , address=104.36.82.9:4011 , piece_id=5QEXV5XZ4T6EF4ZBIVTSYIVKIGOMKOR6ALO33LPORAEOVHHFE6GA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.143664580 (224h23m31.574744701s) [noise=true , address=77.90.31.18:4825 , piece_id=N5FUZPZFO5WZSB7PJTJYHGXFEIZDIWPCITYDIQWOILYW5IKQYYQA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144042823 (224h23m31.575122955s) [noise=true , address=104.36.82.19:4402 , piece_id=FVI6JRNZYLMULP6W5U5FMKCJSWSELEIG3VLR3QLRWYSO5SUI6RZQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144429493 (224h23m31.575509624s) [noise=true , address=104.36.82.18:4400 , piece_id=5LZNZ4M2K6P3NJD57R7IL4UOGYFQOU7AE3XPAUVYCTJHRNBWMVJQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144738945 (224h23m31.575819076s) [noise=true , address=104.36.82.12:4171 , piece_id=RW35JO2COE6QYHEMFVSY4WXEP7HDFOTMTQY4QNVUJUW4FIJUONLQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144861700 (224h23m31.575941821s) [noise=true , address=104.36.82.34:4578 , piece_id=RWY7Z7KQQ4ZNCKFMJG4H4RHWMC6TNTLNW3DRIIBGWFBHWAYWRR2A, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145048208 (224h23m31.576128339s) [noise=true , address=104.36.82.4:4822 , piece_id=7PUOVYBGPFYJQZUBCCHX7AAHKTYB7ZJBFWHJHUJYU22T5DNOARAQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145120676 (224h23m31.576200807s) [noise=true , address=104.36.82.60:4357 , piece_id=SBPQNA5WQ6GI7N73NZLWKL5PXSI3PYF6J5HEPQBRIEVNPHKR5WVQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145318845 (224h23m31.576398977s) [noise=true , address=104.36.82.60:4368 , piece_id=44V5R55SJKLLHQNLUT3XNCMOHUYOTMNUE2V2ZF3QFCA55CC7QN3Q, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145594723 (224h23m31.576674854s) [noise=true , address=45.91.116.7:4029 , piece_id=7TVZLDWPESAINQ37KRCCVWC5YDK6DVC5KVRF7NXVNZ4GNQKVZIVQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145897102 (224h23m31.576977233s) [noise=true , address=104.36.82.38:4695 , piece_id=Q2ZK6THXBRABGL5ZL5RCAZVCDJ3PSWWTMP26GMJKUBYTZFWTSNDQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146160455 (224h23m31.577240576s) [noise=true , address=104.36.82.35:4611 , piece_id=GFIQTHHV67STQ6KFD25FSXSY3SFZJYYNDXTGY3UR4NA3HLBMB6YQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146458486 (224h23m31.577538617s) [noise=true , address=104.36.82.43:4839 , piece_id=ODQ3X4GQJ4F5K47QKW756U3HR7U2AWBVEWOEHFI7PMB73JCMTC6A, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146582913 (224h23m31.577663044s) [noise=true , address=77.90.31.12:4595 , piece_id=7CLANDDN6F2HLIVZNXXXPCX32TPZZ2XEXKILVXGBP7Y2UCFDTQHA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146840807 (224h23m31.577920938s) [noise=true , address=45.91.116.14:4213 , piece_id=75LD5HR6M6HD5GIW4JWLXKCSNKIPX2EALMXIELAVI7QZRIQ3W7WQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147081808 (224h23m31.57816194s) [noise=true , address=77.90.31.15:4721 , piece_id=NK362IOTNC4ED22FGSMKSNLYHZD55Y5MAPBKV3UG63A4BRABKIGA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147231294 (224h23m31.578311455s) [noise=true , address=104.36.82.44:4892 , piece_id=FOBEPAPVYOJUEIZGEJDJBLQP5RKJ2ZJNAOOWZ5NYAPL4MZBBRUDQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147561586 (224h23m31.578641717s) [noise=true , address=104.36.82.36:4651 , piece_id=OTEC4GO32RCZPQWP4LK3JROYRG33VLGSOZZ4P5NIXRPQHRL3QPOQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:38.621048699 (224h23m33.05212888s) [upload=233381]: Next returned nil segment
Aug 18 01:49:38.621070491 (224h23m33.052150652s) [upload=233381]: Waiting for error group managing segments...
Aug 18 01:49:39.039263997 (224h23m33.470344128s) [noise=true , address=45.91.116.14:4213 , piece_id=75LD5HR6M6HD5GIW4JWLXKCSNKIPX2EALMXIELAVI7QZRIQ3W7WQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.050452676 (224h23m33.481532807s) [noise=true , address=104.36.82.38:4695 , piece_id=Q2ZK6THXBRABGL5ZL5RCAZVCDJ3PSWWTMP26GMJKUBYTZFWTSNDQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.066702338 (224h23m33.497782469s) [noise=true , address=77.90.31.18:4825 , piece_id=N5FUZPZFO5WZSB7PJTJYHGXFEIZDIWPCITYDIQWOILYW5IKQYYQA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.091533990 (224h23m33.522614121s) [noise=true , address=77.90.31.15:4721 , piece_id=NK362IOTNC4ED22FGSMKSNLYHZD55Y5MAPBKV3UG63A4BRABKIGA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.094447966 (224h23m33.525528097s) [noise=true , address=104.36.82.36:4651 , piece_id=OTEC4GO32RCZPQWP4LK3JROYRG33VLGSOZZ4P5NIXRPQHRL3QPOQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124130209 (224h23m33.55521033s) [noise=true , address=104.36.82.34:4578 , piece_id=RWY7Z7KQQ4ZNCKFMJG4H4RHWMC6TNTLNW3DRIIBGWFBHWAYWRR2A, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124312378 (224h23m33.555392509s) [noise=true , address=104.36.82.9:4011 , piece_id=5QEXV5XZ4T6EF4ZBIVTSYIVKIGOMKOR6ALO33LPORAEOVHHFE6GA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124738052 (224h23m33.555818183s) [noise=true , address=104.36.82.12:4171 , piece_id=RW35JO2COE6QYHEMFVSY4WXEP7HDFOTMTQY4QNVUJUW4FIJUONLQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.170134133 (224h23m33.601214264s) [noise=true , address=104.36.82.60:4368 , piece_id=44V5R55SJKLLHQNLUT3XNCMOHUYOTMNUE2V2ZF3QFCA55CC7QN3Q, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.190436149 (224h23m33.62151628s) [noise=true , address=104.36.82.4:4822 , piece_id=7PUOVYBGPFYJQZUBCCHX7AAHKTYB7ZJBFWHJHUJYU22T5DNOARAQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.198050718 (224h23m33.629130849s) [noise=true , address=104.36.82.35:4611 , piece_id=GFIQTHHV67STQ6KFD25FSXSY3SFZJYYNDXTGY3UR4NA3HLBMB6YQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218397429 (224h23m33.64947756s) [noise=true , address=104.36.82.43:4839 , piece_id=ODQ3X4GQJ4F5K47QKW756U3HR7U2AWBVEWOEHFI7PMB73JCMTC6A, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218724114 (224h23m33.649804245s) [noise=true , address=104.36.82.19:4402 , piece_id=FVI6JRNZYLMULP6W5U5FMKCJSWSELEIG3VLR3QLRWYSO5SUI6RZQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218936471 (224h23m33.650016602s) [noise=true , address=104.36.82.44:4892 , piece_id=FOBEPAPVYOJUEIZGEJDJBLQP5RKJ2ZJNAOOWZ5NYAPL4MZBBRUDQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218949846 (224h23m33.650029977s) [seg_pos={0 0}, upload=233381]: Segment reached optimal threshold of 14 pieces.
Aug 18 01:49:39.219040078 (224h23m33.65012021s) [noise=true , address=77.90.31.12:4595 , piece_id=7CLANDDN6F2HLIVZNXXXPCX32TPZZ2XEXKILVXGBP7Y2UCFDTQHA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1he15nyRz78fmHLkMRs8Hxi2HntmzNsPTqKEbHNUthhSjGMmuj): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219101787 (224h23m33.650181918s) [noise=true , address=104.36.82.60:4357 , piece_id=SBPQNA5WQ6GI7N73NZLWKL5PXSI3PYF6J5HEPQBRIEVNPHKR5WVQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219231865 (224h23m33.650311996s) [noise=true , address=104.36.82.18:4400 , piece_id=5LZNZ4M2K6P3NJD57R7IL4UOGYFQOU7AE3XPAUVYCTJHRNBWMVJQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UxA6DMP2dr2T8o352iih2D6UeEeGQBMm1SgPbHYHuWaSFdyYv): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219270049 (224h23m33.65035018s) [noise=true , address=45.91.116.7:4029 , piece_id=7TVZLDWPESAINQ37KRCCVWC5YDK6DVC5KVRF7NXVNZ4GNQKVZIVQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rWqAGD7Vrj2yzEVyNbfPp278Gga42xPLyAcdzGvUSuz3EgJYh): protocol: write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection; write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection
Aug 18 01:49:39.219287963 (224h23m33.650368094s) [seg_pos={0 0}, upload=233381]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 01:49:39.219379378 (224h23m33.650459509s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 01:49:39.219384227 (224h23m33.650464358s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 01:49:39.546073200 (224h23m33.977153331s) [upload=233381]: Done uploading segments...
Aug 18 01:49:39.546095903 (224h23m33.977176034s) [upload=233381]: Upload finished. err: <nil>
Duration: 5.7196901s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [........................XX.....X..X...................X...X.] duration:
2.019654122s
FAIL (2025-08-18 01:56:37 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 01:56:06.774084834 (224h30m1.205164975s) [upload=233496]: Starting upload Aug 18 01:56:06.774176439 (224h30m1.20525657s) [upload=233496]: Done starting upload Aug 18 01:56:06.774251723 (224h30m1.205331844s) [upload=233496]: Uploading segments... Aug 18 01:56:06.774313891 (224h30m1.205394023s) [upload=233496]: Got next segment. Inline: true Aug 18 01:56:06.774319081 (224h30m1.205399212s) [upload=233496]: Waiting for error group managing segments... Aug 18 01:56:06.774362986 (224h30m1.205443107s) [upload=233496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:56:06.774369037 (224h30m1.205449168s) [upload=233496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 01:56:06.774371632 (224h30m1.205451763s) [upload=233496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 01:56:07.267528183 (224h30m1.698608314s) [upload=233496]: Done uploading segments... Aug 18 01:56:07.267545005 (224h30m1.698625126s) [upload=233496]: Upload finished. err: <nil>
Duration: 2.019671426s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X.......................................X..........] duration:
5.740057591s
FAIL (2025-08-18 01:56:29 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 01:49:36.672171641 (224h23m31.103251772s) [upload=233381]: Starting upload
Aug 18 01:49:36.672234732 (224h23m31.103314863s) [upload=233381]: Done starting upload
Aug 18 01:49:36.672373758 (224h23m31.103453899s) [upload=233381]: Uploading segments...
Aug 18 01:49:36.672529816 (224h23m31.103609967s) [upload=233381]: Got next segment. Inline: false
Aug 18 01:49:36.672585603 (224h23m31.103665754s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 01:49:36.672592166 (224h23m31.103672297s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 01:49:37.143520003 (224h23m31.574600134s) [seg_pos={0 0}, upload=233381]: Begin upload segment...
Aug 18 01:49:37.143570901 (224h23m31.574651032s) [seg_pos={0 0}, upload=233381]: Done begin upload segment.
Aug 18 01:49:37.143593234 (224h23m31.574673355s) [noise=true , address=104.36.82.9:4011 , piece_id=5QEXV5XZ4T6EF4ZBIVTSYIVKIGOMKOR6ALO33LPORAEOVHHFE6GA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.143664580 (224h23m31.574744701s) [noise=true , address=77.90.31.18:4825 , piece_id=N5FUZPZFO5WZSB7PJTJYHGXFEIZDIWPCITYDIQWOILYW5IKQYYQA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144042823 (224h23m31.575122955s) [noise=true , address=104.36.82.19:4402 , piece_id=FVI6JRNZYLMULP6W5U5FMKCJSWSELEIG3VLR3QLRWYSO5SUI6RZQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144429493 (224h23m31.575509624s) [noise=true , address=104.36.82.18:4400 , piece_id=5LZNZ4M2K6P3NJD57R7IL4UOGYFQOU7AE3XPAUVYCTJHRNBWMVJQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144738945 (224h23m31.575819076s) [noise=true , address=104.36.82.12:4171 , piece_id=RW35JO2COE6QYHEMFVSY4WXEP7HDFOTMTQY4QNVUJUW4FIJUONLQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144861700 (224h23m31.575941821s) [noise=true , address=104.36.82.34:4578 , piece_id=RWY7Z7KQQ4ZNCKFMJG4H4RHWMC6TNTLNW3DRIIBGWFBHWAYWRR2A, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145048208 (224h23m31.576128339s) [noise=true , address=104.36.82.4:4822 , piece_id=7PUOVYBGPFYJQZUBCCHX7AAHKTYB7ZJBFWHJHUJYU22T5DNOARAQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145120676 (224h23m31.576200807s) [noise=true , address=104.36.82.60:4357 , piece_id=SBPQNA5WQ6GI7N73NZLWKL5PXSI3PYF6J5HEPQBRIEVNPHKR5WVQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145318845 (224h23m31.576398977s) [noise=true , address=104.36.82.60:4368 , piece_id=44V5R55SJKLLHQNLUT3XNCMOHUYOTMNUE2V2ZF3QFCA55CC7QN3Q, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145594723 (224h23m31.576674854s) [noise=true , address=45.91.116.7:4029 , piece_id=7TVZLDWPESAINQ37KRCCVWC5YDK6DVC5KVRF7NXVNZ4GNQKVZIVQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145897102 (224h23m31.576977233s) [noise=true , address=104.36.82.38:4695 , piece_id=Q2ZK6THXBRABGL5ZL5RCAZVCDJ3PSWWTMP26GMJKUBYTZFWTSNDQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146160455 (224h23m31.577240576s) [noise=true , address=104.36.82.35:4611 , piece_id=GFIQTHHV67STQ6KFD25FSXSY3SFZJYYNDXTGY3UR4NA3HLBMB6YQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146458486 (224h23m31.577538617s) [noise=true , address=104.36.82.43:4839 , piece_id=ODQ3X4GQJ4F5K47QKW756U3HR7U2AWBVEWOEHFI7PMB73JCMTC6A, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146582913 (224h23m31.577663044s) [noise=true , address=77.90.31.12:4595 , piece_id=7CLANDDN6F2HLIVZNXXXPCX32TPZZ2XEXKILVXGBP7Y2UCFDTQHA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146840807 (224h23m31.577920938s) [noise=true , address=45.91.116.14:4213 , piece_id=75LD5HR6M6HD5GIW4JWLXKCSNKIPX2EALMXIELAVI7QZRIQ3W7WQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147081808 (224h23m31.57816194s) [noise=true , address=77.90.31.15:4721 , piece_id=NK362IOTNC4ED22FGSMKSNLYHZD55Y5MAPBKV3UG63A4BRABKIGA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147231294 (224h23m31.578311455s) [noise=true , address=104.36.82.44:4892 , piece_id=FOBEPAPVYOJUEIZGEJDJBLQP5RKJ2ZJNAOOWZ5NYAPL4MZBBRUDQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147561586 (224h23m31.578641717s) [noise=true , address=104.36.82.36:4651 , piece_id=OTEC4GO32RCZPQWP4LK3JROYRG33VLGSOZZ4P5NIXRPQHRL3QPOQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:38.621048699 (224h23m33.05212888s) [upload=233381]: Next returned nil segment
Aug 18 01:49:38.621070491 (224h23m33.052150652s) [upload=233381]: Waiting for error group managing segments...
Aug 18 01:49:39.039263997 (224h23m33.470344128s) [noise=true , address=45.91.116.14:4213 , piece_id=75LD5HR6M6HD5GIW4JWLXKCSNKIPX2EALMXIELAVI7QZRIQ3W7WQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.050452676 (224h23m33.481532807s) [noise=true , address=104.36.82.38:4695 , piece_id=Q2ZK6THXBRABGL5ZL5RCAZVCDJ3PSWWTMP26GMJKUBYTZFWTSNDQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.066702338 (224h23m33.497782469s) [noise=true , address=77.90.31.18:4825 , piece_id=N5FUZPZFO5WZSB7PJTJYHGXFEIZDIWPCITYDIQWOILYW5IKQYYQA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.091533990 (224h23m33.522614121s) [noise=true , address=77.90.31.15:4721 , piece_id=NK362IOTNC4ED22FGSMKSNLYHZD55Y5MAPBKV3UG63A4BRABKIGA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.094447966 (224h23m33.525528097s) [noise=true , address=104.36.82.36:4651 , piece_id=OTEC4GO32RCZPQWP4LK3JROYRG33VLGSOZZ4P5NIXRPQHRL3QPOQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124130209 (224h23m33.55521033s) [noise=true , address=104.36.82.34:4578 , piece_id=RWY7Z7KQQ4ZNCKFMJG4H4RHWMC6TNTLNW3DRIIBGWFBHWAYWRR2A, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124312378 (224h23m33.555392509s) [noise=true , address=104.36.82.9:4011 , piece_id=5QEXV5XZ4T6EF4ZBIVTSYIVKIGOMKOR6ALO33LPORAEOVHHFE6GA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124738052 (224h23m33.555818183s) [noise=true , address=104.36.82.12:4171 , piece_id=RW35JO2COE6QYHEMFVSY4WXEP7HDFOTMTQY4QNVUJUW4FIJUONLQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.170134133 (224h23m33.601214264s) [noise=true , address=104.36.82.60:4368 , piece_id=44V5R55SJKLLHQNLUT3XNCMOHUYOTMNUE2V2ZF3QFCA55CC7QN3Q, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.190436149 (224h23m33.62151628s) [noise=true , address=104.36.82.4:4822 , piece_id=7PUOVYBGPFYJQZUBCCHX7AAHKTYB7ZJBFWHJHUJYU22T5DNOARAQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.198050718 (224h23m33.629130849s) [noise=true , address=104.36.82.35:4611 , piece_id=GFIQTHHV67STQ6KFD25FSXSY3SFZJYYNDXTGY3UR4NA3HLBMB6YQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218397429 (224h23m33.64947756s) [noise=true , address=104.36.82.43:4839 , piece_id=ODQ3X4GQJ4F5K47QKW756U3HR7U2AWBVEWOEHFI7PMB73JCMTC6A, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218724114 (224h23m33.649804245s) [noise=true , address=104.36.82.19:4402 , piece_id=FVI6JRNZYLMULP6W5U5FMKCJSWSELEIG3VLR3QLRWYSO5SUI6RZQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218936471 (224h23m33.650016602s) [noise=true , address=104.36.82.44:4892 , piece_id=FOBEPAPVYOJUEIZGEJDJBLQP5RKJ2ZJNAOOWZ5NYAPL4MZBBRUDQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218949846 (224h23m33.650029977s) [seg_pos={0 0}, upload=233381]: Segment reached optimal threshold of 14 pieces.
Aug 18 01:49:39.219040078 (224h23m33.65012021s) [noise=true , address=77.90.31.12:4595 , piece_id=7CLANDDN6F2HLIVZNXXXPCX32TPZZ2XEXKILVXGBP7Y2UCFDTQHA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1he15nyRz78fmHLkMRs8Hxi2HntmzNsPTqKEbHNUthhSjGMmuj): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219101787 (224h23m33.650181918s) [noise=true , address=104.36.82.60:4357 , piece_id=SBPQNA5WQ6GI7N73NZLWKL5PXSI3PYF6J5HEPQBRIEVNPHKR5WVQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219231865 (224h23m33.650311996s) [noise=true , address=104.36.82.18:4400 , piece_id=5LZNZ4M2K6P3NJD57R7IL4UOGYFQOU7AE3XPAUVYCTJHRNBWMVJQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UxA6DMP2dr2T8o352iih2D6UeEeGQBMm1SgPbHYHuWaSFdyYv): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219270049 (224h23m33.65035018s) [noise=true , address=45.91.116.7:4029 , piece_id=7TVZLDWPESAINQ37KRCCVWC5YDK6DVC5KVRF7NXVNZ4GNQKVZIVQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rWqAGD7Vrj2yzEVyNbfPp278Gga42xPLyAcdzGvUSuz3EgJYh): protocol: write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection; write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection
Aug 18 01:49:39.219287963 (224h23m33.650368094s) [seg_pos={0 0}, upload=233381]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 01:49:39.219379378 (224h23m33.650459509s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 01:49:39.219384227 (224h23m33.650464358s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 01:49:39.546073200 (224h23m33.977153331s) [upload=233381]: Done uploading segments...
Aug 18 01:49:39.546095903 (224h23m33.977176034s) [upload=233381]: Upload finished. err: <nil>
Duration: 5.740097057s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.........................XX.....X..X...................X...X] duration:
1.767174133s
FAIL (2025-08-18 01:56:07 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 01:56:06.774084834 (224h30m1.205164975s) [upload=233496]: Starting upload Aug 18 01:56:06.774176439 (224h30m1.20525657s) [upload=233496]: Done starting upload Aug 18 01:56:06.774251723 (224h30m1.205331844s) [upload=233496]: Uploading segments... Aug 18 01:56:06.774313891 (224h30m1.205394023s) [upload=233496]: Got next segment. Inline: true Aug 18 01:56:06.774319081 (224h30m1.205399212s) [upload=233496]: Waiting for error group managing segments... Aug 18 01:56:06.774362986 (224h30m1.205443107s) [upload=233496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:56:06.774369037 (224h30m1.205449168s) [upload=233496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 01:56:06.774371632 (224h30m1.205451763s) [upload=233496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 01:56:07.267528183 (224h30m1.698608314s) [upload=233496]: Done uploading segments... Aug 18 01:56:07.267545005 (224h30m1.698625126s) [upload=233496]: Upload finished. err: <nil>
Duration: 1.767205342s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X.......................................X.........] duration:
5.661402705s
FAIL (2025-08-18 01:55:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 01:49:36.672171641 (224h23m31.103251772s) [upload=233381]: Starting upload
Aug 18 01:49:36.672234732 (224h23m31.103314863s) [upload=233381]: Done starting upload
Aug 18 01:49:36.672373758 (224h23m31.103453899s) [upload=233381]: Uploading segments...
Aug 18 01:49:36.672529816 (224h23m31.103609967s) [upload=233381]: Got next segment. Inline: false
Aug 18 01:49:36.672585603 (224h23m31.103665754s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 01:49:36.672592166 (224h23m31.103672297s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 01:49:37.143520003 (224h23m31.574600134s) [seg_pos={0 0}, upload=233381]: Begin upload segment...
Aug 18 01:49:37.143570901 (224h23m31.574651032s) [seg_pos={0 0}, upload=233381]: Done begin upload segment.
Aug 18 01:49:37.143593234 (224h23m31.574673355s) [noise=true , address=104.36.82.9:4011 , piece_id=5QEXV5XZ4T6EF4ZBIVTSYIVKIGOMKOR6ALO33LPORAEOVHHFE6GA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.143664580 (224h23m31.574744701s) [noise=true , address=77.90.31.18:4825 , piece_id=N5FUZPZFO5WZSB7PJTJYHGXFEIZDIWPCITYDIQWOILYW5IKQYYQA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144042823 (224h23m31.575122955s) [noise=true , address=104.36.82.19:4402 , piece_id=FVI6JRNZYLMULP6W5U5FMKCJSWSELEIG3VLR3QLRWYSO5SUI6RZQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144429493 (224h23m31.575509624s) [noise=true , address=104.36.82.18:4400 , piece_id=5LZNZ4M2K6P3NJD57R7IL4UOGYFQOU7AE3XPAUVYCTJHRNBWMVJQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144738945 (224h23m31.575819076s) [noise=true , address=104.36.82.12:4171 , piece_id=RW35JO2COE6QYHEMFVSY4WXEP7HDFOTMTQY4QNVUJUW4FIJUONLQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144861700 (224h23m31.575941821s) [noise=true , address=104.36.82.34:4578 , piece_id=RWY7Z7KQQ4ZNCKFMJG4H4RHWMC6TNTLNW3DRIIBGWFBHWAYWRR2A, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145048208 (224h23m31.576128339s) [noise=true , address=104.36.82.4:4822 , piece_id=7PUOVYBGPFYJQZUBCCHX7AAHKTYB7ZJBFWHJHUJYU22T5DNOARAQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145120676 (224h23m31.576200807s) [noise=true , address=104.36.82.60:4357 , piece_id=SBPQNA5WQ6GI7N73NZLWKL5PXSI3PYF6J5HEPQBRIEVNPHKR5WVQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145318845 (224h23m31.576398977s) [noise=true , address=104.36.82.60:4368 , piece_id=44V5R55SJKLLHQNLUT3XNCMOHUYOTMNUE2V2ZF3QFCA55CC7QN3Q, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145594723 (224h23m31.576674854s) [noise=true , address=45.91.116.7:4029 , piece_id=7TVZLDWPESAINQ37KRCCVWC5YDK6DVC5KVRF7NXVNZ4GNQKVZIVQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145897102 (224h23m31.576977233s) [noise=true , address=104.36.82.38:4695 , piece_id=Q2ZK6THXBRABGL5ZL5RCAZVCDJ3PSWWTMP26GMJKUBYTZFWTSNDQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146160455 (224h23m31.577240576s) [noise=true , address=104.36.82.35:4611 , piece_id=GFIQTHHV67STQ6KFD25FSXSY3SFZJYYNDXTGY3UR4NA3HLBMB6YQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146458486 (224h23m31.577538617s) [noise=true , address=104.36.82.43:4839 , piece_id=ODQ3X4GQJ4F5K47QKW756U3HR7U2AWBVEWOEHFI7PMB73JCMTC6A, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146582913 (224h23m31.577663044s) [noise=true , address=77.90.31.12:4595 , piece_id=7CLANDDN6F2HLIVZNXXXPCX32TPZZ2XEXKILVXGBP7Y2UCFDTQHA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146840807 (224h23m31.577920938s) [noise=true , address=45.91.116.14:4213 , piece_id=75LD5HR6M6HD5GIW4JWLXKCSNKIPX2EALMXIELAVI7QZRIQ3W7WQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147081808 (224h23m31.57816194s) [noise=true , address=77.90.31.15:4721 , piece_id=NK362IOTNC4ED22FGSMKSNLYHZD55Y5MAPBKV3UG63A4BRABKIGA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147231294 (224h23m31.578311455s) [noise=true , address=104.36.82.44:4892 , piece_id=FOBEPAPVYOJUEIZGEJDJBLQP5RKJ2ZJNAOOWZ5NYAPL4MZBBRUDQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147561586 (224h23m31.578641717s) [noise=true , address=104.36.82.36:4651 , piece_id=OTEC4GO32RCZPQWP4LK3JROYRG33VLGSOZZ4P5NIXRPQHRL3QPOQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:38.621048699 (224h23m33.05212888s) [upload=233381]: Next returned nil segment
Aug 18 01:49:38.621070491 (224h23m33.052150652s) [upload=233381]: Waiting for error group managing segments...
Aug 18 01:49:39.039263997 (224h23m33.470344128s) [noise=true , address=45.91.116.14:4213 , piece_id=75LD5HR6M6HD5GIW4JWLXKCSNKIPX2EALMXIELAVI7QZRIQ3W7WQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.050452676 (224h23m33.481532807s) [noise=true , address=104.36.82.38:4695 , piece_id=Q2ZK6THXBRABGL5ZL5RCAZVCDJ3PSWWTMP26GMJKUBYTZFWTSNDQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.066702338 (224h23m33.497782469s) [noise=true , address=77.90.31.18:4825 , piece_id=N5FUZPZFO5WZSB7PJTJYHGXFEIZDIWPCITYDIQWOILYW5IKQYYQA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.091533990 (224h23m33.522614121s) [noise=true , address=77.90.31.15:4721 , piece_id=NK362IOTNC4ED22FGSMKSNLYHZD55Y5MAPBKV3UG63A4BRABKIGA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.094447966 (224h23m33.525528097s) [noise=true , address=104.36.82.36:4651 , piece_id=OTEC4GO32RCZPQWP4LK3JROYRG33VLGSOZZ4P5NIXRPQHRL3QPOQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124130209 (224h23m33.55521033s) [noise=true , address=104.36.82.34:4578 , piece_id=RWY7Z7KQQ4ZNCKFMJG4H4RHWMC6TNTLNW3DRIIBGWFBHWAYWRR2A, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124312378 (224h23m33.555392509s) [noise=true , address=104.36.82.9:4011 , piece_id=5QEXV5XZ4T6EF4ZBIVTSYIVKIGOMKOR6ALO33LPORAEOVHHFE6GA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124738052 (224h23m33.555818183s) [noise=true , address=104.36.82.12:4171 , piece_id=RW35JO2COE6QYHEMFVSY4WXEP7HDFOTMTQY4QNVUJUW4FIJUONLQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.170134133 (224h23m33.601214264s) [noise=true , address=104.36.82.60:4368 , piece_id=44V5R55SJKLLHQNLUT3XNCMOHUYOTMNUE2V2ZF3QFCA55CC7QN3Q, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.190436149 (224h23m33.62151628s) [noise=true , address=104.36.82.4:4822 , piece_id=7PUOVYBGPFYJQZUBCCHX7AAHKTYB7ZJBFWHJHUJYU22T5DNOARAQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.198050718 (224h23m33.629130849s) [noise=true , address=104.36.82.35:4611 , piece_id=GFIQTHHV67STQ6KFD25FSXSY3SFZJYYNDXTGY3UR4NA3HLBMB6YQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218397429 (224h23m33.64947756s) [noise=true , address=104.36.82.43:4839 , piece_id=ODQ3X4GQJ4F5K47QKW756U3HR7U2AWBVEWOEHFI7PMB73JCMTC6A, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218724114 (224h23m33.649804245s) [noise=true , address=104.36.82.19:4402 , piece_id=FVI6JRNZYLMULP6W5U5FMKCJSWSELEIG3VLR3QLRWYSO5SUI6RZQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218936471 (224h23m33.650016602s) [noise=true , address=104.36.82.44:4892 , piece_id=FOBEPAPVYOJUEIZGEJDJBLQP5RKJ2ZJNAOOWZ5NYAPL4MZBBRUDQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218949846 (224h23m33.650029977s) [seg_pos={0 0}, upload=233381]: Segment reached optimal threshold of 14 pieces.
Aug 18 01:49:39.219040078 (224h23m33.65012021s) [noise=true , address=77.90.31.12:4595 , piece_id=7CLANDDN6F2HLIVZNXXXPCX32TPZZ2XEXKILVXGBP7Y2UCFDTQHA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1he15nyRz78fmHLkMRs8Hxi2HntmzNsPTqKEbHNUthhSjGMmuj): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219101787 (224h23m33.650181918s) [noise=true , address=104.36.82.60:4357 , piece_id=SBPQNA5WQ6GI7N73NZLWKL5PXSI3PYF6J5HEPQBRIEVNPHKR5WVQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219231865 (224h23m33.650311996s) [noise=true , address=104.36.82.18:4400 , piece_id=5LZNZ4M2K6P3NJD57R7IL4UOGYFQOU7AE3XPAUVYCTJHRNBWMVJQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UxA6DMP2dr2T8o352iih2D6UeEeGQBMm1SgPbHYHuWaSFdyYv): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219270049 (224h23m33.65035018s) [noise=true , address=45.91.116.7:4029 , piece_id=7TVZLDWPESAINQ37KRCCVWC5YDK6DVC5KVRF7NXVNZ4GNQKVZIVQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rWqAGD7Vrj2yzEVyNbfPp278Gga42xPLyAcdzGvUSuz3EgJYh): protocol: write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection; write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection
Aug 18 01:49:39.219287963 (224h23m33.650368094s) [seg_pos={0 0}, upload=233381]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 01:49:39.219379378 (224h23m33.650459509s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 01:49:39.219384227 (224h23m33.650464358s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 01:49:39.546073200 (224h23m33.977153331s) [upload=233381]: Done uploading segments...
Aug 18 01:49:39.546095903 (224h23m33.977176034s) [upload=233381]: Upload finished. err: <nil>
Duration: 5.661430077s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..........................XX.....X..X...................X...] duration:
1.865458367s
FAIL (2025-08-18 01:55:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 01:54:12.086779168 (224h28m6.517859299s) [upload=233461]: Starting upload Aug 18 01:54:12.086835175 (224h28m6.517915306s) [upload=233461]: Done starting upload Aug 18 01:54:12.086893647 (224h28m6.517973778s) [upload=233461]: Uploading segments... Aug 18 01:54:12.086951908 (224h28m6.518032039s) [upload=233461]: Got next segment. Inline: true Aug 18 01:54:12.086955605 (224h28m6.518035736s) [upload=233461]: Waiting for error group managing segments... Aug 18 01:54:12.087001032 (224h28m6.518081163s) [upload=233461]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:54:12.087005721 (224h28m6.518085852s) [upload=233461]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 01:54:12.087008676 (224h28m6.518088807s) [upload=233461]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 01:54:12.308894070 (224h28m6.739974201s) [upload=233461]: Done uploading segments... Aug 18 01:54:12.308908477 (224h28m6.739988608s) [upload=233461]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.865476282s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X.......................................X........] duration:
5.932084912s
FAIL (2025-08-18 01:55:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 01:49:36.672171641 (224h23m31.103251772s) [upload=233381]: Starting upload
Aug 18 01:49:36.672234732 (224h23m31.103314863s) [upload=233381]: Done starting upload
Aug 18 01:49:36.672373758 (224h23m31.103453899s) [upload=233381]: Uploading segments...
Aug 18 01:49:36.672529816 (224h23m31.103609967s) [upload=233381]: Got next segment. Inline: false
Aug 18 01:49:36.672585603 (224h23m31.103665754s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 01:49:36.672592166 (224h23m31.103672297s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 01:49:37.143520003 (224h23m31.574600134s) [seg_pos={0 0}, upload=233381]: Begin upload segment...
Aug 18 01:49:37.143570901 (224h23m31.574651032s) [seg_pos={0 0}, upload=233381]: Done begin upload segment.
Aug 18 01:49:37.143593234 (224h23m31.574673355s) [noise=true , address=104.36.82.9:4011 , piece_id=5QEXV5XZ4T6EF4ZBIVTSYIVKIGOMKOR6ALO33LPORAEOVHHFE6GA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.143664580 (224h23m31.574744701s) [noise=true , address=77.90.31.18:4825 , piece_id=N5FUZPZFO5WZSB7PJTJYHGXFEIZDIWPCITYDIQWOILYW5IKQYYQA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144042823 (224h23m31.575122955s) [noise=true , address=104.36.82.19:4402 , piece_id=FVI6JRNZYLMULP6W5U5FMKCJSWSELEIG3VLR3QLRWYSO5SUI6RZQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144429493 (224h23m31.575509624s) [noise=true , address=104.36.82.18:4400 , piece_id=5LZNZ4M2K6P3NJD57R7IL4UOGYFQOU7AE3XPAUVYCTJHRNBWMVJQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144738945 (224h23m31.575819076s) [noise=true , address=104.36.82.12:4171 , piece_id=RW35JO2COE6QYHEMFVSY4WXEP7HDFOTMTQY4QNVUJUW4FIJUONLQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144861700 (224h23m31.575941821s) [noise=true , address=104.36.82.34:4578 , piece_id=RWY7Z7KQQ4ZNCKFMJG4H4RHWMC6TNTLNW3DRIIBGWFBHWAYWRR2A, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145048208 (224h23m31.576128339s) [noise=true , address=104.36.82.4:4822 , piece_id=7PUOVYBGPFYJQZUBCCHX7AAHKTYB7ZJBFWHJHUJYU22T5DNOARAQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145120676 (224h23m31.576200807s) [noise=true , address=104.36.82.60:4357 , piece_id=SBPQNA5WQ6GI7N73NZLWKL5PXSI3PYF6J5HEPQBRIEVNPHKR5WVQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145318845 (224h23m31.576398977s) [noise=true , address=104.36.82.60:4368 , piece_id=44V5R55SJKLLHQNLUT3XNCMOHUYOTMNUE2V2ZF3QFCA55CC7QN3Q, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145594723 (224h23m31.576674854s) [noise=true , address=45.91.116.7:4029 , piece_id=7TVZLDWPESAINQ37KRCCVWC5YDK6DVC5KVRF7NXVNZ4GNQKVZIVQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145897102 (224h23m31.576977233s) [noise=true , address=104.36.82.38:4695 , piece_id=Q2ZK6THXBRABGL5ZL5RCAZVCDJ3PSWWTMP26GMJKUBYTZFWTSNDQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146160455 (224h23m31.577240576s) [noise=true , address=104.36.82.35:4611 , piece_id=GFIQTHHV67STQ6KFD25FSXSY3SFZJYYNDXTGY3UR4NA3HLBMB6YQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146458486 (224h23m31.577538617s) [noise=true , address=104.36.82.43:4839 , piece_id=ODQ3X4GQJ4F5K47QKW756U3HR7U2AWBVEWOEHFI7PMB73JCMTC6A, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146582913 (224h23m31.577663044s) [noise=true , address=77.90.31.12:4595 , piece_id=7CLANDDN6F2HLIVZNXXXPCX32TPZZ2XEXKILVXGBP7Y2UCFDTQHA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146840807 (224h23m31.577920938s) [noise=true , address=45.91.116.14:4213 , piece_id=75LD5HR6M6HD5GIW4JWLXKCSNKIPX2EALMXIELAVI7QZRIQ3W7WQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147081808 (224h23m31.57816194s) [noise=true , address=77.90.31.15:4721 , piece_id=NK362IOTNC4ED22FGSMKSNLYHZD55Y5MAPBKV3UG63A4BRABKIGA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147231294 (224h23m31.578311455s) [noise=true , address=104.36.82.44:4892 , piece_id=FOBEPAPVYOJUEIZGEJDJBLQP5RKJ2ZJNAOOWZ5NYAPL4MZBBRUDQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147561586 (224h23m31.578641717s) [noise=true , address=104.36.82.36:4651 , piece_id=OTEC4GO32RCZPQWP4LK3JROYRG33VLGSOZZ4P5NIXRPQHRL3QPOQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:38.621048699 (224h23m33.05212888s) [upload=233381]: Next returned nil segment
Aug 18 01:49:38.621070491 (224h23m33.052150652s) [upload=233381]: Waiting for error group managing segments...
Aug 18 01:49:39.039263997 (224h23m33.470344128s) [noise=true , address=45.91.116.14:4213 , piece_id=75LD5HR6M6HD5GIW4JWLXKCSNKIPX2EALMXIELAVI7QZRIQ3W7WQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.050452676 (224h23m33.481532807s) [noise=true , address=104.36.82.38:4695 , piece_id=Q2ZK6THXBRABGL5ZL5RCAZVCDJ3PSWWTMP26GMJKUBYTZFWTSNDQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.066702338 (224h23m33.497782469s) [noise=true , address=77.90.31.18:4825 , piece_id=N5FUZPZFO5WZSB7PJTJYHGXFEIZDIWPCITYDIQWOILYW5IKQYYQA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.091533990 (224h23m33.522614121s) [noise=true , address=77.90.31.15:4721 , piece_id=NK362IOTNC4ED22FGSMKSNLYHZD55Y5MAPBKV3UG63A4BRABKIGA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.094447966 (224h23m33.525528097s) [noise=true , address=104.36.82.36:4651 , piece_id=OTEC4GO32RCZPQWP4LK3JROYRG33VLGSOZZ4P5NIXRPQHRL3QPOQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124130209 (224h23m33.55521033s) [noise=true , address=104.36.82.34:4578 , piece_id=RWY7Z7KQQ4ZNCKFMJG4H4RHWMC6TNTLNW3DRIIBGWFBHWAYWRR2A, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124312378 (224h23m33.555392509s) [noise=true , address=104.36.82.9:4011 , piece_id=5QEXV5XZ4T6EF4ZBIVTSYIVKIGOMKOR6ALO33LPORAEOVHHFE6GA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124738052 (224h23m33.555818183s) [noise=true , address=104.36.82.12:4171 , piece_id=RW35JO2COE6QYHEMFVSY4WXEP7HDFOTMTQY4QNVUJUW4FIJUONLQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.170134133 (224h23m33.601214264s) [noise=true , address=104.36.82.60:4368 , piece_id=44V5R55SJKLLHQNLUT3XNCMOHUYOTMNUE2V2ZF3QFCA55CC7QN3Q, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.190436149 (224h23m33.62151628s) [noise=true , address=104.36.82.4:4822 , piece_id=7PUOVYBGPFYJQZUBCCHX7AAHKTYB7ZJBFWHJHUJYU22T5DNOARAQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.198050718 (224h23m33.629130849s) [noise=true , address=104.36.82.35:4611 , piece_id=GFIQTHHV67STQ6KFD25FSXSY3SFZJYYNDXTGY3UR4NA3HLBMB6YQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218397429 (224h23m33.64947756s) [noise=true , address=104.36.82.43:4839 , piece_id=ODQ3X4GQJ4F5K47QKW756U3HR7U2AWBVEWOEHFI7PMB73JCMTC6A, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218724114 (224h23m33.649804245s) [noise=true , address=104.36.82.19:4402 , piece_id=FVI6JRNZYLMULP6W5U5FMKCJSWSELEIG3VLR3QLRWYSO5SUI6RZQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218936471 (224h23m33.650016602s) [noise=true , address=104.36.82.44:4892 , piece_id=FOBEPAPVYOJUEIZGEJDJBLQP5RKJ2ZJNAOOWZ5NYAPL4MZBBRUDQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218949846 (224h23m33.650029977s) [seg_pos={0 0}, upload=233381]: Segment reached optimal threshold of 14 pieces.
Aug 18 01:49:39.219040078 (224h23m33.65012021s) [noise=true , address=77.90.31.12:4595 , piece_id=7CLANDDN6F2HLIVZNXXXPCX32TPZZ2XEXKILVXGBP7Y2UCFDTQHA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1he15nyRz78fmHLkMRs8Hxi2HntmzNsPTqKEbHNUthhSjGMmuj): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219101787 (224h23m33.650181918s) [noise=true , address=104.36.82.60:4357 , piece_id=SBPQNA5WQ6GI7N73NZLWKL5PXSI3PYF6J5HEPQBRIEVNPHKR5WVQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219231865 (224h23m33.650311996s) [noise=true , address=104.36.82.18:4400 , piece_id=5LZNZ4M2K6P3NJD57R7IL4UOGYFQOU7AE3XPAUVYCTJHRNBWMVJQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UxA6DMP2dr2T8o352iih2D6UeEeGQBMm1SgPbHYHuWaSFdyYv): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219270049 (224h23m33.65035018s) [noise=true , address=45.91.116.7:4029 , piece_id=7TVZLDWPESAINQ37KRCCVWC5YDK6DVC5KVRF7NXVNZ4GNQKVZIVQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rWqAGD7Vrj2yzEVyNbfPp278Gga42xPLyAcdzGvUSuz3EgJYh): protocol: write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection; write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection
Aug 18 01:49:39.219287963 (224h23m33.650368094s) [seg_pos={0 0}, upload=233381]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 01:49:39.219379378 (224h23m33.650459509s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 01:49:39.219384227 (224h23m33.650464358s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 01:49:39.546073200 (224h23m33.977153331s) [upload=233381]: Done uploading segments...
Aug 18 01:49:39.546095903 (224h23m33.977176034s) [upload=233381]: Upload finished. err: <nil>
Duration: 5.93210982s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...........................XX.....X..X...................X..] duration:
1.970560406s
FAIL (2025-08-18 01:55:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 01:54:12.086779168 (224h28m6.517859299s) [upload=233461]: Starting upload Aug 18 01:54:12.086835175 (224h28m6.517915306s) [upload=233461]: Done starting upload Aug 18 01:54:12.086893647 (224h28m6.517973778s) [upload=233461]: Uploading segments... Aug 18 01:54:12.086951908 (224h28m6.518032039s) [upload=233461]: Got next segment. Inline: true Aug 18 01:54:12.086955605 (224h28m6.518035736s) [upload=233461]: Waiting for error group managing segments... Aug 18 01:54:12.087001032 (224h28m6.518081163s) [upload=233461]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:54:12.087005721 (224h28m6.518085852s) [upload=233461]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 01:54:12.087008676 (224h28m6.518088807s) [upload=233461]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 01:54:12.308894070 (224h28m6.739974201s) [upload=233461]: Done uploading segments... Aug 18 01:54:12.308908477 (224h28m6.739988608s) [upload=233461]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.97058804s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [............................XX.....X..X...................X.] duration:
1.918653398s
FAIL (2025-08-18 01:54:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 01:54:12.086779168 (224h28m6.517859299s) [upload=233461]: Starting upload Aug 18 01:54:12.086835175 (224h28m6.517915306s) [upload=233461]: Done starting upload Aug 18 01:54:12.086893647 (224h28m6.517973778s) [upload=233461]: Uploading segments... Aug 18 01:54:12.086951908 (224h28m6.518032039s) [upload=233461]: Got next segment. Inline: true Aug 18 01:54:12.086955605 (224h28m6.518035736s) [upload=233461]: Waiting for error group managing segments... Aug 18 01:54:12.087001032 (224h28m6.518081163s) [upload=233461]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:54:12.087005721 (224h28m6.518085852s) [upload=233461]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 01:54:12.087008676 (224h28m6.518088807s) [upload=233461]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 01:54:12.308894070 (224h28m6.739974201s) [upload=233461]: Done uploading segments... Aug 18 01:54:12.308908477 (224h28m6.739988608s) [upload=233461]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.91868038s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X.......................................X.......] duration:
5.790931291s
FAIL (2025-08-18 01:54:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 01:49:36.672171641 (224h23m31.103251772s) [upload=233381]: Starting upload
Aug 18 01:49:36.672234732 (224h23m31.103314863s) [upload=233381]: Done starting upload
Aug 18 01:49:36.672373758 (224h23m31.103453899s) [upload=233381]: Uploading segments...
Aug 18 01:49:36.672529816 (224h23m31.103609967s) [upload=233381]: Got next segment. Inline: false
Aug 18 01:49:36.672585603 (224h23m31.103665754s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 01:49:36.672592166 (224h23m31.103672297s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 01:49:37.143520003 (224h23m31.574600134s) [seg_pos={0 0}, upload=233381]: Begin upload segment...
Aug 18 01:49:37.143570901 (224h23m31.574651032s) [seg_pos={0 0}, upload=233381]: Done begin upload segment.
Aug 18 01:49:37.143593234 (224h23m31.574673355s) [noise=true , address=104.36.82.9:4011 , piece_id=5QEXV5XZ4T6EF4ZBIVTSYIVKIGOMKOR6ALO33LPORAEOVHHFE6GA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.143664580 (224h23m31.574744701s) [noise=true , address=77.90.31.18:4825 , piece_id=N5FUZPZFO5WZSB7PJTJYHGXFEIZDIWPCITYDIQWOILYW5IKQYYQA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144042823 (224h23m31.575122955s) [noise=true , address=104.36.82.19:4402 , piece_id=FVI6JRNZYLMULP6W5U5FMKCJSWSELEIG3VLR3QLRWYSO5SUI6RZQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144429493 (224h23m31.575509624s) [noise=true , address=104.36.82.18:4400 , piece_id=5LZNZ4M2K6P3NJD57R7IL4UOGYFQOU7AE3XPAUVYCTJHRNBWMVJQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144738945 (224h23m31.575819076s) [noise=true , address=104.36.82.12:4171 , piece_id=RW35JO2COE6QYHEMFVSY4WXEP7HDFOTMTQY4QNVUJUW4FIJUONLQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144861700 (224h23m31.575941821s) [noise=true , address=104.36.82.34:4578 , piece_id=RWY7Z7KQQ4ZNCKFMJG4H4RHWMC6TNTLNW3DRIIBGWFBHWAYWRR2A, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145048208 (224h23m31.576128339s) [noise=true , address=104.36.82.4:4822 , piece_id=7PUOVYBGPFYJQZUBCCHX7AAHKTYB7ZJBFWHJHUJYU22T5DNOARAQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145120676 (224h23m31.576200807s) [noise=true , address=104.36.82.60:4357 , piece_id=SBPQNA5WQ6GI7N73NZLWKL5PXSI3PYF6J5HEPQBRIEVNPHKR5WVQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145318845 (224h23m31.576398977s) [noise=true , address=104.36.82.60:4368 , piece_id=44V5R55SJKLLHQNLUT3XNCMOHUYOTMNUE2V2ZF3QFCA55CC7QN3Q, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145594723 (224h23m31.576674854s) [noise=true , address=45.91.116.7:4029 , piece_id=7TVZLDWPESAINQ37KRCCVWC5YDK6DVC5KVRF7NXVNZ4GNQKVZIVQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145897102 (224h23m31.576977233s) [noise=true , address=104.36.82.38:4695 , piece_id=Q2ZK6THXBRABGL5ZL5RCAZVCDJ3PSWWTMP26GMJKUBYTZFWTSNDQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146160455 (224h23m31.577240576s) [noise=true , address=104.36.82.35:4611 , piece_id=GFIQTHHV67STQ6KFD25FSXSY3SFZJYYNDXTGY3UR4NA3HLBMB6YQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146458486 (224h23m31.577538617s) [noise=true , address=104.36.82.43:4839 , piece_id=ODQ3X4GQJ4F5K47QKW756U3HR7U2AWBVEWOEHFI7PMB73JCMTC6A, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146582913 (224h23m31.577663044s) [noise=true , address=77.90.31.12:4595 , piece_id=7CLANDDN6F2HLIVZNXXXPCX32TPZZ2XEXKILVXGBP7Y2UCFDTQHA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146840807 (224h23m31.577920938s) [noise=true , address=45.91.116.14:4213 , piece_id=75LD5HR6M6HD5GIW4JWLXKCSNKIPX2EALMXIELAVI7QZRIQ3W7WQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147081808 (224h23m31.57816194s) [noise=true , address=77.90.31.15:4721 , piece_id=NK362IOTNC4ED22FGSMKSNLYHZD55Y5MAPBKV3UG63A4BRABKIGA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147231294 (224h23m31.578311455s) [noise=true , address=104.36.82.44:4892 , piece_id=FOBEPAPVYOJUEIZGEJDJBLQP5RKJ2ZJNAOOWZ5NYAPL4MZBBRUDQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147561586 (224h23m31.578641717s) [noise=true , address=104.36.82.36:4651 , piece_id=OTEC4GO32RCZPQWP4LK3JROYRG33VLGSOZZ4P5NIXRPQHRL3QPOQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:38.621048699 (224h23m33.05212888s) [upload=233381]: Next returned nil segment
Aug 18 01:49:38.621070491 (224h23m33.052150652s) [upload=233381]: Waiting for error group managing segments...
Aug 18 01:49:39.039263997 (224h23m33.470344128s) [noise=true , address=45.91.116.14:4213 , piece_id=75LD5HR6M6HD5GIW4JWLXKCSNKIPX2EALMXIELAVI7QZRIQ3W7WQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.050452676 (224h23m33.481532807s) [noise=true , address=104.36.82.38:4695 , piece_id=Q2ZK6THXBRABGL5ZL5RCAZVCDJ3PSWWTMP26GMJKUBYTZFWTSNDQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.066702338 (224h23m33.497782469s) [noise=true , address=77.90.31.18:4825 , piece_id=N5FUZPZFO5WZSB7PJTJYHGXFEIZDIWPCITYDIQWOILYW5IKQYYQA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.091533990 (224h23m33.522614121s) [noise=true , address=77.90.31.15:4721 , piece_id=NK362IOTNC4ED22FGSMKSNLYHZD55Y5MAPBKV3UG63A4BRABKIGA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.094447966 (224h23m33.525528097s) [noise=true , address=104.36.82.36:4651 , piece_id=OTEC4GO32RCZPQWP4LK3JROYRG33VLGSOZZ4P5NIXRPQHRL3QPOQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124130209 (224h23m33.55521033s) [noise=true , address=104.36.82.34:4578 , piece_id=RWY7Z7KQQ4ZNCKFMJG4H4RHWMC6TNTLNW3DRIIBGWFBHWAYWRR2A, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124312378 (224h23m33.555392509s) [noise=true , address=104.36.82.9:4011 , piece_id=5QEXV5XZ4T6EF4ZBIVTSYIVKIGOMKOR6ALO33LPORAEOVHHFE6GA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124738052 (224h23m33.555818183s) [noise=true , address=104.36.82.12:4171 , piece_id=RW35JO2COE6QYHEMFVSY4WXEP7HDFOTMTQY4QNVUJUW4FIJUONLQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.170134133 (224h23m33.601214264s) [noise=true , address=104.36.82.60:4368 , piece_id=44V5R55SJKLLHQNLUT3XNCMOHUYOTMNUE2V2ZF3QFCA55CC7QN3Q, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.190436149 (224h23m33.62151628s) [noise=true , address=104.36.82.4:4822 , piece_id=7PUOVYBGPFYJQZUBCCHX7AAHKTYB7ZJBFWHJHUJYU22T5DNOARAQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.198050718 (224h23m33.629130849s) [noise=true , address=104.36.82.35:4611 , piece_id=GFIQTHHV67STQ6KFD25FSXSY3SFZJYYNDXTGY3UR4NA3HLBMB6YQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218397429 (224h23m33.64947756s) [noise=true , address=104.36.82.43:4839 , piece_id=ODQ3X4GQJ4F5K47QKW756U3HR7U2AWBVEWOEHFI7PMB73JCMTC6A, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218724114 (224h23m33.649804245s) [noise=true , address=104.36.82.19:4402 , piece_id=FVI6JRNZYLMULP6W5U5FMKCJSWSELEIG3VLR3QLRWYSO5SUI6RZQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218936471 (224h23m33.650016602s) [noise=true , address=104.36.82.44:4892 , piece_id=FOBEPAPVYOJUEIZGEJDJBLQP5RKJ2ZJNAOOWZ5NYAPL4MZBBRUDQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218949846 (224h23m33.650029977s) [seg_pos={0 0}, upload=233381]: Segment reached optimal threshold of 14 pieces.
Aug 18 01:49:39.219040078 (224h23m33.65012021s) [noise=true , address=77.90.31.12:4595 , piece_id=7CLANDDN6F2HLIVZNXXXPCX32TPZZ2XEXKILVXGBP7Y2UCFDTQHA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1he15nyRz78fmHLkMRs8Hxi2HntmzNsPTqKEbHNUthhSjGMmuj): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219101787 (224h23m33.650181918s) [noise=true , address=104.36.82.60:4357 , piece_id=SBPQNA5WQ6GI7N73NZLWKL5PXSI3PYF6J5HEPQBRIEVNPHKR5WVQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219231865 (224h23m33.650311996s) [noise=true , address=104.36.82.18:4400 , piece_id=5LZNZ4M2K6P3NJD57R7IL4UOGYFQOU7AE3XPAUVYCTJHRNBWMVJQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UxA6DMP2dr2T8o352iih2D6UeEeGQBMm1SgPbHYHuWaSFdyYv): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219270049 (224h23m33.65035018s) [noise=true , address=45.91.116.7:4029 , piece_id=7TVZLDWPESAINQ37KRCCVWC5YDK6DVC5KVRF7NXVNZ4GNQKVZIVQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rWqAGD7Vrj2yzEVyNbfPp278Gga42xPLyAcdzGvUSuz3EgJYh): protocol: write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection; write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection
Aug 18 01:49:39.219287963 (224h23m33.650368094s) [seg_pos={0 0}, upload=233381]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 01:49:39.219379378 (224h23m33.650459509s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 01:49:39.219384227 (224h23m33.650464358s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 01:49:39.546073200 (224h23m33.977153331s) [upload=233381]: Done uploading segments...
Aug 18 01:49:39.546095903 (224h23m33.977176034s) [upload=233381]: Upload finished. err: <nil>
Duration: 5.790965608s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.............................XX.....X..X...................X] duration:
892.063694ms
FAIL (2025-08-18 01:54:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 01:54:12.086779168 (224h28m6.517859299s) [upload=233461]: Starting upload Aug 18 01:54:12.086835175 (224h28m6.517915306s) [upload=233461]: Done starting upload Aug 18 01:54:12.086893647 (224h28m6.517973778s) [upload=233461]: Uploading segments... Aug 18 01:54:12.086951908 (224h28m6.518032039s) [upload=233461]: Got next segment. Inline: true Aug 18 01:54:12.086955605 (224h28m6.518035736s) [upload=233461]: Waiting for error group managing segments... Aug 18 01:54:12.087001032 (224h28m6.518081163s) [upload=233461]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:54:12.087005721 (224h28m6.518085852s) [upload=233461]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 01:54:12.087008676 (224h28m6.518088807s) [upload=233461]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 01:54:12.308894070 (224h28m6.739974201s) [upload=233461]: Done uploading segments... Aug 18 01:54:12.308908477 (224h28m6.739988608s) [upload=233461]: Upload finished. err: metaclient: Too Many Requests
Duration: 892.097428ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............................XX.....X..X...................] duration:
1.953259996s
FAIL (2025-08-18 01:53:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 01:38:16.026930657 (224h12m10.458010788s) [upload=233187]: Starting upload Aug 18 01:38:16.026975272 (224h12m10.458055403s) [upload=233187]: Done starting upload Aug 18 01:38:16.027021701 (224h12m10.458101822s) [upload=233187]: Uploading segments... Aug 18 01:38:16.027057609 (224h12m10.45813773s) [upload=233187]: Got next segment. Inline: true Aug 18 01:38:16.027061897 (224h12m10.458142028s) [upload=233187]: Waiting for error group managing segments... Aug 18 01:38:16.027094901 (224h12m10.458175032s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:38:16.027098749 (224h12m10.45817887s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 01:38:16.027101223 (224h12m10.458181354s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 01:38:16.331231433 (224h12m10.762311564s) [upload=233187]: Done uploading segments... Aug 18 01:38:16.331248626 (224h12m10.762328747s) [upload=233187]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.953296635s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X.......................................X......] duration:
6.06555877s
FAIL (2025-08-18 01:53:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 01:49:36.672171641 (224h23m31.103251772s) [upload=233381]: Starting upload
Aug 18 01:49:36.672234732 (224h23m31.103314863s) [upload=233381]: Done starting upload
Aug 18 01:49:36.672373758 (224h23m31.103453899s) [upload=233381]: Uploading segments...
Aug 18 01:49:36.672529816 (224h23m31.103609967s) [upload=233381]: Got next segment. Inline: false
Aug 18 01:49:36.672585603 (224h23m31.103665754s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 01:49:36.672592166 (224h23m31.103672297s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 01:49:37.143520003 (224h23m31.574600134s) [seg_pos={0 0}, upload=233381]: Begin upload segment...
Aug 18 01:49:37.143570901 (224h23m31.574651032s) [seg_pos={0 0}, upload=233381]: Done begin upload segment.
Aug 18 01:49:37.143593234 (224h23m31.574673355s) [noise=true , address=104.36.82.9:4011 , piece_id=5QEXV5XZ4T6EF4ZBIVTSYIVKIGOMKOR6ALO33LPORAEOVHHFE6GA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.143664580 (224h23m31.574744701s) [noise=true , address=77.90.31.18:4825 , piece_id=N5FUZPZFO5WZSB7PJTJYHGXFEIZDIWPCITYDIQWOILYW5IKQYYQA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144042823 (224h23m31.575122955s) [noise=true , address=104.36.82.19:4402 , piece_id=FVI6JRNZYLMULP6W5U5FMKCJSWSELEIG3VLR3QLRWYSO5SUI6RZQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144429493 (224h23m31.575509624s) [noise=true , address=104.36.82.18:4400 , piece_id=5LZNZ4M2K6P3NJD57R7IL4UOGYFQOU7AE3XPAUVYCTJHRNBWMVJQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144738945 (224h23m31.575819076s) [noise=true , address=104.36.82.12:4171 , piece_id=RW35JO2COE6QYHEMFVSY4WXEP7HDFOTMTQY4QNVUJUW4FIJUONLQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144861700 (224h23m31.575941821s) [noise=true , address=104.36.82.34:4578 , piece_id=RWY7Z7KQQ4ZNCKFMJG4H4RHWMC6TNTLNW3DRIIBGWFBHWAYWRR2A, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145048208 (224h23m31.576128339s) [noise=true , address=104.36.82.4:4822 , piece_id=7PUOVYBGPFYJQZUBCCHX7AAHKTYB7ZJBFWHJHUJYU22T5DNOARAQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145120676 (224h23m31.576200807s) [noise=true , address=104.36.82.60:4357 , piece_id=SBPQNA5WQ6GI7N73NZLWKL5PXSI3PYF6J5HEPQBRIEVNPHKR5WVQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145318845 (224h23m31.576398977s) [noise=true , address=104.36.82.60:4368 , piece_id=44V5R55SJKLLHQNLUT3XNCMOHUYOTMNUE2V2ZF3QFCA55CC7QN3Q, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145594723 (224h23m31.576674854s) [noise=true , address=45.91.116.7:4029 , piece_id=7TVZLDWPESAINQ37KRCCVWC5YDK6DVC5KVRF7NXVNZ4GNQKVZIVQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145897102 (224h23m31.576977233s) [noise=true , address=104.36.82.38:4695 , piece_id=Q2ZK6THXBRABGL5ZL5RCAZVCDJ3PSWWTMP26GMJKUBYTZFWTSNDQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146160455 (224h23m31.577240576s) [noise=true , address=104.36.82.35:4611 , piece_id=GFIQTHHV67STQ6KFD25FSXSY3SFZJYYNDXTGY3UR4NA3HLBMB6YQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146458486 (224h23m31.577538617s) [noise=true , address=104.36.82.43:4839 , piece_id=ODQ3X4GQJ4F5K47QKW756U3HR7U2AWBVEWOEHFI7PMB73JCMTC6A, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146582913 (224h23m31.577663044s) [noise=true , address=77.90.31.12:4595 , piece_id=7CLANDDN6F2HLIVZNXXXPCX32TPZZ2XEXKILVXGBP7Y2UCFDTQHA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146840807 (224h23m31.577920938s) [noise=true , address=45.91.116.14:4213 , piece_id=75LD5HR6M6HD5GIW4JWLXKCSNKIPX2EALMXIELAVI7QZRIQ3W7WQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147081808 (224h23m31.57816194s) [noise=true , address=77.90.31.15:4721 , piece_id=NK362IOTNC4ED22FGSMKSNLYHZD55Y5MAPBKV3UG63A4BRABKIGA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147231294 (224h23m31.578311455s) [noise=true , address=104.36.82.44:4892 , piece_id=FOBEPAPVYOJUEIZGEJDJBLQP5RKJ2ZJNAOOWZ5NYAPL4MZBBRUDQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147561586 (224h23m31.578641717s) [noise=true , address=104.36.82.36:4651 , piece_id=OTEC4GO32RCZPQWP4LK3JROYRG33VLGSOZZ4P5NIXRPQHRL3QPOQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:38.621048699 (224h23m33.05212888s) [upload=233381]: Next returned nil segment
Aug 18 01:49:38.621070491 (224h23m33.052150652s) [upload=233381]: Waiting for error group managing segments...
Aug 18 01:49:39.039263997 (224h23m33.470344128s) [noise=true , address=45.91.116.14:4213 , piece_id=75LD5HR6M6HD5GIW4JWLXKCSNKIPX2EALMXIELAVI7QZRIQ3W7WQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.050452676 (224h23m33.481532807s) [noise=true , address=104.36.82.38:4695 , piece_id=Q2ZK6THXBRABGL5ZL5RCAZVCDJ3PSWWTMP26GMJKUBYTZFWTSNDQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.066702338 (224h23m33.497782469s) [noise=true , address=77.90.31.18:4825 , piece_id=N5FUZPZFO5WZSB7PJTJYHGXFEIZDIWPCITYDIQWOILYW5IKQYYQA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.091533990 (224h23m33.522614121s) [noise=true , address=77.90.31.15:4721 , piece_id=NK362IOTNC4ED22FGSMKSNLYHZD55Y5MAPBKV3UG63A4BRABKIGA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.094447966 (224h23m33.525528097s) [noise=true , address=104.36.82.36:4651 , piece_id=OTEC4GO32RCZPQWP4LK3JROYRG33VLGSOZZ4P5NIXRPQHRL3QPOQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124130209 (224h23m33.55521033s) [noise=true , address=104.36.82.34:4578 , piece_id=RWY7Z7KQQ4ZNCKFMJG4H4RHWMC6TNTLNW3DRIIBGWFBHWAYWRR2A, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124312378 (224h23m33.555392509s) [noise=true , address=104.36.82.9:4011 , piece_id=5QEXV5XZ4T6EF4ZBIVTSYIVKIGOMKOR6ALO33LPORAEOVHHFE6GA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124738052 (224h23m33.555818183s) [noise=true , address=104.36.82.12:4171 , piece_id=RW35JO2COE6QYHEMFVSY4WXEP7HDFOTMTQY4QNVUJUW4FIJUONLQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.170134133 (224h23m33.601214264s) [noise=true , address=104.36.82.60:4368 , piece_id=44V5R55SJKLLHQNLUT3XNCMOHUYOTMNUE2V2ZF3QFCA55CC7QN3Q, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.190436149 (224h23m33.62151628s) [noise=true , address=104.36.82.4:4822 , piece_id=7PUOVYBGPFYJQZUBCCHX7AAHKTYB7ZJBFWHJHUJYU22T5DNOARAQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.198050718 (224h23m33.629130849s) [noise=true , address=104.36.82.35:4611 , piece_id=GFIQTHHV67STQ6KFD25FSXSY3SFZJYYNDXTGY3UR4NA3HLBMB6YQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218397429 (224h23m33.64947756s) [noise=true , address=104.36.82.43:4839 , piece_id=ODQ3X4GQJ4F5K47QKW756U3HR7U2AWBVEWOEHFI7PMB73JCMTC6A, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218724114 (224h23m33.649804245s) [noise=true , address=104.36.82.19:4402 , piece_id=FVI6JRNZYLMULP6W5U5FMKCJSWSELEIG3VLR3QLRWYSO5SUI6RZQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218936471 (224h23m33.650016602s) [noise=true , address=104.36.82.44:4892 , piece_id=FOBEPAPVYOJUEIZGEJDJBLQP5RKJ2ZJNAOOWZ5NYAPL4MZBBRUDQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218949846 (224h23m33.650029977s) [seg_pos={0 0}, upload=233381]: Segment reached optimal threshold of 14 pieces.
Aug 18 01:49:39.219040078 (224h23m33.65012021s) [noise=true , address=77.90.31.12:4595 , piece_id=7CLANDDN6F2HLIVZNXXXPCX32TPZZ2XEXKILVXGBP7Y2UCFDTQHA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1he15nyRz78fmHLkMRs8Hxi2HntmzNsPTqKEbHNUthhSjGMmuj): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219101787 (224h23m33.650181918s) [noise=true , address=104.36.82.60:4357 , piece_id=SBPQNA5WQ6GI7N73NZLWKL5PXSI3PYF6J5HEPQBRIEVNPHKR5WVQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219231865 (224h23m33.650311996s) [noise=true , address=104.36.82.18:4400 , piece_id=5LZNZ4M2K6P3NJD57R7IL4UOGYFQOU7AE3XPAUVYCTJHRNBWMVJQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UxA6DMP2dr2T8o352iih2D6UeEeGQBMm1SgPbHYHuWaSFdyYv): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219270049 (224h23m33.65035018s) [noise=true , address=45.91.116.7:4029 , piece_id=7TVZLDWPESAINQ37KRCCVWC5YDK6DVC5KVRF7NXVNZ4GNQKVZIVQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rWqAGD7Vrj2yzEVyNbfPp278Gga42xPLyAcdzGvUSuz3EgJYh): protocol: write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection; write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection
Aug 18 01:49:39.219287963 (224h23m33.650368094s) [seg_pos={0 0}, upload=233381]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 01:49:39.219379378 (224h23m33.650459509s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 01:49:39.219384227 (224h23m33.650464358s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 01:49:39.546073200 (224h23m33.977153331s) [upload=233381]: Done uploading segments...
Aug 18 01:49:39.546095903 (224h23m33.977176034s) [upload=233381]: Upload finished. err: <nil>
Duration: 6.065586513s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...............................XX.....X..X..................] duration:
1.865228828s
FAIL (2025-08-18 01:52:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 01:38:16.026930657 (224h12m10.458010788s) [upload=233187]: Starting upload Aug 18 01:38:16.026975272 (224h12m10.458055403s) [upload=233187]: Done starting upload Aug 18 01:38:16.027021701 (224h12m10.458101822s) [upload=233187]: Uploading segments... Aug 18 01:38:16.027057609 (224h12m10.45813773s) [upload=233187]: Got next segment. Inline: true Aug 18 01:38:16.027061897 (224h12m10.458142028s) [upload=233187]: Waiting for error group managing segments... Aug 18 01:38:16.027094901 (224h12m10.458175032s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:38:16.027098749 (224h12m10.45817887s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 01:38:16.027101223 (224h12m10.458181354s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 01:38:16.331231433 (224h12m10.762311564s) [upload=233187]: Done uploading segments... Aug 18 01:38:16.331248626 (224h12m10.762328747s) [upload=233187]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.865253806s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X.......................................X.....] duration:
5.88891929s
FAIL (2025-08-18 01:52:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 01:49:36.672171641 (224h23m31.103251772s) [upload=233381]: Starting upload
Aug 18 01:49:36.672234732 (224h23m31.103314863s) [upload=233381]: Done starting upload
Aug 18 01:49:36.672373758 (224h23m31.103453899s) [upload=233381]: Uploading segments...
Aug 18 01:49:36.672529816 (224h23m31.103609967s) [upload=233381]: Got next segment. Inline: false
Aug 18 01:49:36.672585603 (224h23m31.103665754s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 01:49:36.672592166 (224h23m31.103672297s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 01:49:37.143520003 (224h23m31.574600134s) [seg_pos={0 0}, upload=233381]: Begin upload segment...
Aug 18 01:49:37.143570901 (224h23m31.574651032s) [seg_pos={0 0}, upload=233381]: Done begin upload segment.
Aug 18 01:49:37.143593234 (224h23m31.574673355s) [noise=true , address=104.36.82.9:4011 , piece_id=5QEXV5XZ4T6EF4ZBIVTSYIVKIGOMKOR6ALO33LPORAEOVHHFE6GA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.143664580 (224h23m31.574744701s) [noise=true , address=77.90.31.18:4825 , piece_id=N5FUZPZFO5WZSB7PJTJYHGXFEIZDIWPCITYDIQWOILYW5IKQYYQA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144042823 (224h23m31.575122955s) [noise=true , address=104.36.82.19:4402 , piece_id=FVI6JRNZYLMULP6W5U5FMKCJSWSELEIG3VLR3QLRWYSO5SUI6RZQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144429493 (224h23m31.575509624s) [noise=true , address=104.36.82.18:4400 , piece_id=5LZNZ4M2K6P3NJD57R7IL4UOGYFQOU7AE3XPAUVYCTJHRNBWMVJQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144738945 (224h23m31.575819076s) [noise=true , address=104.36.82.12:4171 , piece_id=RW35JO2COE6QYHEMFVSY4WXEP7HDFOTMTQY4QNVUJUW4FIJUONLQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144861700 (224h23m31.575941821s) [noise=true , address=104.36.82.34:4578 , piece_id=RWY7Z7KQQ4ZNCKFMJG4H4RHWMC6TNTLNW3DRIIBGWFBHWAYWRR2A, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145048208 (224h23m31.576128339s) [noise=true , address=104.36.82.4:4822 , piece_id=7PUOVYBGPFYJQZUBCCHX7AAHKTYB7ZJBFWHJHUJYU22T5DNOARAQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145120676 (224h23m31.576200807s) [noise=true , address=104.36.82.60:4357 , piece_id=SBPQNA5WQ6GI7N73NZLWKL5PXSI3PYF6J5HEPQBRIEVNPHKR5WVQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145318845 (224h23m31.576398977s) [noise=true , address=104.36.82.60:4368 , piece_id=44V5R55SJKLLHQNLUT3XNCMOHUYOTMNUE2V2ZF3QFCA55CC7QN3Q, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145594723 (224h23m31.576674854s) [noise=true , address=45.91.116.7:4029 , piece_id=7TVZLDWPESAINQ37KRCCVWC5YDK6DVC5KVRF7NXVNZ4GNQKVZIVQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145897102 (224h23m31.576977233s) [noise=true , address=104.36.82.38:4695 , piece_id=Q2ZK6THXBRABGL5ZL5RCAZVCDJ3PSWWTMP26GMJKUBYTZFWTSNDQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146160455 (224h23m31.577240576s) [noise=true , address=104.36.82.35:4611 , piece_id=GFIQTHHV67STQ6KFD25FSXSY3SFZJYYNDXTGY3UR4NA3HLBMB6YQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146458486 (224h23m31.577538617s) [noise=true , address=104.36.82.43:4839 , piece_id=ODQ3X4GQJ4F5K47QKW756U3HR7U2AWBVEWOEHFI7PMB73JCMTC6A, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146582913 (224h23m31.577663044s) [noise=true , address=77.90.31.12:4595 , piece_id=7CLANDDN6F2HLIVZNXXXPCX32TPZZ2XEXKILVXGBP7Y2UCFDTQHA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146840807 (224h23m31.577920938s) [noise=true , address=45.91.116.14:4213 , piece_id=75LD5HR6M6HD5GIW4JWLXKCSNKIPX2EALMXIELAVI7QZRIQ3W7WQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147081808 (224h23m31.57816194s) [noise=true , address=77.90.31.15:4721 , piece_id=NK362IOTNC4ED22FGSMKSNLYHZD55Y5MAPBKV3UG63A4BRABKIGA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147231294 (224h23m31.578311455s) [noise=true , address=104.36.82.44:4892 , piece_id=FOBEPAPVYOJUEIZGEJDJBLQP5RKJ2ZJNAOOWZ5NYAPL4MZBBRUDQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147561586 (224h23m31.578641717s) [noise=true , address=104.36.82.36:4651 , piece_id=OTEC4GO32RCZPQWP4LK3JROYRG33VLGSOZZ4P5NIXRPQHRL3QPOQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:38.621048699 (224h23m33.05212888s) [upload=233381]: Next returned nil segment
Aug 18 01:49:38.621070491 (224h23m33.052150652s) [upload=233381]: Waiting for error group managing segments...
Aug 18 01:49:39.039263997 (224h23m33.470344128s) [noise=true , address=45.91.116.14:4213 , piece_id=75LD5HR6M6HD5GIW4JWLXKCSNKIPX2EALMXIELAVI7QZRIQ3W7WQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.050452676 (224h23m33.481532807s) [noise=true , address=104.36.82.38:4695 , piece_id=Q2ZK6THXBRABGL5ZL5RCAZVCDJ3PSWWTMP26GMJKUBYTZFWTSNDQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.066702338 (224h23m33.497782469s) [noise=true , address=77.90.31.18:4825 , piece_id=N5FUZPZFO5WZSB7PJTJYHGXFEIZDIWPCITYDIQWOILYW5IKQYYQA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.091533990 (224h23m33.522614121s) [noise=true , address=77.90.31.15:4721 , piece_id=NK362IOTNC4ED22FGSMKSNLYHZD55Y5MAPBKV3UG63A4BRABKIGA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.094447966 (224h23m33.525528097s) [noise=true , address=104.36.82.36:4651 , piece_id=OTEC4GO32RCZPQWP4LK3JROYRG33VLGSOZZ4P5NIXRPQHRL3QPOQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124130209 (224h23m33.55521033s) [noise=true , address=104.36.82.34:4578 , piece_id=RWY7Z7KQQ4ZNCKFMJG4H4RHWMC6TNTLNW3DRIIBGWFBHWAYWRR2A, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124312378 (224h23m33.555392509s) [noise=true , address=104.36.82.9:4011 , piece_id=5QEXV5XZ4T6EF4ZBIVTSYIVKIGOMKOR6ALO33LPORAEOVHHFE6GA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124738052 (224h23m33.555818183s) [noise=true , address=104.36.82.12:4171 , piece_id=RW35JO2COE6QYHEMFVSY4WXEP7HDFOTMTQY4QNVUJUW4FIJUONLQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.170134133 (224h23m33.601214264s) [noise=true , address=104.36.82.60:4368 , piece_id=44V5R55SJKLLHQNLUT3XNCMOHUYOTMNUE2V2ZF3QFCA55CC7QN3Q, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.190436149 (224h23m33.62151628s) [noise=true , address=104.36.82.4:4822 , piece_id=7PUOVYBGPFYJQZUBCCHX7AAHKTYB7ZJBFWHJHUJYU22T5DNOARAQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.198050718 (224h23m33.629130849s) [noise=true , address=104.36.82.35:4611 , piece_id=GFIQTHHV67STQ6KFD25FSXSY3SFZJYYNDXTGY3UR4NA3HLBMB6YQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218397429 (224h23m33.64947756s) [noise=true , address=104.36.82.43:4839 , piece_id=ODQ3X4GQJ4F5K47QKW756U3HR7U2AWBVEWOEHFI7PMB73JCMTC6A, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218724114 (224h23m33.649804245s) [noise=true , address=104.36.82.19:4402 , piece_id=FVI6JRNZYLMULP6W5U5FMKCJSWSELEIG3VLR3QLRWYSO5SUI6RZQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218936471 (224h23m33.650016602s) [noise=true , address=104.36.82.44:4892 , piece_id=FOBEPAPVYOJUEIZGEJDJBLQP5RKJ2ZJNAOOWZ5NYAPL4MZBBRUDQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218949846 (224h23m33.650029977s) [seg_pos={0 0}, upload=233381]: Segment reached optimal threshold of 14 pieces.
Aug 18 01:49:39.219040078 (224h23m33.65012021s) [noise=true , address=77.90.31.12:4595 , piece_id=7CLANDDN6F2HLIVZNXXXPCX32TPZZ2XEXKILVXGBP7Y2UCFDTQHA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1he15nyRz78fmHLkMRs8Hxi2HntmzNsPTqKEbHNUthhSjGMmuj): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219101787 (224h23m33.650181918s) [noise=true , address=104.36.82.60:4357 , piece_id=SBPQNA5WQ6GI7N73NZLWKL5PXSI3PYF6J5HEPQBRIEVNPHKR5WVQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219231865 (224h23m33.650311996s) [noise=true , address=104.36.82.18:4400 , piece_id=5LZNZ4M2K6P3NJD57R7IL4UOGYFQOU7AE3XPAUVYCTJHRNBWMVJQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UxA6DMP2dr2T8o352iih2D6UeEeGQBMm1SgPbHYHuWaSFdyYv): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219270049 (224h23m33.65035018s) [noise=true , address=45.91.116.7:4029 , piece_id=7TVZLDWPESAINQ37KRCCVWC5YDK6DVC5KVRF7NXVNZ4GNQKVZIVQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rWqAGD7Vrj2yzEVyNbfPp278Gga42xPLyAcdzGvUSuz3EgJYh): protocol: write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection; write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection
Aug 18 01:49:39.219287963 (224h23m33.650368094s) [seg_pos={0 0}, upload=233381]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 01:49:39.219379378 (224h23m33.650459509s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 01:49:39.219384227 (224h23m33.650464358s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 01:49:39.546073200 (224h23m33.977153331s) [upload=233381]: Done uploading segments...
Aug 18 01:49:39.546095903 (224h23m33.977176034s) [upload=233381]: Upload finished. err: <nil>
Duration: 5.888945871s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X.......................................X....] duration:
5.820230582s
FAIL (2025-08-18 01:51:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 01:49:36.672171641 (224h23m31.103251772s) [upload=233381]: Starting upload
Aug 18 01:49:36.672234732 (224h23m31.103314863s) [upload=233381]: Done starting upload
Aug 18 01:49:36.672373758 (224h23m31.103453899s) [upload=233381]: Uploading segments...
Aug 18 01:49:36.672529816 (224h23m31.103609967s) [upload=233381]: Got next segment. Inline: false
Aug 18 01:49:36.672585603 (224h23m31.103665754s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 01:49:36.672592166 (224h23m31.103672297s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 01:49:37.143520003 (224h23m31.574600134s) [seg_pos={0 0}, upload=233381]: Begin upload segment...
Aug 18 01:49:37.143570901 (224h23m31.574651032s) [seg_pos={0 0}, upload=233381]: Done begin upload segment.
Aug 18 01:49:37.143593234 (224h23m31.574673355s) [noise=true , address=104.36.82.9:4011 , piece_id=5QEXV5XZ4T6EF4ZBIVTSYIVKIGOMKOR6ALO33LPORAEOVHHFE6GA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.143664580 (224h23m31.574744701s) [noise=true , address=77.90.31.18:4825 , piece_id=N5FUZPZFO5WZSB7PJTJYHGXFEIZDIWPCITYDIQWOILYW5IKQYYQA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144042823 (224h23m31.575122955s) [noise=true , address=104.36.82.19:4402 , piece_id=FVI6JRNZYLMULP6W5U5FMKCJSWSELEIG3VLR3QLRWYSO5SUI6RZQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144429493 (224h23m31.575509624s) [noise=true , address=104.36.82.18:4400 , piece_id=5LZNZ4M2K6P3NJD57R7IL4UOGYFQOU7AE3XPAUVYCTJHRNBWMVJQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144738945 (224h23m31.575819076s) [noise=true , address=104.36.82.12:4171 , piece_id=RW35JO2COE6QYHEMFVSY4WXEP7HDFOTMTQY4QNVUJUW4FIJUONLQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144861700 (224h23m31.575941821s) [noise=true , address=104.36.82.34:4578 , piece_id=RWY7Z7KQQ4ZNCKFMJG4H4RHWMC6TNTLNW3DRIIBGWFBHWAYWRR2A, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145048208 (224h23m31.576128339s) [noise=true , address=104.36.82.4:4822 , piece_id=7PUOVYBGPFYJQZUBCCHX7AAHKTYB7ZJBFWHJHUJYU22T5DNOARAQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145120676 (224h23m31.576200807s) [noise=true , address=104.36.82.60:4357 , piece_id=SBPQNA5WQ6GI7N73NZLWKL5PXSI3PYF6J5HEPQBRIEVNPHKR5WVQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145318845 (224h23m31.576398977s) [noise=true , address=104.36.82.60:4368 , piece_id=44V5R55SJKLLHQNLUT3XNCMOHUYOTMNUE2V2ZF3QFCA55CC7QN3Q, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145594723 (224h23m31.576674854s) [noise=true , address=45.91.116.7:4029 , piece_id=7TVZLDWPESAINQ37KRCCVWC5YDK6DVC5KVRF7NXVNZ4GNQKVZIVQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145897102 (224h23m31.576977233s) [noise=true , address=104.36.82.38:4695 , piece_id=Q2ZK6THXBRABGL5ZL5RCAZVCDJ3PSWWTMP26GMJKUBYTZFWTSNDQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146160455 (224h23m31.577240576s) [noise=true , address=104.36.82.35:4611 , piece_id=GFIQTHHV67STQ6KFD25FSXSY3SFZJYYNDXTGY3UR4NA3HLBMB6YQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146458486 (224h23m31.577538617s) [noise=true , address=104.36.82.43:4839 , piece_id=ODQ3X4GQJ4F5K47QKW756U3HR7U2AWBVEWOEHFI7PMB73JCMTC6A, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146582913 (224h23m31.577663044s) [noise=true , address=77.90.31.12:4595 , piece_id=7CLANDDN6F2HLIVZNXXXPCX32TPZZ2XEXKILVXGBP7Y2UCFDTQHA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146840807 (224h23m31.577920938s) [noise=true , address=45.91.116.14:4213 , piece_id=75LD5HR6M6HD5GIW4JWLXKCSNKIPX2EALMXIELAVI7QZRIQ3W7WQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147081808 (224h23m31.57816194s) [noise=true , address=77.90.31.15:4721 , piece_id=NK362IOTNC4ED22FGSMKSNLYHZD55Y5MAPBKV3UG63A4BRABKIGA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147231294 (224h23m31.578311455s) [noise=true , address=104.36.82.44:4892 , piece_id=FOBEPAPVYOJUEIZGEJDJBLQP5RKJ2ZJNAOOWZ5NYAPL4MZBBRUDQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147561586 (224h23m31.578641717s) [noise=true , address=104.36.82.36:4651 , piece_id=OTEC4GO32RCZPQWP4LK3JROYRG33VLGSOZZ4P5NIXRPQHRL3QPOQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:38.621048699 (224h23m33.05212888s) [upload=233381]: Next returned nil segment
Aug 18 01:49:38.621070491 (224h23m33.052150652s) [upload=233381]: Waiting for error group managing segments...
Aug 18 01:49:39.039263997 (224h23m33.470344128s) [noise=true , address=45.91.116.14:4213 , piece_id=75LD5HR6M6HD5GIW4JWLXKCSNKIPX2EALMXIELAVI7QZRIQ3W7WQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.050452676 (224h23m33.481532807s) [noise=true , address=104.36.82.38:4695 , piece_id=Q2ZK6THXBRABGL5ZL5RCAZVCDJ3PSWWTMP26GMJKUBYTZFWTSNDQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.066702338 (224h23m33.497782469s) [noise=true , address=77.90.31.18:4825 , piece_id=N5FUZPZFO5WZSB7PJTJYHGXFEIZDIWPCITYDIQWOILYW5IKQYYQA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.091533990 (224h23m33.522614121s) [noise=true , address=77.90.31.15:4721 , piece_id=NK362IOTNC4ED22FGSMKSNLYHZD55Y5MAPBKV3UG63A4BRABKIGA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.094447966 (224h23m33.525528097s) [noise=true , address=104.36.82.36:4651 , piece_id=OTEC4GO32RCZPQWP4LK3JROYRG33VLGSOZZ4P5NIXRPQHRL3QPOQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124130209 (224h23m33.55521033s) [noise=true , address=104.36.82.34:4578 , piece_id=RWY7Z7KQQ4ZNCKFMJG4H4RHWMC6TNTLNW3DRIIBGWFBHWAYWRR2A, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124312378 (224h23m33.555392509s) [noise=true , address=104.36.82.9:4011 , piece_id=5QEXV5XZ4T6EF4ZBIVTSYIVKIGOMKOR6ALO33LPORAEOVHHFE6GA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124738052 (224h23m33.555818183s) [noise=true , address=104.36.82.12:4171 , piece_id=RW35JO2COE6QYHEMFVSY4WXEP7HDFOTMTQY4QNVUJUW4FIJUONLQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.170134133 (224h23m33.601214264s) [noise=true , address=104.36.82.60:4368 , piece_id=44V5R55SJKLLHQNLUT3XNCMOHUYOTMNUE2V2ZF3QFCA55CC7QN3Q, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.190436149 (224h23m33.62151628s) [noise=true , address=104.36.82.4:4822 , piece_id=7PUOVYBGPFYJQZUBCCHX7AAHKTYB7ZJBFWHJHUJYU22T5DNOARAQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.198050718 (224h23m33.629130849s) [noise=true , address=104.36.82.35:4611 , piece_id=GFIQTHHV67STQ6KFD25FSXSY3SFZJYYNDXTGY3UR4NA3HLBMB6YQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218397429 (224h23m33.64947756s) [noise=true , address=104.36.82.43:4839 , piece_id=ODQ3X4GQJ4F5K47QKW756U3HR7U2AWBVEWOEHFI7PMB73JCMTC6A, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218724114 (224h23m33.649804245s) [noise=true , address=104.36.82.19:4402 , piece_id=FVI6JRNZYLMULP6W5U5FMKCJSWSELEIG3VLR3QLRWYSO5SUI6RZQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218936471 (224h23m33.650016602s) [noise=true , address=104.36.82.44:4892 , piece_id=FOBEPAPVYOJUEIZGEJDJBLQP5RKJ2ZJNAOOWZ5NYAPL4MZBBRUDQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218949846 (224h23m33.650029977s) [seg_pos={0 0}, upload=233381]: Segment reached optimal threshold of 14 pieces.
Aug 18 01:49:39.219040078 (224h23m33.65012021s) [noise=true , address=77.90.31.12:4595 , piece_id=7CLANDDN6F2HLIVZNXXXPCX32TPZZ2XEXKILVXGBP7Y2UCFDTQHA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1he15nyRz78fmHLkMRs8Hxi2HntmzNsPTqKEbHNUthhSjGMmuj): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219101787 (224h23m33.650181918s) [noise=true , address=104.36.82.60:4357 , piece_id=SBPQNA5WQ6GI7N73NZLWKL5PXSI3PYF6J5HEPQBRIEVNPHKR5WVQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219231865 (224h23m33.650311996s) [noise=true , address=104.36.82.18:4400 , piece_id=5LZNZ4M2K6P3NJD57R7IL4UOGYFQOU7AE3XPAUVYCTJHRNBWMVJQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UxA6DMP2dr2T8o352iih2D6UeEeGQBMm1SgPbHYHuWaSFdyYv): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219270049 (224h23m33.65035018s) [noise=true , address=45.91.116.7:4029 , piece_id=7TVZLDWPESAINQ37KRCCVWC5YDK6DVC5KVRF7NXVNZ4GNQKVZIVQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rWqAGD7Vrj2yzEVyNbfPp278Gga42xPLyAcdzGvUSuz3EgJYh): protocol: write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection; write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection
Aug 18 01:49:39.219287963 (224h23m33.650368094s) [seg_pos={0 0}, upload=233381]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 01:49:39.219379378 (224h23m33.650459509s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 01:49:39.219384227 (224h23m33.650464358s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 01:49:39.546073200 (224h23m33.977153331s) [upload=233381]: Done uploading segments...
Aug 18 01:49:39.546095903 (224h23m33.977176034s) [upload=233381]: Upload finished. err: <nil>
Duration: 5.820260219s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [................................XX.....X..X.................] duration:
1.975474263s
FAIL (2025-08-18 01:51:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 01:38:16.026930657 (224h12m10.458010788s) [upload=233187]: Starting upload Aug 18 01:38:16.026975272 (224h12m10.458055403s) [upload=233187]: Done starting upload Aug 18 01:38:16.027021701 (224h12m10.458101822s) [upload=233187]: Uploading segments... Aug 18 01:38:16.027057609 (224h12m10.45813773s) [upload=233187]: Got next segment. Inline: true Aug 18 01:38:16.027061897 (224h12m10.458142028s) [upload=233187]: Waiting for error group managing segments... Aug 18 01:38:16.027094901 (224h12m10.458175032s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:38:16.027098749 (224h12m10.45817887s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 01:38:16.027101223 (224h12m10.458181354s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 01:38:16.331231433 (224h12m10.762311564s) [upload=233187]: Done uploading segments... Aug 18 01:38:16.331248626 (224h12m10.762328747s) [upload=233187]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.975504571s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X.......................................X...] duration:
6.141912309s
FAIL (2025-08-18 01:51:22 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 01:49:36.672171641 (224h23m31.103251772s) [upload=233381]: Starting upload
Aug 18 01:49:36.672234732 (224h23m31.103314863s) [upload=233381]: Done starting upload
Aug 18 01:49:36.672373758 (224h23m31.103453899s) [upload=233381]: Uploading segments...
Aug 18 01:49:36.672529816 (224h23m31.103609967s) [upload=233381]: Got next segment. Inline: false
Aug 18 01:49:36.672585603 (224h23m31.103665754s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 01:49:36.672592166 (224h23m31.103672297s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 01:49:37.143520003 (224h23m31.574600134s) [seg_pos={0 0}, upload=233381]: Begin upload segment...
Aug 18 01:49:37.143570901 (224h23m31.574651032s) [seg_pos={0 0}, upload=233381]: Done begin upload segment.
Aug 18 01:49:37.143593234 (224h23m31.574673355s) [noise=true , address=104.36.82.9:4011 , piece_id=5QEXV5XZ4T6EF4ZBIVTSYIVKIGOMKOR6ALO33LPORAEOVHHFE6GA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.143664580 (224h23m31.574744701s) [noise=true , address=77.90.31.18:4825 , piece_id=N5FUZPZFO5WZSB7PJTJYHGXFEIZDIWPCITYDIQWOILYW5IKQYYQA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144042823 (224h23m31.575122955s) [noise=true , address=104.36.82.19:4402 , piece_id=FVI6JRNZYLMULP6W5U5FMKCJSWSELEIG3VLR3QLRWYSO5SUI6RZQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144429493 (224h23m31.575509624s) [noise=true , address=104.36.82.18:4400 , piece_id=5LZNZ4M2K6P3NJD57R7IL4UOGYFQOU7AE3XPAUVYCTJHRNBWMVJQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144738945 (224h23m31.575819076s) [noise=true , address=104.36.82.12:4171 , piece_id=RW35JO2COE6QYHEMFVSY4WXEP7HDFOTMTQY4QNVUJUW4FIJUONLQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144861700 (224h23m31.575941821s) [noise=true , address=104.36.82.34:4578 , piece_id=RWY7Z7KQQ4ZNCKFMJG4H4RHWMC6TNTLNW3DRIIBGWFBHWAYWRR2A, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145048208 (224h23m31.576128339s) [noise=true , address=104.36.82.4:4822 , piece_id=7PUOVYBGPFYJQZUBCCHX7AAHKTYB7ZJBFWHJHUJYU22T5DNOARAQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145120676 (224h23m31.576200807s) [noise=true , address=104.36.82.60:4357 , piece_id=SBPQNA5WQ6GI7N73NZLWKL5PXSI3PYF6J5HEPQBRIEVNPHKR5WVQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145318845 (224h23m31.576398977s) [noise=true , address=104.36.82.60:4368 , piece_id=44V5R55SJKLLHQNLUT3XNCMOHUYOTMNUE2V2ZF3QFCA55CC7QN3Q, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145594723 (224h23m31.576674854s) [noise=true , address=45.91.116.7:4029 , piece_id=7TVZLDWPESAINQ37KRCCVWC5YDK6DVC5KVRF7NXVNZ4GNQKVZIVQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145897102 (224h23m31.576977233s) [noise=true , address=104.36.82.38:4695 , piece_id=Q2ZK6THXBRABGL5ZL5RCAZVCDJ3PSWWTMP26GMJKUBYTZFWTSNDQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146160455 (224h23m31.577240576s) [noise=true , address=104.36.82.35:4611 , piece_id=GFIQTHHV67STQ6KFD25FSXSY3SFZJYYNDXTGY3UR4NA3HLBMB6YQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146458486 (224h23m31.577538617s) [noise=true , address=104.36.82.43:4839 , piece_id=ODQ3X4GQJ4F5K47QKW756U3HR7U2AWBVEWOEHFI7PMB73JCMTC6A, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146582913 (224h23m31.577663044s) [noise=true , address=77.90.31.12:4595 , piece_id=7CLANDDN6F2HLIVZNXXXPCX32TPZZ2XEXKILVXGBP7Y2UCFDTQHA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146840807 (224h23m31.577920938s) [noise=true , address=45.91.116.14:4213 , piece_id=75LD5HR6M6HD5GIW4JWLXKCSNKIPX2EALMXIELAVI7QZRIQ3W7WQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147081808 (224h23m31.57816194s) [noise=true , address=77.90.31.15:4721 , piece_id=NK362IOTNC4ED22FGSMKSNLYHZD55Y5MAPBKV3UG63A4BRABKIGA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147231294 (224h23m31.578311455s) [noise=true , address=104.36.82.44:4892 , piece_id=FOBEPAPVYOJUEIZGEJDJBLQP5RKJ2ZJNAOOWZ5NYAPL4MZBBRUDQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147561586 (224h23m31.578641717s) [noise=true , address=104.36.82.36:4651 , piece_id=OTEC4GO32RCZPQWP4LK3JROYRG33VLGSOZZ4P5NIXRPQHRL3QPOQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:38.621048699 (224h23m33.05212888s) [upload=233381]: Next returned nil segment
Aug 18 01:49:38.621070491 (224h23m33.052150652s) [upload=233381]: Waiting for error group managing segments...
Aug 18 01:49:39.039263997 (224h23m33.470344128s) [noise=true , address=45.91.116.14:4213 , piece_id=75LD5HR6M6HD5GIW4JWLXKCSNKIPX2EALMXIELAVI7QZRIQ3W7WQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.050452676 (224h23m33.481532807s) [noise=true , address=104.36.82.38:4695 , piece_id=Q2ZK6THXBRABGL5ZL5RCAZVCDJ3PSWWTMP26GMJKUBYTZFWTSNDQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.066702338 (224h23m33.497782469s) [noise=true , address=77.90.31.18:4825 , piece_id=N5FUZPZFO5WZSB7PJTJYHGXFEIZDIWPCITYDIQWOILYW5IKQYYQA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.091533990 (224h23m33.522614121s) [noise=true , address=77.90.31.15:4721 , piece_id=NK362IOTNC4ED22FGSMKSNLYHZD55Y5MAPBKV3UG63A4BRABKIGA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.094447966 (224h23m33.525528097s) [noise=true , address=104.36.82.36:4651 , piece_id=OTEC4GO32RCZPQWP4LK3JROYRG33VLGSOZZ4P5NIXRPQHRL3QPOQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124130209 (224h23m33.55521033s) [noise=true , address=104.36.82.34:4578 , piece_id=RWY7Z7KQQ4ZNCKFMJG4H4RHWMC6TNTLNW3DRIIBGWFBHWAYWRR2A, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124312378 (224h23m33.555392509s) [noise=true , address=104.36.82.9:4011 , piece_id=5QEXV5XZ4T6EF4ZBIVTSYIVKIGOMKOR6ALO33LPORAEOVHHFE6GA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124738052 (224h23m33.555818183s) [noise=true , address=104.36.82.12:4171 , piece_id=RW35JO2COE6QYHEMFVSY4WXEP7HDFOTMTQY4QNVUJUW4FIJUONLQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.170134133 (224h23m33.601214264s) [noise=true , address=104.36.82.60:4368 , piece_id=44V5R55SJKLLHQNLUT3XNCMOHUYOTMNUE2V2ZF3QFCA55CC7QN3Q, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.190436149 (224h23m33.62151628s) [noise=true , address=104.36.82.4:4822 , piece_id=7PUOVYBGPFYJQZUBCCHX7AAHKTYB7ZJBFWHJHUJYU22T5DNOARAQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.198050718 (224h23m33.629130849s) [noise=true , address=104.36.82.35:4611 , piece_id=GFIQTHHV67STQ6KFD25FSXSY3SFZJYYNDXTGY3UR4NA3HLBMB6YQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218397429 (224h23m33.64947756s) [noise=true , address=104.36.82.43:4839 , piece_id=ODQ3X4GQJ4F5K47QKW756U3HR7U2AWBVEWOEHFI7PMB73JCMTC6A, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218724114 (224h23m33.649804245s) [noise=true , address=104.36.82.19:4402 , piece_id=FVI6JRNZYLMULP6W5U5FMKCJSWSELEIG3VLR3QLRWYSO5SUI6RZQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218936471 (224h23m33.650016602s) [noise=true , address=104.36.82.44:4892 , piece_id=FOBEPAPVYOJUEIZGEJDJBLQP5RKJ2ZJNAOOWZ5NYAPL4MZBBRUDQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218949846 (224h23m33.650029977s) [seg_pos={0 0}, upload=233381]: Segment reached optimal threshold of 14 pieces.
Aug 18 01:49:39.219040078 (224h23m33.65012021s) [noise=true , address=77.90.31.12:4595 , piece_id=7CLANDDN6F2HLIVZNXXXPCX32TPZZ2XEXKILVXGBP7Y2UCFDTQHA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1he15nyRz78fmHLkMRs8Hxi2HntmzNsPTqKEbHNUthhSjGMmuj): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219101787 (224h23m33.650181918s) [noise=true , address=104.36.82.60:4357 , piece_id=SBPQNA5WQ6GI7N73NZLWKL5PXSI3PYF6J5HEPQBRIEVNPHKR5WVQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219231865 (224h23m33.650311996s) [noise=true , address=104.36.82.18:4400 , piece_id=5LZNZ4M2K6P3NJD57R7IL4UOGYFQOU7AE3XPAUVYCTJHRNBWMVJQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UxA6DMP2dr2T8o352iih2D6UeEeGQBMm1SgPbHYHuWaSFdyYv): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219270049 (224h23m33.65035018s) [noise=true , address=45.91.116.7:4029 , piece_id=7TVZLDWPESAINQ37KRCCVWC5YDK6DVC5KVRF7NXVNZ4GNQKVZIVQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rWqAGD7Vrj2yzEVyNbfPp278Gga42xPLyAcdzGvUSuz3EgJYh): protocol: write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection; write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection
Aug 18 01:49:39.219287963 (224h23m33.650368094s) [seg_pos={0 0}, upload=233381]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 01:49:39.219379378 (224h23m33.650459509s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 01:49:39.219384227 (224h23m33.650464358s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 01:49:39.546073200 (224h23m33.977153331s) [upload=233381]: Done uploading segments...
Aug 18 01:49:39.546095903 (224h23m33.977176034s) [upload=233381]: Upload finished. err: <nil>
Duration: 6.141937236s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X................X.......................................X..] duration:
5.691345809s
FAIL (2025-08-18 01:50:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 01:49:36.672171641 (224h23m31.103251772s) [upload=233381]: Starting upload
Aug 18 01:49:36.672234732 (224h23m31.103314863s) [upload=233381]: Done starting upload
Aug 18 01:49:36.672373758 (224h23m31.103453899s) [upload=233381]: Uploading segments...
Aug 18 01:49:36.672529816 (224h23m31.103609967s) [upload=233381]: Got next segment. Inline: false
Aug 18 01:49:36.672585603 (224h23m31.103665754s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 01:49:36.672592166 (224h23m31.103672297s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 01:49:37.143520003 (224h23m31.574600134s) [seg_pos={0 0}, upload=233381]: Begin upload segment...
Aug 18 01:49:37.143570901 (224h23m31.574651032s) [seg_pos={0 0}, upload=233381]: Done begin upload segment.
Aug 18 01:49:37.143593234 (224h23m31.574673355s) [noise=true , address=104.36.82.9:4011 , piece_id=5QEXV5XZ4T6EF4ZBIVTSYIVKIGOMKOR6ALO33LPORAEOVHHFE6GA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.143664580 (224h23m31.574744701s) [noise=true , address=77.90.31.18:4825 , piece_id=N5FUZPZFO5WZSB7PJTJYHGXFEIZDIWPCITYDIQWOILYW5IKQYYQA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144042823 (224h23m31.575122955s) [noise=true , address=104.36.82.19:4402 , piece_id=FVI6JRNZYLMULP6W5U5FMKCJSWSELEIG3VLR3QLRWYSO5SUI6RZQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144429493 (224h23m31.575509624s) [noise=true , address=104.36.82.18:4400 , piece_id=5LZNZ4M2K6P3NJD57R7IL4UOGYFQOU7AE3XPAUVYCTJHRNBWMVJQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144738945 (224h23m31.575819076s) [noise=true , address=104.36.82.12:4171 , piece_id=RW35JO2COE6QYHEMFVSY4WXEP7HDFOTMTQY4QNVUJUW4FIJUONLQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144861700 (224h23m31.575941821s) [noise=true , address=104.36.82.34:4578 , piece_id=RWY7Z7KQQ4ZNCKFMJG4H4RHWMC6TNTLNW3DRIIBGWFBHWAYWRR2A, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145048208 (224h23m31.576128339s) [noise=true , address=104.36.82.4:4822 , piece_id=7PUOVYBGPFYJQZUBCCHX7AAHKTYB7ZJBFWHJHUJYU22T5DNOARAQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145120676 (224h23m31.576200807s) [noise=true , address=104.36.82.60:4357 , piece_id=SBPQNA5WQ6GI7N73NZLWKL5PXSI3PYF6J5HEPQBRIEVNPHKR5WVQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145318845 (224h23m31.576398977s) [noise=true , address=104.36.82.60:4368 , piece_id=44V5R55SJKLLHQNLUT3XNCMOHUYOTMNUE2V2ZF3QFCA55CC7QN3Q, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145594723 (224h23m31.576674854s) [noise=true , address=45.91.116.7:4029 , piece_id=7TVZLDWPESAINQ37KRCCVWC5YDK6DVC5KVRF7NXVNZ4GNQKVZIVQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145897102 (224h23m31.576977233s) [noise=true , address=104.36.82.38:4695 , piece_id=Q2ZK6THXBRABGL5ZL5RCAZVCDJ3PSWWTMP26GMJKUBYTZFWTSNDQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146160455 (224h23m31.577240576s) [noise=true , address=104.36.82.35:4611 , piece_id=GFIQTHHV67STQ6KFD25FSXSY3SFZJYYNDXTGY3UR4NA3HLBMB6YQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146458486 (224h23m31.577538617s) [noise=true , address=104.36.82.43:4839 , piece_id=ODQ3X4GQJ4F5K47QKW756U3HR7U2AWBVEWOEHFI7PMB73JCMTC6A, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146582913 (224h23m31.577663044s) [noise=true , address=77.90.31.12:4595 , piece_id=7CLANDDN6F2HLIVZNXXXPCX32TPZZ2XEXKILVXGBP7Y2UCFDTQHA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146840807 (224h23m31.577920938s) [noise=true , address=45.91.116.14:4213 , piece_id=75LD5HR6M6HD5GIW4JWLXKCSNKIPX2EALMXIELAVI7QZRIQ3W7WQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147081808 (224h23m31.57816194s) [noise=true , address=77.90.31.15:4721 , piece_id=NK362IOTNC4ED22FGSMKSNLYHZD55Y5MAPBKV3UG63A4BRABKIGA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147231294 (224h23m31.578311455s) [noise=true , address=104.36.82.44:4892 , piece_id=FOBEPAPVYOJUEIZGEJDJBLQP5RKJ2ZJNAOOWZ5NYAPL4MZBBRUDQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147561586 (224h23m31.578641717s) [noise=true , address=104.36.82.36:4651 , piece_id=OTEC4GO32RCZPQWP4LK3JROYRG33VLGSOZZ4P5NIXRPQHRL3QPOQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:38.621048699 (224h23m33.05212888s) [upload=233381]: Next returned nil segment
Aug 18 01:49:38.621070491 (224h23m33.052150652s) [upload=233381]: Waiting for error group managing segments...
Aug 18 01:49:39.039263997 (224h23m33.470344128s) [noise=true , address=45.91.116.14:4213 , piece_id=75LD5HR6M6HD5GIW4JWLXKCSNKIPX2EALMXIELAVI7QZRIQ3W7WQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.050452676 (224h23m33.481532807s) [noise=true , address=104.36.82.38:4695 , piece_id=Q2ZK6THXBRABGL5ZL5RCAZVCDJ3PSWWTMP26GMJKUBYTZFWTSNDQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.066702338 (224h23m33.497782469s) [noise=true , address=77.90.31.18:4825 , piece_id=N5FUZPZFO5WZSB7PJTJYHGXFEIZDIWPCITYDIQWOILYW5IKQYYQA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.091533990 (224h23m33.522614121s) [noise=true , address=77.90.31.15:4721 , piece_id=NK362IOTNC4ED22FGSMKSNLYHZD55Y5MAPBKV3UG63A4BRABKIGA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.094447966 (224h23m33.525528097s) [noise=true , address=104.36.82.36:4651 , piece_id=OTEC4GO32RCZPQWP4LK3JROYRG33VLGSOZZ4P5NIXRPQHRL3QPOQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124130209 (224h23m33.55521033s) [noise=true , address=104.36.82.34:4578 , piece_id=RWY7Z7KQQ4ZNCKFMJG4H4RHWMC6TNTLNW3DRIIBGWFBHWAYWRR2A, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124312378 (224h23m33.555392509s) [noise=true , address=104.36.82.9:4011 , piece_id=5QEXV5XZ4T6EF4ZBIVTSYIVKIGOMKOR6ALO33LPORAEOVHHFE6GA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124738052 (224h23m33.555818183s) [noise=true , address=104.36.82.12:4171 , piece_id=RW35JO2COE6QYHEMFVSY4WXEP7HDFOTMTQY4QNVUJUW4FIJUONLQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.170134133 (224h23m33.601214264s) [noise=true , address=104.36.82.60:4368 , piece_id=44V5R55SJKLLHQNLUT3XNCMOHUYOTMNUE2V2ZF3QFCA55CC7QN3Q, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.190436149 (224h23m33.62151628s) [noise=true , address=104.36.82.4:4822 , piece_id=7PUOVYBGPFYJQZUBCCHX7AAHKTYB7ZJBFWHJHUJYU22T5DNOARAQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.198050718 (224h23m33.629130849s) [noise=true , address=104.36.82.35:4611 , piece_id=GFIQTHHV67STQ6KFD25FSXSY3SFZJYYNDXTGY3UR4NA3HLBMB6YQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218397429 (224h23m33.64947756s) [noise=true , address=104.36.82.43:4839 , piece_id=ODQ3X4GQJ4F5K47QKW756U3HR7U2AWBVEWOEHFI7PMB73JCMTC6A, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218724114 (224h23m33.649804245s) [noise=true , address=104.36.82.19:4402 , piece_id=FVI6JRNZYLMULP6W5U5FMKCJSWSELEIG3VLR3QLRWYSO5SUI6RZQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218936471 (224h23m33.650016602s) [noise=true , address=104.36.82.44:4892 , piece_id=FOBEPAPVYOJUEIZGEJDJBLQP5RKJ2ZJNAOOWZ5NYAPL4MZBBRUDQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218949846 (224h23m33.650029977s) [seg_pos={0 0}, upload=233381]: Segment reached optimal threshold of 14 pieces.
Aug 18 01:49:39.219040078 (224h23m33.65012021s) [noise=true , address=77.90.31.12:4595 , piece_id=7CLANDDN6F2HLIVZNXXXPCX32TPZZ2XEXKILVXGBP7Y2UCFDTQHA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1he15nyRz78fmHLkMRs8Hxi2HntmzNsPTqKEbHNUthhSjGMmuj): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219101787 (224h23m33.650181918s) [noise=true , address=104.36.82.60:4357 , piece_id=SBPQNA5WQ6GI7N73NZLWKL5PXSI3PYF6J5HEPQBRIEVNPHKR5WVQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219231865 (224h23m33.650311996s) [noise=true , address=104.36.82.18:4400 , piece_id=5LZNZ4M2K6P3NJD57R7IL4UOGYFQOU7AE3XPAUVYCTJHRNBWMVJQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UxA6DMP2dr2T8o352iih2D6UeEeGQBMm1SgPbHYHuWaSFdyYv): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219270049 (224h23m33.65035018s) [noise=true , address=45.91.116.7:4029 , piece_id=7TVZLDWPESAINQ37KRCCVWC5YDK6DVC5KVRF7NXVNZ4GNQKVZIVQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rWqAGD7Vrj2yzEVyNbfPp278Gga42xPLyAcdzGvUSuz3EgJYh): protocol: write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection; write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection
Aug 18 01:49:39.219287963 (224h23m33.650368094s) [seg_pos={0 0}, upload=233381]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 01:49:39.219379378 (224h23m33.650459509s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 01:49:39.219384227 (224h23m33.650464358s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 01:49:39.546073200 (224h23m33.977153331s) [upload=233381]: Done uploading segments...
Aug 18 01:49:39.546095903 (224h23m33.977176034s) [upload=233381]: Upload finished. err: <nil>
Duration: 5.691373662s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.................................XX.....X..X................] duration:
1.890562471s
FAIL (2025-08-18 01:50:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 01:38:16.026930657 (224h12m10.458010788s) [upload=233187]: Starting upload Aug 18 01:38:16.026975272 (224h12m10.458055403s) [upload=233187]: Done starting upload Aug 18 01:38:16.027021701 (224h12m10.458101822s) [upload=233187]: Uploading segments... Aug 18 01:38:16.027057609 (224h12m10.45813773s) [upload=233187]: Got next segment. Inline: true Aug 18 01:38:16.027061897 (224h12m10.458142028s) [upload=233187]: Waiting for error group managing segments... Aug 18 01:38:16.027094901 (224h12m10.458175032s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:38:16.027098749 (224h12m10.45817887s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 01:38:16.027101223 (224h12m10.458181354s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 01:38:16.331231433 (224h12m10.762311564s) [upload=233187]: Done uploading segments... Aug 18 01:38:16.331248626 (224h12m10.762328747s) [upload=233187]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.890596217s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X................X.......................................X.] duration:
5.667009423s
FAIL (2025-08-18 01:50:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 01:49:36.672171641 (224h23m31.103251772s) [upload=233381]: Starting upload
Aug 18 01:49:36.672234732 (224h23m31.103314863s) [upload=233381]: Done starting upload
Aug 18 01:49:36.672373758 (224h23m31.103453899s) [upload=233381]: Uploading segments...
Aug 18 01:49:36.672529816 (224h23m31.103609967s) [upload=233381]: Got next segment. Inline: false
Aug 18 01:49:36.672585603 (224h23m31.103665754s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 01:49:36.672592166 (224h23m31.103672297s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 01:49:37.143520003 (224h23m31.574600134s) [seg_pos={0 0}, upload=233381]: Begin upload segment...
Aug 18 01:49:37.143570901 (224h23m31.574651032s) [seg_pos={0 0}, upload=233381]: Done begin upload segment.
Aug 18 01:49:37.143593234 (224h23m31.574673355s) [noise=true , address=104.36.82.9:4011 , piece_id=5QEXV5XZ4T6EF4ZBIVTSYIVKIGOMKOR6ALO33LPORAEOVHHFE6GA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.143664580 (224h23m31.574744701s) [noise=true , address=77.90.31.18:4825 , piece_id=N5FUZPZFO5WZSB7PJTJYHGXFEIZDIWPCITYDIQWOILYW5IKQYYQA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144042823 (224h23m31.575122955s) [noise=true , address=104.36.82.19:4402 , piece_id=FVI6JRNZYLMULP6W5U5FMKCJSWSELEIG3VLR3QLRWYSO5SUI6RZQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144429493 (224h23m31.575509624s) [noise=true , address=104.36.82.18:4400 , piece_id=5LZNZ4M2K6P3NJD57R7IL4UOGYFQOU7AE3XPAUVYCTJHRNBWMVJQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144738945 (224h23m31.575819076s) [noise=true , address=104.36.82.12:4171 , piece_id=RW35JO2COE6QYHEMFVSY4WXEP7HDFOTMTQY4QNVUJUW4FIJUONLQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144861700 (224h23m31.575941821s) [noise=true , address=104.36.82.34:4578 , piece_id=RWY7Z7KQQ4ZNCKFMJG4H4RHWMC6TNTLNW3DRIIBGWFBHWAYWRR2A, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145048208 (224h23m31.576128339s) [noise=true , address=104.36.82.4:4822 , piece_id=7PUOVYBGPFYJQZUBCCHX7AAHKTYB7ZJBFWHJHUJYU22T5DNOARAQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145120676 (224h23m31.576200807s) [noise=true , address=104.36.82.60:4357 , piece_id=SBPQNA5WQ6GI7N73NZLWKL5PXSI3PYF6J5HEPQBRIEVNPHKR5WVQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145318845 (224h23m31.576398977s) [noise=true , address=104.36.82.60:4368 , piece_id=44V5R55SJKLLHQNLUT3XNCMOHUYOTMNUE2V2ZF3QFCA55CC7QN3Q, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145594723 (224h23m31.576674854s) [noise=true , address=45.91.116.7:4029 , piece_id=7TVZLDWPESAINQ37KRCCVWC5YDK6DVC5KVRF7NXVNZ4GNQKVZIVQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145897102 (224h23m31.576977233s) [noise=true , address=104.36.82.38:4695 , piece_id=Q2ZK6THXBRABGL5ZL5RCAZVCDJ3PSWWTMP26GMJKUBYTZFWTSNDQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146160455 (224h23m31.577240576s) [noise=true , address=104.36.82.35:4611 , piece_id=GFIQTHHV67STQ6KFD25FSXSY3SFZJYYNDXTGY3UR4NA3HLBMB6YQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146458486 (224h23m31.577538617s) [noise=true , address=104.36.82.43:4839 , piece_id=ODQ3X4GQJ4F5K47QKW756U3HR7U2AWBVEWOEHFI7PMB73JCMTC6A, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146582913 (224h23m31.577663044s) [noise=true , address=77.90.31.12:4595 , piece_id=7CLANDDN6F2HLIVZNXXXPCX32TPZZ2XEXKILVXGBP7Y2UCFDTQHA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146840807 (224h23m31.577920938s) [noise=true , address=45.91.116.14:4213 , piece_id=75LD5HR6M6HD5GIW4JWLXKCSNKIPX2EALMXIELAVI7QZRIQ3W7WQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147081808 (224h23m31.57816194s) [noise=true , address=77.90.31.15:4721 , piece_id=NK362IOTNC4ED22FGSMKSNLYHZD55Y5MAPBKV3UG63A4BRABKIGA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147231294 (224h23m31.578311455s) [noise=true , address=104.36.82.44:4892 , piece_id=FOBEPAPVYOJUEIZGEJDJBLQP5RKJ2ZJNAOOWZ5NYAPL4MZBBRUDQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147561586 (224h23m31.578641717s) [noise=true , address=104.36.82.36:4651 , piece_id=OTEC4GO32RCZPQWP4LK3JROYRG33VLGSOZZ4P5NIXRPQHRL3QPOQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:38.621048699 (224h23m33.05212888s) [upload=233381]: Next returned nil segment
Aug 18 01:49:38.621070491 (224h23m33.052150652s) [upload=233381]: Waiting for error group managing segments...
Aug 18 01:49:39.039263997 (224h23m33.470344128s) [noise=true , address=45.91.116.14:4213 , piece_id=75LD5HR6M6HD5GIW4JWLXKCSNKIPX2EALMXIELAVI7QZRIQ3W7WQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.050452676 (224h23m33.481532807s) [noise=true , address=104.36.82.38:4695 , piece_id=Q2ZK6THXBRABGL5ZL5RCAZVCDJ3PSWWTMP26GMJKUBYTZFWTSNDQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.066702338 (224h23m33.497782469s) [noise=true , address=77.90.31.18:4825 , piece_id=N5FUZPZFO5WZSB7PJTJYHGXFEIZDIWPCITYDIQWOILYW5IKQYYQA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.091533990 (224h23m33.522614121s) [noise=true , address=77.90.31.15:4721 , piece_id=NK362IOTNC4ED22FGSMKSNLYHZD55Y5MAPBKV3UG63A4BRABKIGA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.094447966 (224h23m33.525528097s) [noise=true , address=104.36.82.36:4651 , piece_id=OTEC4GO32RCZPQWP4LK3JROYRG33VLGSOZZ4P5NIXRPQHRL3QPOQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124130209 (224h23m33.55521033s) [noise=true , address=104.36.82.34:4578 , piece_id=RWY7Z7KQQ4ZNCKFMJG4H4RHWMC6TNTLNW3DRIIBGWFBHWAYWRR2A, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124312378 (224h23m33.555392509s) [noise=true , address=104.36.82.9:4011 , piece_id=5QEXV5XZ4T6EF4ZBIVTSYIVKIGOMKOR6ALO33LPORAEOVHHFE6GA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124738052 (224h23m33.555818183s) [noise=true , address=104.36.82.12:4171 , piece_id=RW35JO2COE6QYHEMFVSY4WXEP7HDFOTMTQY4QNVUJUW4FIJUONLQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.170134133 (224h23m33.601214264s) [noise=true , address=104.36.82.60:4368 , piece_id=44V5R55SJKLLHQNLUT3XNCMOHUYOTMNUE2V2ZF3QFCA55CC7QN3Q, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.190436149 (224h23m33.62151628s) [noise=true , address=104.36.82.4:4822 , piece_id=7PUOVYBGPFYJQZUBCCHX7AAHKTYB7ZJBFWHJHUJYU22T5DNOARAQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.198050718 (224h23m33.629130849s) [noise=true , address=104.36.82.35:4611 , piece_id=GFIQTHHV67STQ6KFD25FSXSY3SFZJYYNDXTGY3UR4NA3HLBMB6YQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218397429 (224h23m33.64947756s) [noise=true , address=104.36.82.43:4839 , piece_id=ODQ3X4GQJ4F5K47QKW756U3HR7U2AWBVEWOEHFI7PMB73JCMTC6A, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218724114 (224h23m33.649804245s) [noise=true , address=104.36.82.19:4402 , piece_id=FVI6JRNZYLMULP6W5U5FMKCJSWSELEIG3VLR3QLRWYSO5SUI6RZQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218936471 (224h23m33.650016602s) [noise=true , address=104.36.82.44:4892 , piece_id=FOBEPAPVYOJUEIZGEJDJBLQP5RKJ2ZJNAOOWZ5NYAPL4MZBBRUDQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218949846 (224h23m33.650029977s) [seg_pos={0 0}, upload=233381]: Segment reached optimal threshold of 14 pieces.
Aug 18 01:49:39.219040078 (224h23m33.65012021s) [noise=true , address=77.90.31.12:4595 , piece_id=7CLANDDN6F2HLIVZNXXXPCX32TPZZ2XEXKILVXGBP7Y2UCFDTQHA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1he15nyRz78fmHLkMRs8Hxi2HntmzNsPTqKEbHNUthhSjGMmuj): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219101787 (224h23m33.650181918s) [noise=true , address=104.36.82.60:4357 , piece_id=SBPQNA5WQ6GI7N73NZLWKL5PXSI3PYF6J5HEPQBRIEVNPHKR5WVQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219231865 (224h23m33.650311996s) [noise=true , address=104.36.82.18:4400 , piece_id=5LZNZ4M2K6P3NJD57R7IL4UOGYFQOU7AE3XPAUVYCTJHRNBWMVJQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UxA6DMP2dr2T8o352iih2D6UeEeGQBMm1SgPbHYHuWaSFdyYv): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219270049 (224h23m33.65035018s) [noise=true , address=45.91.116.7:4029 , piece_id=7TVZLDWPESAINQ37KRCCVWC5YDK6DVC5KVRF7NXVNZ4GNQKVZIVQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rWqAGD7Vrj2yzEVyNbfPp278Gga42xPLyAcdzGvUSuz3EgJYh): protocol: write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection; write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection
Aug 18 01:49:39.219287963 (224h23m33.650368094s) [seg_pos={0 0}, upload=233381]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 01:49:39.219379378 (224h23m33.650459509s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 01:49:39.219384227 (224h23m33.650464358s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 01:49:39.546073200 (224h23m33.977153331s) [upload=233381]: Done uploading segments...
Aug 18 01:49:39.546095903 (224h23m33.977176034s) [upload=233381]: Upload finished. err: <nil>
Duration: 5.667035854s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..................................XX.....X..X...............] duration:
1.964145963s
FAIL (2025-08-18 01:50:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 01:38:16.026930657 (224h12m10.458010788s) [upload=233187]: Starting upload Aug 18 01:38:16.026975272 (224h12m10.458055403s) [upload=233187]: Done starting upload Aug 18 01:38:16.027021701 (224h12m10.458101822s) [upload=233187]: Uploading segments... Aug 18 01:38:16.027057609 (224h12m10.45813773s) [upload=233187]: Got next segment. Inline: true Aug 18 01:38:16.027061897 (224h12m10.458142028s) [upload=233187]: Waiting for error group managing segments... Aug 18 01:38:16.027094901 (224h12m10.458175032s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:38:16.027098749 (224h12m10.45817887s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 01:38:16.027101223 (224h12m10.458181354s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 01:38:16.331231433 (224h12m10.762311564s) [upload=233187]: Done uploading segments... Aug 18 01:38:16.331248626 (224h12m10.762328747s) [upload=233187]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.964178375s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X................X.......................................X] duration:
4.027894938s
FAIL (2025-08-18 01:49:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 01:49:36.672171641 (224h23m31.103251772s) [upload=233381]: Starting upload
Aug 18 01:49:36.672234732 (224h23m31.103314863s) [upload=233381]: Done starting upload
Aug 18 01:49:36.672373758 (224h23m31.103453899s) [upload=233381]: Uploading segments...
Aug 18 01:49:36.672529816 (224h23m31.103609967s) [upload=233381]: Got next segment. Inline: false
Aug 18 01:49:36.672585603 (224h23m31.103665754s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 01:49:36.672592166 (224h23m31.103672297s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 01:49:37.143520003 (224h23m31.574600134s) [seg_pos={0 0}, upload=233381]: Begin upload segment...
Aug 18 01:49:37.143570901 (224h23m31.574651032s) [seg_pos={0 0}, upload=233381]: Done begin upload segment.
Aug 18 01:49:37.143593234 (224h23m31.574673355s) [noise=true , address=104.36.82.9:4011 , piece_id=5QEXV5XZ4T6EF4ZBIVTSYIVKIGOMKOR6ALO33LPORAEOVHHFE6GA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.143664580 (224h23m31.574744701s) [noise=true , address=77.90.31.18:4825 , piece_id=N5FUZPZFO5WZSB7PJTJYHGXFEIZDIWPCITYDIQWOILYW5IKQYYQA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144042823 (224h23m31.575122955s) [noise=true , address=104.36.82.19:4402 , piece_id=FVI6JRNZYLMULP6W5U5FMKCJSWSELEIG3VLR3QLRWYSO5SUI6RZQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144429493 (224h23m31.575509624s) [noise=true , address=104.36.82.18:4400 , piece_id=5LZNZ4M2K6P3NJD57R7IL4UOGYFQOU7AE3XPAUVYCTJHRNBWMVJQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144738945 (224h23m31.575819076s) [noise=true , address=104.36.82.12:4171 , piece_id=RW35JO2COE6QYHEMFVSY4WXEP7HDFOTMTQY4QNVUJUW4FIJUONLQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.144861700 (224h23m31.575941821s) [noise=true , address=104.36.82.34:4578 , piece_id=RWY7Z7KQQ4ZNCKFMJG4H4RHWMC6TNTLNW3DRIIBGWFBHWAYWRR2A, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145048208 (224h23m31.576128339s) [noise=true , address=104.36.82.4:4822 , piece_id=7PUOVYBGPFYJQZUBCCHX7AAHKTYB7ZJBFWHJHUJYU22T5DNOARAQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145120676 (224h23m31.576200807s) [noise=true , address=104.36.82.60:4357 , piece_id=SBPQNA5WQ6GI7N73NZLWKL5PXSI3PYF6J5HEPQBRIEVNPHKR5WVQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145318845 (224h23m31.576398977s) [noise=true , address=104.36.82.60:4368 , piece_id=44V5R55SJKLLHQNLUT3XNCMOHUYOTMNUE2V2ZF3QFCA55CC7QN3Q, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145594723 (224h23m31.576674854s) [noise=true , address=45.91.116.7:4029 , piece_id=7TVZLDWPESAINQ37KRCCVWC5YDK6DVC5KVRF7NXVNZ4GNQKVZIVQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.145897102 (224h23m31.576977233s) [noise=true , address=104.36.82.38:4695 , piece_id=Q2ZK6THXBRABGL5ZL5RCAZVCDJ3PSWWTMP26GMJKUBYTZFWTSNDQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146160455 (224h23m31.577240576s) [noise=true , address=104.36.82.35:4611 , piece_id=GFIQTHHV67STQ6KFD25FSXSY3SFZJYYNDXTGY3UR4NA3HLBMB6YQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146458486 (224h23m31.577538617s) [noise=true , address=104.36.82.43:4839 , piece_id=ODQ3X4GQJ4F5K47QKW756U3HR7U2AWBVEWOEHFI7PMB73JCMTC6A, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146582913 (224h23m31.577663044s) [noise=true , address=77.90.31.12:4595 , piece_id=7CLANDDN6F2HLIVZNXXXPCX32TPZZ2XEXKILVXGBP7Y2UCFDTQHA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.146840807 (224h23m31.577920938s) [noise=true , address=45.91.116.14:4213 , piece_id=75LD5HR6M6HD5GIW4JWLXKCSNKIPX2EALMXIELAVI7QZRIQ3W7WQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147081808 (224h23m31.57816194s) [noise=true , address=77.90.31.15:4721 , piece_id=NK362IOTNC4ED22FGSMKSNLYHZD55Y5MAPBKV3UG63A4BRABKIGA, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147231294 (224h23m31.578311455s) [noise=true , address=104.36.82.44:4892 , piece_id=FOBEPAPVYOJUEIZGEJDJBLQP5RKJ2ZJNAOOWZ5NYAPL4MZBBRUDQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:37.147561586 (224h23m31.578641717s) [noise=true , address=104.36.82.36:4651 , piece_id=OTEC4GO32RCZPQWP4LK3JROYRG33VLGSOZZ4P5NIXRPQHRL3QPOQ, seg_pos={0 0}, upload=233381]: Uploading piece...
Aug 18 01:49:38.621048699 (224h23m33.05212888s) [upload=233381]: Next returned nil segment
Aug 18 01:49:38.621070491 (224h23m33.052150652s) [upload=233381]: Waiting for error group managing segments...
Aug 18 01:49:39.039263997 (224h23m33.470344128s) [noise=true , address=45.91.116.14:4213 , piece_id=75LD5HR6M6HD5GIW4JWLXKCSNKIPX2EALMXIELAVI7QZRIQ3W7WQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.050452676 (224h23m33.481532807s) [noise=true , address=104.36.82.38:4695 , piece_id=Q2ZK6THXBRABGL5ZL5RCAZVCDJ3PSWWTMP26GMJKUBYTZFWTSNDQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.066702338 (224h23m33.497782469s) [noise=true , address=77.90.31.18:4825 , piece_id=N5FUZPZFO5WZSB7PJTJYHGXFEIZDIWPCITYDIQWOILYW5IKQYYQA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.091533990 (224h23m33.522614121s) [noise=true , address=77.90.31.15:4721 , piece_id=NK362IOTNC4ED22FGSMKSNLYHZD55Y5MAPBKV3UG63A4BRABKIGA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.094447966 (224h23m33.525528097s) [noise=true , address=104.36.82.36:4651 , piece_id=OTEC4GO32RCZPQWP4LK3JROYRG33VLGSOZZ4P5NIXRPQHRL3QPOQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124130209 (224h23m33.55521033s) [noise=true , address=104.36.82.34:4578 , piece_id=RWY7Z7KQQ4ZNCKFMJG4H4RHWMC6TNTLNW3DRIIBGWFBHWAYWRR2A, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124312378 (224h23m33.555392509s) [noise=true , address=104.36.82.9:4011 , piece_id=5QEXV5XZ4T6EF4ZBIVTSYIVKIGOMKOR6ALO33LPORAEOVHHFE6GA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.124738052 (224h23m33.555818183s) [noise=true , address=104.36.82.12:4171 , piece_id=RW35JO2COE6QYHEMFVSY4WXEP7HDFOTMTQY4QNVUJUW4FIJUONLQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.170134133 (224h23m33.601214264s) [noise=true , address=104.36.82.60:4368 , piece_id=44V5R55SJKLLHQNLUT3XNCMOHUYOTMNUE2V2ZF3QFCA55CC7QN3Q, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.190436149 (224h23m33.62151628s) [noise=true , address=104.36.82.4:4822 , piece_id=7PUOVYBGPFYJQZUBCCHX7AAHKTYB7ZJBFWHJHUJYU22T5DNOARAQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.198050718 (224h23m33.629130849s) [noise=true , address=104.36.82.35:4611 , piece_id=GFIQTHHV67STQ6KFD25FSXSY3SFZJYYNDXTGY3UR4NA3HLBMB6YQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218397429 (224h23m33.64947756s) [noise=true , address=104.36.82.43:4839 , piece_id=ODQ3X4GQJ4F5K47QKW756U3HR7U2AWBVEWOEHFI7PMB73JCMTC6A, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218724114 (224h23m33.649804245s) [noise=true , address=104.36.82.19:4402 , piece_id=FVI6JRNZYLMULP6W5U5FMKCJSWSELEIG3VLR3QLRWYSO5SUI6RZQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218936471 (224h23m33.650016602s) [noise=true , address=104.36.82.44:4892 , piece_id=FOBEPAPVYOJUEIZGEJDJBLQP5RKJ2ZJNAOOWZ5NYAPL4MZBBRUDQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: <nil>
Aug 18 01:49:39.218949846 (224h23m33.650029977s) [seg_pos={0 0}, upload=233381]: Segment reached optimal threshold of 14 pieces.
Aug 18 01:49:39.219040078 (224h23m33.65012021s) [noise=true , address=77.90.31.12:4595 , piece_id=7CLANDDN6F2HLIVZNXXXPCX32TPZZ2XEXKILVXGBP7Y2UCFDTQHA, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1he15nyRz78fmHLkMRs8Hxi2HntmzNsPTqKEbHNUthhSjGMmuj): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219101787 (224h23m33.650181918s) [noise=true , address=104.36.82.60:4357 , piece_id=SBPQNA5WQ6GI7N73NZLWKL5PXSI3PYF6J5HEPQBRIEVNPHKR5WVQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219231865 (224h23m33.650311996s) [noise=true , address=104.36.82.18:4400 , piece_id=5LZNZ4M2K6P3NJD57R7IL4UOGYFQOU7AE3XPAUVYCTJHRNBWMVJQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UxA6DMP2dr2T8o352iih2D6UeEeGQBMm1SgPbHYHuWaSFdyYv): protocol: expected piece hash; context canceled; EOF
Aug 18 01:49:39.219270049 (224h23m33.65035018s) [noise=true , address=45.91.116.7:4029 , piece_id=7TVZLDWPESAINQ37KRCCVWC5YDK6DVC5KVRF7NXVNZ4GNQKVZIVQ, seg_pos={0 0}, upload=233381]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rWqAGD7Vrj2yzEVyNbfPp278Gga42xPLyAcdzGvUSuz3EgJYh): protocol: write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection; write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33456->45.91.116.7:4029: use of closed network connection
Aug 18 01:49:39.219287963 (224h23m33.650368094s) [seg_pos={0 0}, upload=233381]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 01:49:39.219379378 (224h23m33.650459509s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 01:49:39.219384227 (224h23m33.650464358s) [upload=233381]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 01:49:39.546073200 (224h23m33.977153331s) [upload=233381]: Done uploading segments...
Aug 18 01:49:39.546095903 (224h23m33.977176034s) [upload=233381]: Upload finished. err: <nil>
Duration: 4.027920096s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...................................XX.....X..X..............] duration:
1.932690958s
FAIL (2025-08-18 01:49:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 01:38:16.026930657 (224h12m10.458010788s) [upload=233187]: Starting upload Aug 18 01:38:16.026975272 (224h12m10.458055403s) [upload=233187]: Done starting upload Aug 18 01:38:16.027021701 (224h12m10.458101822s) [upload=233187]: Uploading segments... Aug 18 01:38:16.027057609 (224h12m10.45813773s) [upload=233187]: Got next segment. Inline: true Aug 18 01:38:16.027061897 (224h12m10.458142028s) [upload=233187]: Waiting for error group managing segments... Aug 18 01:38:16.027094901 (224h12m10.458175032s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:38:16.027098749 (224h12m10.45817887s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 01:38:16.027101223 (224h12m10.458181354s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 01:38:16.331231433 (224h12m10.762311564s) [upload=233187]: Done uploading segments... Aug 18 01:38:16.331248626 (224h12m10.762328747s) [upload=233187]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.932714423s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X................X.......................................] duration:
5.945932774s
FAIL (2025-08-18 01:49:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 01:20:52.452488492 (223h54m46.883568644s) [upload=232885]: Starting upload
Aug 18 01:20:52.452565580 (223h54m46.883645711s) [upload=232885]: Done starting upload
Aug 18 01:20:52.452625986 (223h54m46.883706117s) [upload=232885]: Uploading segments...
Aug 18 01:20:52.452770703 (223h54m46.883850834s) [upload=232885]: Got next segment. Inline: false
Aug 18 01:20:52.452823614 (223h54m46.883903736s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 01:20:52.452827682 (223h54m46.883907813s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 01:20:52.921867859 (223h54m47.35294803s) [seg_pos={0 0}, upload=232885]: Begin upload segment...
Aug 18 01:20:52.921915100 (223h54m47.352995231s) [seg_pos={0 0}, upload=232885]: Done begin upload segment.
Aug 18 01:20:52.921937854 (223h54m47.353017985s) [noise=true , address=64.49.13.155:4915 , piece_id=JZ7N6GIEFNO643AIWZ6Z4ZGXOAZRYGDS35WEDBTUJAGMSDXTGPXQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.921999131 (223h54m47.353079262s) [noise=true , address=104.36.82.21:4478 , piece_id=IY5KC377HYAU2XFEH2VG3SHTWCFGK54KOUEUZQ5TEZQBOZXAMY7A, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922310636 (223h54m47.353390767s) [noise=true , address=77.90.31.13:4654 , piece_id=O53RNB3HMLVU5NJH4SK6JDKCQXHSB5JKOQ7Z76ENS3NIG4SVR5WQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922421298 (223h54m47.353501419s) [noise=true , address=104.36.82.14:4228 , piece_id=2E4FIXOY2RAX4BUTYTW66HSFH3HFGNQYLHIRH2H5JUO3RCZDYQEQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922635819 (223h54m47.35371594s) [noise=true , address=104.36.82.17:4359 , piece_id=DHYNAHQ3NAJURDPLZJJY3A7IMOXWQXSI7T5GCODTEKGXPIRBH3ZA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922706264 (223h54m47.353786385s) [noise=true , address=104.36.82.23:4459 , piece_id=6UDI3KG365RRERRZ2WOCLPZJPKGJU32YNO4GMZOHHIEMATZ5NXSQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922970529 (223h54m47.35405066s) [noise=true , address=77.90.31.15:4704 , piece_id=UVZKCHAAV47PGZTXXRETQAKEV5UUMRAHN6MLRCDYAWL7FQLDFWKQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923017830 (223h54m47.354097961s) [noise=true , address=45.91.116.8:4063 , piece_id=CQIZKY2YAS7PPH7IGCZ62MY3UIIAFCK6CO4IEL4ITZ6OYTHDVOPQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923248390 (223h54m47.354328521s) [noise=true , address=104.36.82.15:4290 , piece_id=ZWEXNPINOSTI2TEMBO6ERE5HPMCZ5OHXY5PZ52P225LS3MWL6VAA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923295100 (223h54m47.354375221s) [noise=true , address=77.90.31.12:4614 , piece_id=HD7OC5VPWMGFYCEIX7KF6YKUZG4PA7KWVYSQAMRGZFV4X63DJFWQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923576468 (223h54m47.354656599s) [noise=true , address=104.36.82.35:4587 , piece_id=4IDMSU4AGF2EXSXU3VJP23J47DBV2BX2WNXI7Q3SRETDCOHGTSDA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923584394 (223h54m47.354664525s) [noise=true , address=104.36.82.10:4081 , piece_id=B7H4OREJMPRHBBPKVZJKYYN72M3Y5RFSVGRBHPNYQL6KKUOMIWTQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923870110 (223h54m47.354950231s) [noise=true , address=104.36.82.36:4629 , piece_id=3Q2Y5YJCMWZUOIRCX7GSSD5RBNA3P7U4I6MG5XLRJDY5DCSAXQHA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924098226 (223h54m47.355178358s) [noise=true , address=104.36.82.8:4991 , piece_id=Y34CYOMWJ3MEPB2IRJJDGNCPHTNJXQREYBZOLSPDCP3WL7DBZ77A, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924351632 (223h54m47.355431763s) [noise=true , address=45.91.116.6:4999 , piece_id=2TDE7ULW6NDHEPOAMLRJJZ473HU23XBM5EFXZSUBTKL4YCO5J5JA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924680081 (223h54m47.355760212s) [noise=true , address=77.90.31.14:4679 , piece_id=M44XZ7IROIEWSXD6TRUJF4EEOC7C3B67353B4L6GD6JXHTQ42LOQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.925734468 (223h54m47.356814599s) [noise=true , address=77.90.31.16:4759 , piece_id=22ZGABIKYBNOOWUZ2MCBWHX5ETZMUB6NDKQ35CU7NYA4POGXXKHQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.925969748 (223h54m47.357049879s) [noise=true , address=45.91.116.9:4265 , piece_id=XRCTSMY2KBYSFD7XCAZRQLG2ZBFSTVQ4JHWOLTGSXY3WFXU773XA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:54.116296228 (223h54m48.547376359s) [upload=232885]: Next returned nil segment
Aug 18 01:20:54.116312098 (223h54m48.547392229s) [upload=232885]: Waiting for error group managing segments...
Aug 18 01:20:54.420069145 (223h54m48.851149276s) [noise=true , address=64.49.13.155:4915 , piece_id=JZ7N6GIEFNO643AIWZ6Z4ZGXOAZRYGDS35WEDBTUJAGMSDXTGPXQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.864989040 (223h54m49.296069171s) [noise=true , address=104.36.82.23:4459 , piece_id=6UDI3KG365RRERRZ2WOCLPZJPKGJU32YNO4GMZOHHIEMATZ5NXSQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.884574575 (223h54m49.315654706s) [noise=true , address=77.90.31.14:4679 , piece_id=M44XZ7IROIEWSXD6TRUJF4EEOC7C3B67353B4L6GD6JXHTQ42LOQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.901503566 (223h54m49.332583697s) [noise=true , address=104.36.82.36:4629 , piece_id=3Q2Y5YJCMWZUOIRCX7GSSD5RBNA3P7U4I6MG5XLRJDY5DCSAXQHA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.924258746 (223h54m49.355338867s) [noise=true , address=104.36.82.15:4290 , piece_id=ZWEXNPINOSTI2TEMBO6ERE5HPMCZ5OHXY5PZ52P225LS3MWL6VAA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.925720423 (223h54m49.356800554s) [noise=true , address=45.91.116.8:4063 , piece_id=CQIZKY2YAS7PPH7IGCZ62MY3UIIAFCK6CO4IEL4ITZ6OYTHDVOPQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.928315268 (223h54m49.359395399s) [noise=true , address=104.36.82.14:4228 , piece_id=2E4FIXOY2RAX4BUTYTW66HSFH3HFGNQYLHIRH2H5JUO3RCZDYQEQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.940016547 (223h54m49.371096678s) [noise=true , address=104.36.82.35:4587 , piece_id=4IDMSU4AGF2EXSXU3VJP23J47DBV2BX2WNXI7Q3SRETDCOHGTSDA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.974323059 (223h54m49.40540319s) [noise=true , address=104.36.82.17:4359 , piece_id=DHYNAHQ3NAJURDPLZJJY3A7IMOXWQXSI7T5GCODTEKGXPIRBH3ZA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.993699504 (223h54m49.424779635s) [noise=true , address=45.91.116.9:4265 , piece_id=XRCTSMY2KBYSFD7XCAZRQLG2ZBFSTVQ4JHWOLTGSXY3WFXU773XA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.997353635 (223h54m49.428433766s) [noise=true , address=104.36.82.21:4478 , piece_id=IY5KC377HYAU2XFEH2VG3SHTWCFGK54KOUEUZQ5TEZQBOZXAMY7A, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.017027348 (223h54m49.448107479s) [noise=true , address=77.90.31.12:4614 , piece_id=HD7OC5VPWMGFYCEIX7KF6YKUZG4PA7KWVYSQAMRGZFV4X63DJFWQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.031039219 (223h54m49.46211935s) [noise=true , address=77.90.31.16:4759 , piece_id=22ZGABIKYBNOOWUZ2MCBWHX5ETZMUB6NDKQ35CU7NYA4POGXXKHQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.037083404 (223h54m49.468163525s) [noise=true , address=104.36.82.10:4081 , piece_id=B7H4OREJMPRHBBPKVZJKYYN72M3Y5RFSVGRBHPNYQL6KKUOMIWTQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.037108391 (223h54m49.468188522s) [seg_pos={0 0}, upload=232885]: Segment reached optimal threshold of 14 pieces.
Aug 18 01:20:55.037297984 (223h54m49.468378115s) [noise=true , address=77.90.31.13:4654 , piece_id=O53RNB3HMLVU5NJH4SK6JDKCQXHSB5JKOQ7Z76ENS3NIG4SVR5WQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8): protocol: expected piece hash; context canceled; EOF
Aug 18 01:20:55.037322210 (223h54m49.468402341s) [noise=true , address=104.36.82.8:4991 , piece_id=Y34CYOMWJ3MEPB2IRJJDGNCPHTNJXQREYBZOLSPDCP3WL7DBZ77A, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qhGin74NgTpgUFEFrMdhXaQC3v17PefWnKgLSotok56yRoxZx): protocol: write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection; write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection
Aug 18 01:20:55.037351246 (223h54m49.468431377s) [noise=true , address=45.91.116.6:4999 , piece_id=2TDE7ULW6NDHEPOAMLRJJZ473HU23XBM5EFXZSUBTKL4YCO5J5JA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12evc8vF5f1Z7cPrrC7G7BsGuDWjzttAE2FsQciV7nztBDmrCZB): protocol: write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection; write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection
Aug 18 01:20:55.037400019 (223h54m49.46848015s) [noise=true , address=77.90.31.15:4704 , piece_id=UVZKCHAAV47PGZTXXRETQAKEV5UUMRAHN6MLRCDYAWL7FQLDFWKQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: expected piece hash; context canceled; EOF
Aug 18 01:20:55.037412794 (223h54m49.468492925s) [seg_pos={0 0}, upload=232885]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 01:20:55.037468010 (223h54m49.468548141s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 01:20:55.037471677 (223h54m49.468551808s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 01:20:55.389966548 (223h54m49.821046729s) [upload=232885]: Done uploading segments...
Aug 18 01:20:55.389990333 (223h54m49.821070504s) [upload=232885]: Upload finished. err: <nil>
Duration: 5.945959545s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....................................XX.....X..X.............] duration:
1.995267145s
FAIL (2025-08-18 01:49:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 01:38:16.026930657 (224h12m10.458010788s) [upload=233187]: Starting upload Aug 18 01:38:16.026975272 (224h12m10.458055403s) [upload=233187]: Done starting upload Aug 18 01:38:16.027021701 (224h12m10.458101822s) [upload=233187]: Uploading segments... Aug 18 01:38:16.027057609 (224h12m10.45813773s) [upload=233187]: Got next segment. Inline: true Aug 18 01:38:16.027061897 (224h12m10.458142028s) [upload=233187]: Waiting for error group managing segments... Aug 18 01:38:16.027094901 (224h12m10.458175032s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:38:16.027098749 (224h12m10.45817887s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 01:38:16.027101223 (224h12m10.458181354s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 01:38:16.331231433 (224h12m10.762311564s) [upload=233187]: Done uploading segments... Aug 18 01:38:16.331248626 (224h12m10.762328747s) [upload=233187]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.995293003s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X................X......................................] duration:
6.002792777s
FAIL (2025-08-18 01:48:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 01:20:52.452488492 (223h54m46.883568644s) [upload=232885]: Starting upload
Aug 18 01:20:52.452565580 (223h54m46.883645711s) [upload=232885]: Done starting upload
Aug 18 01:20:52.452625986 (223h54m46.883706117s) [upload=232885]: Uploading segments...
Aug 18 01:20:52.452770703 (223h54m46.883850834s) [upload=232885]: Got next segment. Inline: false
Aug 18 01:20:52.452823614 (223h54m46.883903736s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 01:20:52.452827682 (223h54m46.883907813s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 01:20:52.921867859 (223h54m47.35294803s) [seg_pos={0 0}, upload=232885]: Begin upload segment...
Aug 18 01:20:52.921915100 (223h54m47.352995231s) [seg_pos={0 0}, upload=232885]: Done begin upload segment.
Aug 18 01:20:52.921937854 (223h54m47.353017985s) [noise=true , address=64.49.13.155:4915 , piece_id=JZ7N6GIEFNO643AIWZ6Z4ZGXOAZRYGDS35WEDBTUJAGMSDXTGPXQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.921999131 (223h54m47.353079262s) [noise=true , address=104.36.82.21:4478 , piece_id=IY5KC377HYAU2XFEH2VG3SHTWCFGK54KOUEUZQ5TEZQBOZXAMY7A, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922310636 (223h54m47.353390767s) [noise=true , address=77.90.31.13:4654 , piece_id=O53RNB3HMLVU5NJH4SK6JDKCQXHSB5JKOQ7Z76ENS3NIG4SVR5WQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922421298 (223h54m47.353501419s) [noise=true , address=104.36.82.14:4228 , piece_id=2E4FIXOY2RAX4BUTYTW66HSFH3HFGNQYLHIRH2H5JUO3RCZDYQEQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922635819 (223h54m47.35371594s) [noise=true , address=104.36.82.17:4359 , piece_id=DHYNAHQ3NAJURDPLZJJY3A7IMOXWQXSI7T5GCODTEKGXPIRBH3ZA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922706264 (223h54m47.353786385s) [noise=true , address=104.36.82.23:4459 , piece_id=6UDI3KG365RRERRZ2WOCLPZJPKGJU32YNO4GMZOHHIEMATZ5NXSQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922970529 (223h54m47.35405066s) [noise=true , address=77.90.31.15:4704 , piece_id=UVZKCHAAV47PGZTXXRETQAKEV5UUMRAHN6MLRCDYAWL7FQLDFWKQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923017830 (223h54m47.354097961s) [noise=true , address=45.91.116.8:4063 , piece_id=CQIZKY2YAS7PPH7IGCZ62MY3UIIAFCK6CO4IEL4ITZ6OYTHDVOPQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923248390 (223h54m47.354328521s) [noise=true , address=104.36.82.15:4290 , piece_id=ZWEXNPINOSTI2TEMBO6ERE5HPMCZ5OHXY5PZ52P225LS3MWL6VAA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923295100 (223h54m47.354375221s) [noise=true , address=77.90.31.12:4614 , piece_id=HD7OC5VPWMGFYCEIX7KF6YKUZG4PA7KWVYSQAMRGZFV4X63DJFWQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923576468 (223h54m47.354656599s) [noise=true , address=104.36.82.35:4587 , piece_id=4IDMSU4AGF2EXSXU3VJP23J47DBV2BX2WNXI7Q3SRETDCOHGTSDA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923584394 (223h54m47.354664525s) [noise=true , address=104.36.82.10:4081 , piece_id=B7H4OREJMPRHBBPKVZJKYYN72M3Y5RFSVGRBHPNYQL6KKUOMIWTQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923870110 (223h54m47.354950231s) [noise=true , address=104.36.82.36:4629 , piece_id=3Q2Y5YJCMWZUOIRCX7GSSD5RBNA3P7U4I6MG5XLRJDY5DCSAXQHA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924098226 (223h54m47.355178358s) [noise=true , address=104.36.82.8:4991 , piece_id=Y34CYOMWJ3MEPB2IRJJDGNCPHTNJXQREYBZOLSPDCP3WL7DBZ77A, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924351632 (223h54m47.355431763s) [noise=true , address=45.91.116.6:4999 , piece_id=2TDE7ULW6NDHEPOAMLRJJZ473HU23XBM5EFXZSUBTKL4YCO5J5JA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924680081 (223h54m47.355760212s) [noise=true , address=77.90.31.14:4679 , piece_id=M44XZ7IROIEWSXD6TRUJF4EEOC7C3B67353B4L6GD6JXHTQ42LOQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.925734468 (223h54m47.356814599s) [noise=true , address=77.90.31.16:4759 , piece_id=22ZGABIKYBNOOWUZ2MCBWHX5ETZMUB6NDKQ35CU7NYA4POGXXKHQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.925969748 (223h54m47.357049879s) [noise=true , address=45.91.116.9:4265 , piece_id=XRCTSMY2KBYSFD7XCAZRQLG2ZBFSTVQ4JHWOLTGSXY3WFXU773XA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:54.116296228 (223h54m48.547376359s) [upload=232885]: Next returned nil segment
Aug 18 01:20:54.116312098 (223h54m48.547392229s) [upload=232885]: Waiting for error group managing segments...
Aug 18 01:20:54.420069145 (223h54m48.851149276s) [noise=true , address=64.49.13.155:4915 , piece_id=JZ7N6GIEFNO643AIWZ6Z4ZGXOAZRYGDS35WEDBTUJAGMSDXTGPXQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.864989040 (223h54m49.296069171s) [noise=true , address=104.36.82.23:4459 , piece_id=6UDI3KG365RRERRZ2WOCLPZJPKGJU32YNO4GMZOHHIEMATZ5NXSQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.884574575 (223h54m49.315654706s) [noise=true , address=77.90.31.14:4679 , piece_id=M44XZ7IROIEWSXD6TRUJF4EEOC7C3B67353B4L6GD6JXHTQ42LOQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.901503566 (223h54m49.332583697s) [noise=true , address=104.36.82.36:4629 , piece_id=3Q2Y5YJCMWZUOIRCX7GSSD5RBNA3P7U4I6MG5XLRJDY5DCSAXQHA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.924258746 (223h54m49.355338867s) [noise=true , address=104.36.82.15:4290 , piece_id=ZWEXNPINOSTI2TEMBO6ERE5HPMCZ5OHXY5PZ52P225LS3MWL6VAA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.925720423 (223h54m49.356800554s) [noise=true , address=45.91.116.8:4063 , piece_id=CQIZKY2YAS7PPH7IGCZ62MY3UIIAFCK6CO4IEL4ITZ6OYTHDVOPQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.928315268 (223h54m49.359395399s) [noise=true , address=104.36.82.14:4228 , piece_id=2E4FIXOY2RAX4BUTYTW66HSFH3HFGNQYLHIRH2H5JUO3RCZDYQEQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.940016547 (223h54m49.371096678s) [noise=true , address=104.36.82.35:4587 , piece_id=4IDMSU4AGF2EXSXU3VJP23J47DBV2BX2WNXI7Q3SRETDCOHGTSDA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.974323059 (223h54m49.40540319s) [noise=true , address=104.36.82.17:4359 , piece_id=DHYNAHQ3NAJURDPLZJJY3A7IMOXWQXSI7T5GCODTEKGXPIRBH3ZA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.993699504 (223h54m49.424779635s) [noise=true , address=45.91.116.9:4265 , piece_id=XRCTSMY2KBYSFD7XCAZRQLG2ZBFSTVQ4JHWOLTGSXY3WFXU773XA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.997353635 (223h54m49.428433766s) [noise=true , address=104.36.82.21:4478 , piece_id=IY5KC377HYAU2XFEH2VG3SHTWCFGK54KOUEUZQ5TEZQBOZXAMY7A, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.017027348 (223h54m49.448107479s) [noise=true , address=77.90.31.12:4614 , piece_id=HD7OC5VPWMGFYCEIX7KF6YKUZG4PA7KWVYSQAMRGZFV4X63DJFWQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.031039219 (223h54m49.46211935s) [noise=true , address=77.90.31.16:4759 , piece_id=22ZGABIKYBNOOWUZ2MCBWHX5ETZMUB6NDKQ35CU7NYA4POGXXKHQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.037083404 (223h54m49.468163525s) [noise=true , address=104.36.82.10:4081 , piece_id=B7H4OREJMPRHBBPKVZJKYYN72M3Y5RFSVGRBHPNYQL6KKUOMIWTQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.037108391 (223h54m49.468188522s) [seg_pos={0 0}, upload=232885]: Segment reached optimal threshold of 14 pieces.
Aug 18 01:20:55.037297984 (223h54m49.468378115s) [noise=true , address=77.90.31.13:4654 , piece_id=O53RNB3HMLVU5NJH4SK6JDKCQXHSB5JKOQ7Z76ENS3NIG4SVR5WQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8): protocol: expected piece hash; context canceled; EOF
Aug 18 01:20:55.037322210 (223h54m49.468402341s) [noise=true , address=104.36.82.8:4991 , piece_id=Y34CYOMWJ3MEPB2IRJJDGNCPHTNJXQREYBZOLSPDCP3WL7DBZ77A, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qhGin74NgTpgUFEFrMdhXaQC3v17PefWnKgLSotok56yRoxZx): protocol: write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection; write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection
Aug 18 01:20:55.037351246 (223h54m49.468431377s) [noise=true , address=45.91.116.6:4999 , piece_id=2TDE7ULW6NDHEPOAMLRJJZ473HU23XBM5EFXZSUBTKL4YCO5J5JA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12evc8vF5f1Z7cPrrC7G7BsGuDWjzttAE2FsQciV7nztBDmrCZB): protocol: write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection; write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection
Aug 18 01:20:55.037400019 (223h54m49.46848015s) [noise=true , address=77.90.31.15:4704 , piece_id=UVZKCHAAV47PGZTXXRETQAKEV5UUMRAHN6MLRCDYAWL7FQLDFWKQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: expected piece hash; context canceled; EOF
Aug 18 01:20:55.037412794 (223h54m49.468492925s) [seg_pos={0 0}, upload=232885]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 01:20:55.037468010 (223h54m49.468548141s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 01:20:55.037471677 (223h54m49.468551808s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 01:20:55.389966548 (223h54m49.821046729s) [upload=232885]: Done uploading segments...
Aug 18 01:20:55.389990333 (223h54m49.821070504s) [upload=232885]: Upload finished. err: <nil>
Duration: 6.002820571s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....................................XX.....X..X............] duration:
1.932582192s
FAIL (2025-08-18 01:48:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 01:38:16.026930657 (224h12m10.458010788s) [upload=233187]: Starting upload Aug 18 01:38:16.026975272 (224h12m10.458055403s) [upload=233187]: Done starting upload Aug 18 01:38:16.027021701 (224h12m10.458101822s) [upload=233187]: Uploading segments... Aug 18 01:38:16.027057609 (224h12m10.45813773s) [upload=233187]: Got next segment. Inline: true Aug 18 01:38:16.027061897 (224h12m10.458142028s) [upload=233187]: Waiting for error group managing segments... Aug 18 01:38:16.027094901 (224h12m10.458175032s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:38:16.027098749 (224h12m10.45817887s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 01:38:16.027101223 (224h12m10.458181354s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 01:38:16.331231433 (224h12m10.762311564s) [upload=233187]: Done uploading segments... Aug 18 01:38:16.331248626 (224h12m10.762328747s) [upload=233187]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.932611329s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......................................XX.....X..X...........] duration:
2.037652783s
FAIL (2025-08-18 01:47:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 01:38:16.026930657 (224h12m10.458010788s) [upload=233187]: Starting upload Aug 18 01:38:16.026975272 (224h12m10.458055403s) [upload=233187]: Done starting upload Aug 18 01:38:16.027021701 (224h12m10.458101822s) [upload=233187]: Uploading segments... Aug 18 01:38:16.027057609 (224h12m10.45813773s) [upload=233187]: Got next segment. Inline: true Aug 18 01:38:16.027061897 (224h12m10.458142028s) [upload=233187]: Waiting for error group managing segments... Aug 18 01:38:16.027094901 (224h12m10.458175032s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:38:16.027098749 (224h12m10.45817887s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 01:38:16.027101223 (224h12m10.458181354s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 01:38:16.331231433 (224h12m10.762311564s) [upload=233187]: Done uploading segments... Aug 18 01:38:16.331248626 (224h12m10.762328747s) [upload=233187]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.037678673s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X................X.....................................] duration:
6.1360817s
FAIL (2025-08-18 01:47:43 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 01:20:52.452488492 (223h54m46.883568644s) [upload=232885]: Starting upload
Aug 18 01:20:52.452565580 (223h54m46.883645711s) [upload=232885]: Done starting upload
Aug 18 01:20:52.452625986 (223h54m46.883706117s) [upload=232885]: Uploading segments...
Aug 18 01:20:52.452770703 (223h54m46.883850834s) [upload=232885]: Got next segment. Inline: false
Aug 18 01:20:52.452823614 (223h54m46.883903736s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 01:20:52.452827682 (223h54m46.883907813s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 01:20:52.921867859 (223h54m47.35294803s) [seg_pos={0 0}, upload=232885]: Begin upload segment...
Aug 18 01:20:52.921915100 (223h54m47.352995231s) [seg_pos={0 0}, upload=232885]: Done begin upload segment.
Aug 18 01:20:52.921937854 (223h54m47.353017985s) [noise=true , address=64.49.13.155:4915 , piece_id=JZ7N6GIEFNO643AIWZ6Z4ZGXOAZRYGDS35WEDBTUJAGMSDXTGPXQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.921999131 (223h54m47.353079262s) [noise=true , address=104.36.82.21:4478 , piece_id=IY5KC377HYAU2XFEH2VG3SHTWCFGK54KOUEUZQ5TEZQBOZXAMY7A, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922310636 (223h54m47.353390767s) [noise=true , address=77.90.31.13:4654 , piece_id=O53RNB3HMLVU5NJH4SK6JDKCQXHSB5JKOQ7Z76ENS3NIG4SVR5WQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922421298 (223h54m47.353501419s) [noise=true , address=104.36.82.14:4228 , piece_id=2E4FIXOY2RAX4BUTYTW66HSFH3HFGNQYLHIRH2H5JUO3RCZDYQEQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922635819 (223h54m47.35371594s) [noise=true , address=104.36.82.17:4359 , piece_id=DHYNAHQ3NAJURDPLZJJY3A7IMOXWQXSI7T5GCODTEKGXPIRBH3ZA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922706264 (223h54m47.353786385s) [noise=true , address=104.36.82.23:4459 , piece_id=6UDI3KG365RRERRZ2WOCLPZJPKGJU32YNO4GMZOHHIEMATZ5NXSQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922970529 (223h54m47.35405066s) [noise=true , address=77.90.31.15:4704 , piece_id=UVZKCHAAV47PGZTXXRETQAKEV5UUMRAHN6MLRCDYAWL7FQLDFWKQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923017830 (223h54m47.354097961s) [noise=true , address=45.91.116.8:4063 , piece_id=CQIZKY2YAS7PPH7IGCZ62MY3UIIAFCK6CO4IEL4ITZ6OYTHDVOPQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923248390 (223h54m47.354328521s) [noise=true , address=104.36.82.15:4290 , piece_id=ZWEXNPINOSTI2TEMBO6ERE5HPMCZ5OHXY5PZ52P225LS3MWL6VAA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923295100 (223h54m47.354375221s) [noise=true , address=77.90.31.12:4614 , piece_id=HD7OC5VPWMGFYCEIX7KF6YKUZG4PA7KWVYSQAMRGZFV4X63DJFWQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923576468 (223h54m47.354656599s) [noise=true , address=104.36.82.35:4587 , piece_id=4IDMSU4AGF2EXSXU3VJP23J47DBV2BX2WNXI7Q3SRETDCOHGTSDA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923584394 (223h54m47.354664525s) [noise=true , address=104.36.82.10:4081 , piece_id=B7H4OREJMPRHBBPKVZJKYYN72M3Y5RFSVGRBHPNYQL6KKUOMIWTQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923870110 (223h54m47.354950231s) [noise=true , address=104.36.82.36:4629 , piece_id=3Q2Y5YJCMWZUOIRCX7GSSD5RBNA3P7U4I6MG5XLRJDY5DCSAXQHA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924098226 (223h54m47.355178358s) [noise=true , address=104.36.82.8:4991 , piece_id=Y34CYOMWJ3MEPB2IRJJDGNCPHTNJXQREYBZOLSPDCP3WL7DBZ77A, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924351632 (223h54m47.355431763s) [noise=true , address=45.91.116.6:4999 , piece_id=2TDE7ULW6NDHEPOAMLRJJZ473HU23XBM5EFXZSUBTKL4YCO5J5JA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924680081 (223h54m47.355760212s) [noise=true , address=77.90.31.14:4679 , piece_id=M44XZ7IROIEWSXD6TRUJF4EEOC7C3B67353B4L6GD6JXHTQ42LOQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.925734468 (223h54m47.356814599s) [noise=true , address=77.90.31.16:4759 , piece_id=22ZGABIKYBNOOWUZ2MCBWHX5ETZMUB6NDKQ35CU7NYA4POGXXKHQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.925969748 (223h54m47.357049879s) [noise=true , address=45.91.116.9:4265 , piece_id=XRCTSMY2KBYSFD7XCAZRQLG2ZBFSTVQ4JHWOLTGSXY3WFXU773XA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:54.116296228 (223h54m48.547376359s) [upload=232885]: Next returned nil segment
Aug 18 01:20:54.116312098 (223h54m48.547392229s) [upload=232885]: Waiting for error group managing segments...
Aug 18 01:20:54.420069145 (223h54m48.851149276s) [noise=true , address=64.49.13.155:4915 , piece_id=JZ7N6GIEFNO643AIWZ6Z4ZGXOAZRYGDS35WEDBTUJAGMSDXTGPXQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.864989040 (223h54m49.296069171s) [noise=true , address=104.36.82.23:4459 , piece_id=6UDI3KG365RRERRZ2WOCLPZJPKGJU32YNO4GMZOHHIEMATZ5NXSQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.884574575 (223h54m49.315654706s) [noise=true , address=77.90.31.14:4679 , piece_id=M44XZ7IROIEWSXD6TRUJF4EEOC7C3B67353B4L6GD6JXHTQ42LOQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.901503566 (223h54m49.332583697s) [noise=true , address=104.36.82.36:4629 , piece_id=3Q2Y5YJCMWZUOIRCX7GSSD5RBNA3P7U4I6MG5XLRJDY5DCSAXQHA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.924258746 (223h54m49.355338867s) [noise=true , address=104.36.82.15:4290 , piece_id=ZWEXNPINOSTI2TEMBO6ERE5HPMCZ5OHXY5PZ52P225LS3MWL6VAA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.925720423 (223h54m49.356800554s) [noise=true , address=45.91.116.8:4063 , piece_id=CQIZKY2YAS7PPH7IGCZ62MY3UIIAFCK6CO4IEL4ITZ6OYTHDVOPQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.928315268 (223h54m49.359395399s) [noise=true , address=104.36.82.14:4228 , piece_id=2E4FIXOY2RAX4BUTYTW66HSFH3HFGNQYLHIRH2H5JUO3RCZDYQEQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.940016547 (223h54m49.371096678s) [noise=true , address=104.36.82.35:4587 , piece_id=4IDMSU4AGF2EXSXU3VJP23J47DBV2BX2WNXI7Q3SRETDCOHGTSDA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.974323059 (223h54m49.40540319s) [noise=true , address=104.36.82.17:4359 , piece_id=DHYNAHQ3NAJURDPLZJJY3A7IMOXWQXSI7T5GCODTEKGXPIRBH3ZA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.993699504 (223h54m49.424779635s) [noise=true , address=45.91.116.9:4265 , piece_id=XRCTSMY2KBYSFD7XCAZRQLG2ZBFSTVQ4JHWOLTGSXY3WFXU773XA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.997353635 (223h54m49.428433766s) [noise=true , address=104.36.82.21:4478 , piece_id=IY5KC377HYAU2XFEH2VG3SHTWCFGK54KOUEUZQ5TEZQBOZXAMY7A, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.017027348 (223h54m49.448107479s) [noise=true , address=77.90.31.12:4614 , piece_id=HD7OC5VPWMGFYCEIX7KF6YKUZG4PA7KWVYSQAMRGZFV4X63DJFWQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.031039219 (223h54m49.46211935s) [noise=true , address=77.90.31.16:4759 , piece_id=22ZGABIKYBNOOWUZ2MCBWHX5ETZMUB6NDKQ35CU7NYA4POGXXKHQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.037083404 (223h54m49.468163525s) [noise=true , address=104.36.82.10:4081 , piece_id=B7H4OREJMPRHBBPKVZJKYYN72M3Y5RFSVGRBHPNYQL6KKUOMIWTQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.037108391 (223h54m49.468188522s) [seg_pos={0 0}, upload=232885]: Segment reached optimal threshold of 14 pieces.
Aug 18 01:20:55.037297984 (223h54m49.468378115s) [noise=true , address=77.90.31.13:4654 , piece_id=O53RNB3HMLVU5NJH4SK6JDKCQXHSB5JKOQ7Z76ENS3NIG4SVR5WQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8): protocol: expected piece hash; context canceled; EOF
Aug 18 01:20:55.037322210 (223h54m49.468402341s) [noise=true , address=104.36.82.8:4991 , piece_id=Y34CYOMWJ3MEPB2IRJJDGNCPHTNJXQREYBZOLSPDCP3WL7DBZ77A, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qhGin74NgTpgUFEFrMdhXaQC3v17PefWnKgLSotok56yRoxZx): protocol: write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection; write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection
Aug 18 01:20:55.037351246 (223h54m49.468431377s) [noise=true , address=45.91.116.6:4999 , piece_id=2TDE7ULW6NDHEPOAMLRJJZ473HU23XBM5EFXZSUBTKL4YCO5J5JA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12evc8vF5f1Z7cPrrC7G7BsGuDWjzttAE2FsQciV7nztBDmrCZB): protocol: write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection; write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection
Aug 18 01:20:55.037400019 (223h54m49.46848015s) [noise=true , address=77.90.31.15:4704 , piece_id=UVZKCHAAV47PGZTXXRETQAKEV5UUMRAHN6MLRCDYAWL7FQLDFWKQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: expected piece hash; context canceled; EOF
Aug 18 01:20:55.037412794 (223h54m49.468492925s) [seg_pos={0 0}, upload=232885]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 01:20:55.037468010 (223h54m49.468548141s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 01:20:55.037471677 (223h54m49.468551808s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 01:20:55.389966548 (223h54m49.821046729s) [upload=232885]: Done uploading segments...
Aug 18 01:20:55.389990333 (223h54m49.821070504s) [upload=232885]: Upload finished. err: <nil>
Duration: 6.136107018s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......................................XX.....X..X..........] duration:
2.005853987s
FAIL (2025-08-18 01:47:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 01:38:16.026930657 (224h12m10.458010788s) [upload=233187]: Starting upload Aug 18 01:38:16.026975272 (224h12m10.458055403s) [upload=233187]: Done starting upload Aug 18 01:38:16.027021701 (224h12m10.458101822s) [upload=233187]: Uploading segments... Aug 18 01:38:16.027057609 (224h12m10.45813773s) [upload=233187]: Got next segment. Inline: true Aug 18 01:38:16.027061897 (224h12m10.458142028s) [upload=233187]: Waiting for error group managing segments... Aug 18 01:38:16.027094901 (224h12m10.458175032s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:38:16.027098749 (224h12m10.45817887s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 01:38:16.027101223 (224h12m10.458181354s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 01:38:16.331231433 (224h12m10.762311564s) [upload=233187]: Done uploading segments... Aug 18 01:38:16.331248626 (224h12m10.762328747s) [upload=233187]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.005873384s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X................X....................................] duration:
6.120664173s
FAIL (2025-08-18 01:47:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 01:20:52.452488492 (223h54m46.883568644s) [upload=232885]: Starting upload
Aug 18 01:20:52.452565580 (223h54m46.883645711s) [upload=232885]: Done starting upload
Aug 18 01:20:52.452625986 (223h54m46.883706117s) [upload=232885]: Uploading segments...
Aug 18 01:20:52.452770703 (223h54m46.883850834s) [upload=232885]: Got next segment. Inline: false
Aug 18 01:20:52.452823614 (223h54m46.883903736s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 01:20:52.452827682 (223h54m46.883907813s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 01:20:52.921867859 (223h54m47.35294803s) [seg_pos={0 0}, upload=232885]: Begin upload segment...
Aug 18 01:20:52.921915100 (223h54m47.352995231s) [seg_pos={0 0}, upload=232885]: Done begin upload segment.
Aug 18 01:20:52.921937854 (223h54m47.353017985s) [noise=true , address=64.49.13.155:4915 , piece_id=JZ7N6GIEFNO643AIWZ6Z4ZGXOAZRYGDS35WEDBTUJAGMSDXTGPXQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.921999131 (223h54m47.353079262s) [noise=true , address=104.36.82.21:4478 , piece_id=IY5KC377HYAU2XFEH2VG3SHTWCFGK54KOUEUZQ5TEZQBOZXAMY7A, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922310636 (223h54m47.353390767s) [noise=true , address=77.90.31.13:4654 , piece_id=O53RNB3HMLVU5NJH4SK6JDKCQXHSB5JKOQ7Z76ENS3NIG4SVR5WQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922421298 (223h54m47.353501419s) [noise=true , address=104.36.82.14:4228 , piece_id=2E4FIXOY2RAX4BUTYTW66HSFH3HFGNQYLHIRH2H5JUO3RCZDYQEQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922635819 (223h54m47.35371594s) [noise=true , address=104.36.82.17:4359 , piece_id=DHYNAHQ3NAJURDPLZJJY3A7IMOXWQXSI7T5GCODTEKGXPIRBH3ZA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922706264 (223h54m47.353786385s) [noise=true , address=104.36.82.23:4459 , piece_id=6UDI3KG365RRERRZ2WOCLPZJPKGJU32YNO4GMZOHHIEMATZ5NXSQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922970529 (223h54m47.35405066s) [noise=true , address=77.90.31.15:4704 , piece_id=UVZKCHAAV47PGZTXXRETQAKEV5UUMRAHN6MLRCDYAWL7FQLDFWKQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923017830 (223h54m47.354097961s) [noise=true , address=45.91.116.8:4063 , piece_id=CQIZKY2YAS7PPH7IGCZ62MY3UIIAFCK6CO4IEL4ITZ6OYTHDVOPQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923248390 (223h54m47.354328521s) [noise=true , address=104.36.82.15:4290 , piece_id=ZWEXNPINOSTI2TEMBO6ERE5HPMCZ5OHXY5PZ52P225LS3MWL6VAA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923295100 (223h54m47.354375221s) [noise=true , address=77.90.31.12:4614 , piece_id=HD7OC5VPWMGFYCEIX7KF6YKUZG4PA7KWVYSQAMRGZFV4X63DJFWQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923576468 (223h54m47.354656599s) [noise=true , address=104.36.82.35:4587 , piece_id=4IDMSU4AGF2EXSXU3VJP23J47DBV2BX2WNXI7Q3SRETDCOHGTSDA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923584394 (223h54m47.354664525s) [noise=true , address=104.36.82.10:4081 , piece_id=B7H4OREJMPRHBBPKVZJKYYN72M3Y5RFSVGRBHPNYQL6KKUOMIWTQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923870110 (223h54m47.354950231s) [noise=true , address=104.36.82.36:4629 , piece_id=3Q2Y5YJCMWZUOIRCX7GSSD5RBNA3P7U4I6MG5XLRJDY5DCSAXQHA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924098226 (223h54m47.355178358s) [noise=true , address=104.36.82.8:4991 , piece_id=Y34CYOMWJ3MEPB2IRJJDGNCPHTNJXQREYBZOLSPDCP3WL7DBZ77A, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924351632 (223h54m47.355431763s) [noise=true , address=45.91.116.6:4999 , piece_id=2TDE7ULW6NDHEPOAMLRJJZ473HU23XBM5EFXZSUBTKL4YCO5J5JA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924680081 (223h54m47.355760212s) [noise=true , address=77.90.31.14:4679 , piece_id=M44XZ7IROIEWSXD6TRUJF4EEOC7C3B67353B4L6GD6JXHTQ42LOQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.925734468 (223h54m47.356814599s) [noise=true , address=77.90.31.16:4759 , piece_id=22ZGABIKYBNOOWUZ2MCBWHX5ETZMUB6NDKQ35CU7NYA4POGXXKHQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.925969748 (223h54m47.357049879s) [noise=true , address=45.91.116.9:4265 , piece_id=XRCTSMY2KBYSFD7XCAZRQLG2ZBFSTVQ4JHWOLTGSXY3WFXU773XA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:54.116296228 (223h54m48.547376359s) [upload=232885]: Next returned nil segment
Aug 18 01:20:54.116312098 (223h54m48.547392229s) [upload=232885]: Waiting for error group managing segments...
Aug 18 01:20:54.420069145 (223h54m48.851149276s) [noise=true , address=64.49.13.155:4915 , piece_id=JZ7N6GIEFNO643AIWZ6Z4ZGXOAZRYGDS35WEDBTUJAGMSDXTGPXQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.864989040 (223h54m49.296069171s) [noise=true , address=104.36.82.23:4459 , piece_id=6UDI3KG365RRERRZ2WOCLPZJPKGJU32YNO4GMZOHHIEMATZ5NXSQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.884574575 (223h54m49.315654706s) [noise=true , address=77.90.31.14:4679 , piece_id=M44XZ7IROIEWSXD6TRUJF4EEOC7C3B67353B4L6GD6JXHTQ42LOQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.901503566 (223h54m49.332583697s) [noise=true , address=104.36.82.36:4629 , piece_id=3Q2Y5YJCMWZUOIRCX7GSSD5RBNA3P7U4I6MG5XLRJDY5DCSAXQHA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.924258746 (223h54m49.355338867s) [noise=true , address=104.36.82.15:4290 , piece_id=ZWEXNPINOSTI2TEMBO6ERE5HPMCZ5OHXY5PZ52P225LS3MWL6VAA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.925720423 (223h54m49.356800554s) [noise=true , address=45.91.116.8:4063 , piece_id=CQIZKY2YAS7PPH7IGCZ62MY3UIIAFCK6CO4IEL4ITZ6OYTHDVOPQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.928315268 (223h54m49.359395399s) [noise=true , address=104.36.82.14:4228 , piece_id=2E4FIXOY2RAX4BUTYTW66HSFH3HFGNQYLHIRH2H5JUO3RCZDYQEQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.940016547 (223h54m49.371096678s) [noise=true , address=104.36.82.35:4587 , piece_id=4IDMSU4AGF2EXSXU3VJP23J47DBV2BX2WNXI7Q3SRETDCOHGTSDA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.974323059 (223h54m49.40540319s) [noise=true , address=104.36.82.17:4359 , piece_id=DHYNAHQ3NAJURDPLZJJY3A7IMOXWQXSI7T5GCODTEKGXPIRBH3ZA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.993699504 (223h54m49.424779635s) [noise=true , address=45.91.116.9:4265 , piece_id=XRCTSMY2KBYSFD7XCAZRQLG2ZBFSTVQ4JHWOLTGSXY3WFXU773XA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.997353635 (223h54m49.428433766s) [noise=true , address=104.36.82.21:4478 , piece_id=IY5KC377HYAU2XFEH2VG3SHTWCFGK54KOUEUZQ5TEZQBOZXAMY7A, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.017027348 (223h54m49.448107479s) [noise=true , address=77.90.31.12:4614 , piece_id=HD7OC5VPWMGFYCEIX7KF6YKUZG4PA7KWVYSQAMRGZFV4X63DJFWQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.031039219 (223h54m49.46211935s) [noise=true , address=77.90.31.16:4759 , piece_id=22ZGABIKYBNOOWUZ2MCBWHX5ETZMUB6NDKQ35CU7NYA4POGXXKHQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.037083404 (223h54m49.468163525s) [noise=true , address=104.36.82.10:4081 , piece_id=B7H4OREJMPRHBBPKVZJKYYN72M3Y5RFSVGRBHPNYQL6KKUOMIWTQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.037108391 (223h54m49.468188522s) [seg_pos={0 0}, upload=232885]: Segment reached optimal threshold of 14 pieces.
Aug 18 01:20:55.037297984 (223h54m49.468378115s) [noise=true , address=77.90.31.13:4654 , piece_id=O53RNB3HMLVU5NJH4SK6JDKCQXHSB5JKOQ7Z76ENS3NIG4SVR5WQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8): protocol: expected piece hash; context canceled; EOF
Aug 18 01:20:55.037322210 (223h54m49.468402341s) [noise=true , address=104.36.82.8:4991 , piece_id=Y34CYOMWJ3MEPB2IRJJDGNCPHTNJXQREYBZOLSPDCP3WL7DBZ77A, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qhGin74NgTpgUFEFrMdhXaQC3v17PefWnKgLSotok56yRoxZx): protocol: write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection; write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection
Aug 18 01:20:55.037351246 (223h54m49.468431377s) [noise=true , address=45.91.116.6:4999 , piece_id=2TDE7ULW6NDHEPOAMLRJJZ473HU23XBM5EFXZSUBTKL4YCO5J5JA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12evc8vF5f1Z7cPrrC7G7BsGuDWjzttAE2FsQciV7nztBDmrCZB): protocol: write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection; write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection
Aug 18 01:20:55.037400019 (223h54m49.46848015s) [noise=true , address=77.90.31.15:4704 , piece_id=UVZKCHAAV47PGZTXXRETQAKEV5UUMRAHN6MLRCDYAWL7FQLDFWKQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: expected piece hash; context canceled; EOF
Aug 18 01:20:55.037412794 (223h54m49.468492925s) [seg_pos={0 0}, upload=232885]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 01:20:55.037468010 (223h54m49.468548141s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 01:20:55.037471677 (223h54m49.468551808s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 01:20:55.389966548 (223h54m49.821046729s) [upload=232885]: Done uploading segments...
Aug 18 01:20:55.389990333 (223h54m49.821070504s) [upload=232885]: Upload finished. err: <nil>
Duration: 6.120697989s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X................X...................................] duration:
6.418464809s
FAIL (2025-08-18 01:46:43 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 01:20:52.452488492 (223h54m46.883568644s) [upload=232885]: Starting upload
Aug 18 01:20:52.452565580 (223h54m46.883645711s) [upload=232885]: Done starting upload
Aug 18 01:20:52.452625986 (223h54m46.883706117s) [upload=232885]: Uploading segments...
Aug 18 01:20:52.452770703 (223h54m46.883850834s) [upload=232885]: Got next segment. Inline: false
Aug 18 01:20:52.452823614 (223h54m46.883903736s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 01:20:52.452827682 (223h54m46.883907813s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 01:20:52.921867859 (223h54m47.35294803s) [seg_pos={0 0}, upload=232885]: Begin upload segment...
Aug 18 01:20:52.921915100 (223h54m47.352995231s) [seg_pos={0 0}, upload=232885]: Done begin upload segment.
Aug 18 01:20:52.921937854 (223h54m47.353017985s) [noise=true , address=64.49.13.155:4915 , piece_id=JZ7N6GIEFNO643AIWZ6Z4ZGXOAZRYGDS35WEDBTUJAGMSDXTGPXQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.921999131 (223h54m47.353079262s) [noise=true , address=104.36.82.21:4478 , piece_id=IY5KC377HYAU2XFEH2VG3SHTWCFGK54KOUEUZQ5TEZQBOZXAMY7A, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922310636 (223h54m47.353390767s) [noise=true , address=77.90.31.13:4654 , piece_id=O53RNB3HMLVU5NJH4SK6JDKCQXHSB5JKOQ7Z76ENS3NIG4SVR5WQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922421298 (223h54m47.353501419s) [noise=true , address=104.36.82.14:4228 , piece_id=2E4FIXOY2RAX4BUTYTW66HSFH3HFGNQYLHIRH2H5JUO3RCZDYQEQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922635819 (223h54m47.35371594s) [noise=true , address=104.36.82.17:4359 , piece_id=DHYNAHQ3NAJURDPLZJJY3A7IMOXWQXSI7T5GCODTEKGXPIRBH3ZA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922706264 (223h54m47.353786385s) [noise=true , address=104.36.82.23:4459 , piece_id=6UDI3KG365RRERRZ2WOCLPZJPKGJU32YNO4GMZOHHIEMATZ5NXSQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922970529 (223h54m47.35405066s) [noise=true , address=77.90.31.15:4704 , piece_id=UVZKCHAAV47PGZTXXRETQAKEV5UUMRAHN6MLRCDYAWL7FQLDFWKQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923017830 (223h54m47.354097961s) [noise=true , address=45.91.116.8:4063 , piece_id=CQIZKY2YAS7PPH7IGCZ62MY3UIIAFCK6CO4IEL4ITZ6OYTHDVOPQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923248390 (223h54m47.354328521s) [noise=true , address=104.36.82.15:4290 , piece_id=ZWEXNPINOSTI2TEMBO6ERE5HPMCZ5OHXY5PZ52P225LS3MWL6VAA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923295100 (223h54m47.354375221s) [noise=true , address=77.90.31.12:4614 , piece_id=HD7OC5VPWMGFYCEIX7KF6YKUZG4PA7KWVYSQAMRGZFV4X63DJFWQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923576468 (223h54m47.354656599s) [noise=true , address=104.36.82.35:4587 , piece_id=4IDMSU4AGF2EXSXU3VJP23J47DBV2BX2WNXI7Q3SRETDCOHGTSDA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923584394 (223h54m47.354664525s) [noise=true , address=104.36.82.10:4081 , piece_id=B7H4OREJMPRHBBPKVZJKYYN72M3Y5RFSVGRBHPNYQL6KKUOMIWTQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923870110 (223h54m47.354950231s) [noise=true , address=104.36.82.36:4629 , piece_id=3Q2Y5YJCMWZUOIRCX7GSSD5RBNA3P7U4I6MG5XLRJDY5DCSAXQHA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924098226 (223h54m47.355178358s) [noise=true , address=104.36.82.8:4991 , piece_id=Y34CYOMWJ3MEPB2IRJJDGNCPHTNJXQREYBZOLSPDCP3WL7DBZ77A, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924351632 (223h54m47.355431763s) [noise=true , address=45.91.116.6:4999 , piece_id=2TDE7ULW6NDHEPOAMLRJJZ473HU23XBM5EFXZSUBTKL4YCO5J5JA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924680081 (223h54m47.355760212s) [noise=true , address=77.90.31.14:4679 , piece_id=M44XZ7IROIEWSXD6TRUJF4EEOC7C3B67353B4L6GD6JXHTQ42LOQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.925734468 (223h54m47.356814599s) [noise=true , address=77.90.31.16:4759 , piece_id=22ZGABIKYBNOOWUZ2MCBWHX5ETZMUB6NDKQ35CU7NYA4POGXXKHQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.925969748 (223h54m47.357049879s) [noise=true , address=45.91.116.9:4265 , piece_id=XRCTSMY2KBYSFD7XCAZRQLG2ZBFSTVQ4JHWOLTGSXY3WFXU773XA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:54.116296228 (223h54m48.547376359s) [upload=232885]: Next returned nil segment
Aug 18 01:20:54.116312098 (223h54m48.547392229s) [upload=232885]: Waiting for error group managing segments...
Aug 18 01:20:54.420069145 (223h54m48.851149276s) [noise=true , address=64.49.13.155:4915 , piece_id=JZ7N6GIEFNO643AIWZ6Z4ZGXOAZRYGDS35WEDBTUJAGMSDXTGPXQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.864989040 (223h54m49.296069171s) [noise=true , address=104.36.82.23:4459 , piece_id=6UDI3KG365RRERRZ2WOCLPZJPKGJU32YNO4GMZOHHIEMATZ5NXSQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.884574575 (223h54m49.315654706s) [noise=true , address=77.90.31.14:4679 , piece_id=M44XZ7IROIEWSXD6TRUJF4EEOC7C3B67353B4L6GD6JXHTQ42LOQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.901503566 (223h54m49.332583697s) [noise=true , address=104.36.82.36:4629 , piece_id=3Q2Y5YJCMWZUOIRCX7GSSD5RBNA3P7U4I6MG5XLRJDY5DCSAXQHA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.924258746 (223h54m49.355338867s) [noise=true , address=104.36.82.15:4290 , piece_id=ZWEXNPINOSTI2TEMBO6ERE5HPMCZ5OHXY5PZ52P225LS3MWL6VAA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.925720423 (223h54m49.356800554s) [noise=true , address=45.91.116.8:4063 , piece_id=CQIZKY2YAS7PPH7IGCZ62MY3UIIAFCK6CO4IEL4ITZ6OYTHDVOPQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.928315268 (223h54m49.359395399s) [noise=true , address=104.36.82.14:4228 , piece_id=2E4FIXOY2RAX4BUTYTW66HSFH3HFGNQYLHIRH2H5JUO3RCZDYQEQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.940016547 (223h54m49.371096678s) [noise=true , address=104.36.82.35:4587 , piece_id=4IDMSU4AGF2EXSXU3VJP23J47DBV2BX2WNXI7Q3SRETDCOHGTSDA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.974323059 (223h54m49.40540319s) [noise=true , address=104.36.82.17:4359 , piece_id=DHYNAHQ3NAJURDPLZJJY3A7IMOXWQXSI7T5GCODTEKGXPIRBH3ZA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.993699504 (223h54m49.424779635s) [noise=true , address=45.91.116.9:4265 , piece_id=XRCTSMY2KBYSFD7XCAZRQLG2ZBFSTVQ4JHWOLTGSXY3WFXU773XA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.997353635 (223h54m49.428433766s) [noise=true , address=104.36.82.21:4478 , piece_id=IY5KC377HYAU2XFEH2VG3SHTWCFGK54KOUEUZQ5TEZQBOZXAMY7A, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.017027348 (223h54m49.448107479s) [noise=true , address=77.90.31.12:4614 , piece_id=HD7OC5VPWMGFYCEIX7KF6YKUZG4PA7KWVYSQAMRGZFV4X63DJFWQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.031039219 (223h54m49.46211935s) [noise=true , address=77.90.31.16:4759 , piece_id=22ZGABIKYBNOOWUZ2MCBWHX5ETZMUB6NDKQ35CU7NYA4POGXXKHQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.037083404 (223h54m49.468163525s) [noise=true , address=104.36.82.10:4081 , piece_id=B7H4OREJMPRHBBPKVZJKYYN72M3Y5RFSVGRBHPNYQL6KKUOMIWTQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.037108391 (223h54m49.468188522s) [seg_pos={0 0}, upload=232885]: Segment reached optimal threshold of 14 pieces.
Aug 18 01:20:55.037297984 (223h54m49.468378115s) [noise=true , address=77.90.31.13:4654 , piece_id=O53RNB3HMLVU5NJH4SK6JDKCQXHSB5JKOQ7Z76ENS3NIG4SVR5WQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8): protocol: expected piece hash; context canceled; EOF
Aug 18 01:20:55.037322210 (223h54m49.468402341s) [noise=true , address=104.36.82.8:4991 , piece_id=Y34CYOMWJ3MEPB2IRJJDGNCPHTNJXQREYBZOLSPDCP3WL7DBZ77A, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qhGin74NgTpgUFEFrMdhXaQC3v17PefWnKgLSotok56yRoxZx): protocol: write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection; write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection
Aug 18 01:20:55.037351246 (223h54m49.468431377s) [noise=true , address=45.91.116.6:4999 , piece_id=2TDE7ULW6NDHEPOAMLRJJZ473HU23XBM5EFXZSUBTKL4YCO5J5JA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12evc8vF5f1Z7cPrrC7G7BsGuDWjzttAE2FsQciV7nztBDmrCZB): protocol: write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection; write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection
Aug 18 01:20:55.037400019 (223h54m49.46848015s) [noise=true , address=77.90.31.15:4704 , piece_id=UVZKCHAAV47PGZTXXRETQAKEV5UUMRAHN6MLRCDYAWL7FQLDFWKQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: expected piece hash; context canceled; EOF
Aug 18 01:20:55.037412794 (223h54m49.468492925s) [seg_pos={0 0}, upload=232885]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 01:20:55.037468010 (223h54m49.468548141s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 01:20:55.037471677 (223h54m49.468551808s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 01:20:55.389966548 (223h54m49.821046729s) [upload=232885]: Done uploading segments...
Aug 18 01:20:55.389990333 (223h54m49.821070504s) [upload=232885]: Upload finished. err: <nil>
Duration: 6.418488534s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........................................XX.....X..X.........] duration:
2.142888359s
FAIL (2025-08-18 01:46:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 01:38:16.026930657 (224h12m10.458010788s) [upload=233187]: Starting upload Aug 18 01:38:16.026975272 (224h12m10.458055403s) [upload=233187]: Done starting upload Aug 18 01:38:16.027021701 (224h12m10.458101822s) [upload=233187]: Uploading segments... Aug 18 01:38:16.027057609 (224h12m10.45813773s) [upload=233187]: Got next segment. Inline: true Aug 18 01:38:16.027061897 (224h12m10.458142028s) [upload=233187]: Waiting for error group managing segments... Aug 18 01:38:16.027094901 (224h12m10.458175032s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:38:16.027098749 (224h12m10.45817887s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 01:38:16.027101223 (224h12m10.458181354s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 01:38:16.331231433 (224h12m10.762311564s) [upload=233187]: Done uploading segments... Aug 18 01:38:16.331248626 (224h12m10.762328747s) [upload=233187]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.142913056s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X................X..................................] duration:
5.907217047s
FAIL (2025-08-18 01:45:33 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 01:20:52.452488492 (223h54m46.883568644s) [upload=232885]: Starting upload
Aug 18 01:20:52.452565580 (223h54m46.883645711s) [upload=232885]: Done starting upload
Aug 18 01:20:52.452625986 (223h54m46.883706117s) [upload=232885]: Uploading segments...
Aug 18 01:20:52.452770703 (223h54m46.883850834s) [upload=232885]: Got next segment. Inline: false
Aug 18 01:20:52.452823614 (223h54m46.883903736s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 01:20:52.452827682 (223h54m46.883907813s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 01:20:52.921867859 (223h54m47.35294803s) [seg_pos={0 0}, upload=232885]: Begin upload segment...
Aug 18 01:20:52.921915100 (223h54m47.352995231s) [seg_pos={0 0}, upload=232885]: Done begin upload segment.
Aug 18 01:20:52.921937854 (223h54m47.353017985s) [noise=true , address=64.49.13.155:4915 , piece_id=JZ7N6GIEFNO643AIWZ6Z4ZGXOAZRYGDS35WEDBTUJAGMSDXTGPXQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.921999131 (223h54m47.353079262s) [noise=true , address=104.36.82.21:4478 , piece_id=IY5KC377HYAU2XFEH2VG3SHTWCFGK54KOUEUZQ5TEZQBOZXAMY7A, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922310636 (223h54m47.353390767s) [noise=true , address=77.90.31.13:4654 , piece_id=O53RNB3HMLVU5NJH4SK6JDKCQXHSB5JKOQ7Z76ENS3NIG4SVR5WQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922421298 (223h54m47.353501419s) [noise=true , address=104.36.82.14:4228 , piece_id=2E4FIXOY2RAX4BUTYTW66HSFH3HFGNQYLHIRH2H5JUO3RCZDYQEQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922635819 (223h54m47.35371594s) [noise=true , address=104.36.82.17:4359 , piece_id=DHYNAHQ3NAJURDPLZJJY3A7IMOXWQXSI7T5GCODTEKGXPIRBH3ZA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922706264 (223h54m47.353786385s) [noise=true , address=104.36.82.23:4459 , piece_id=6UDI3KG365RRERRZ2WOCLPZJPKGJU32YNO4GMZOHHIEMATZ5NXSQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922970529 (223h54m47.35405066s) [noise=true , address=77.90.31.15:4704 , piece_id=UVZKCHAAV47PGZTXXRETQAKEV5UUMRAHN6MLRCDYAWL7FQLDFWKQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923017830 (223h54m47.354097961s) [noise=true , address=45.91.116.8:4063 , piece_id=CQIZKY2YAS7PPH7IGCZ62MY3UIIAFCK6CO4IEL4ITZ6OYTHDVOPQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923248390 (223h54m47.354328521s) [noise=true , address=104.36.82.15:4290 , piece_id=ZWEXNPINOSTI2TEMBO6ERE5HPMCZ5OHXY5PZ52P225LS3MWL6VAA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923295100 (223h54m47.354375221s) [noise=true , address=77.90.31.12:4614 , piece_id=HD7OC5VPWMGFYCEIX7KF6YKUZG4PA7KWVYSQAMRGZFV4X63DJFWQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923576468 (223h54m47.354656599s) [noise=true , address=104.36.82.35:4587 , piece_id=4IDMSU4AGF2EXSXU3VJP23J47DBV2BX2WNXI7Q3SRETDCOHGTSDA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923584394 (223h54m47.354664525s) [noise=true , address=104.36.82.10:4081 , piece_id=B7H4OREJMPRHBBPKVZJKYYN72M3Y5RFSVGRBHPNYQL6KKUOMIWTQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923870110 (223h54m47.354950231s) [noise=true , address=104.36.82.36:4629 , piece_id=3Q2Y5YJCMWZUOIRCX7GSSD5RBNA3P7U4I6MG5XLRJDY5DCSAXQHA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924098226 (223h54m47.355178358s) [noise=true , address=104.36.82.8:4991 , piece_id=Y34CYOMWJ3MEPB2IRJJDGNCPHTNJXQREYBZOLSPDCP3WL7DBZ77A, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924351632 (223h54m47.355431763s) [noise=true , address=45.91.116.6:4999 , piece_id=2TDE7ULW6NDHEPOAMLRJJZ473HU23XBM5EFXZSUBTKL4YCO5J5JA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924680081 (223h54m47.355760212s) [noise=true , address=77.90.31.14:4679 , piece_id=M44XZ7IROIEWSXD6TRUJF4EEOC7C3B67353B4L6GD6JXHTQ42LOQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.925734468 (223h54m47.356814599s) [noise=true , address=77.90.31.16:4759 , piece_id=22ZGABIKYBNOOWUZ2MCBWHX5ETZMUB6NDKQ35CU7NYA4POGXXKHQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.925969748 (223h54m47.357049879s) [noise=true , address=45.91.116.9:4265 , piece_id=XRCTSMY2KBYSFD7XCAZRQLG2ZBFSTVQ4JHWOLTGSXY3WFXU773XA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:54.116296228 (223h54m48.547376359s) [upload=232885]: Next returned nil segment
Aug 18 01:20:54.116312098 (223h54m48.547392229s) [upload=232885]: Waiting for error group managing segments...
Aug 18 01:20:54.420069145 (223h54m48.851149276s) [noise=true , address=64.49.13.155:4915 , piece_id=JZ7N6GIEFNO643AIWZ6Z4ZGXOAZRYGDS35WEDBTUJAGMSDXTGPXQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.864989040 (223h54m49.296069171s) [noise=true , address=104.36.82.23:4459 , piece_id=6UDI3KG365RRERRZ2WOCLPZJPKGJU32YNO4GMZOHHIEMATZ5NXSQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.884574575 (223h54m49.315654706s) [noise=true , address=77.90.31.14:4679 , piece_id=M44XZ7IROIEWSXD6TRUJF4EEOC7C3B67353B4L6GD6JXHTQ42LOQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.901503566 (223h54m49.332583697s) [noise=true , address=104.36.82.36:4629 , piece_id=3Q2Y5YJCMWZUOIRCX7GSSD5RBNA3P7U4I6MG5XLRJDY5DCSAXQHA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.924258746 (223h54m49.355338867s) [noise=true , address=104.36.82.15:4290 , piece_id=ZWEXNPINOSTI2TEMBO6ERE5HPMCZ5OHXY5PZ52P225LS3MWL6VAA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.925720423 (223h54m49.356800554s) [noise=true , address=45.91.116.8:4063 , piece_id=CQIZKY2YAS7PPH7IGCZ62MY3UIIAFCK6CO4IEL4ITZ6OYTHDVOPQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.928315268 (223h54m49.359395399s) [noise=true , address=104.36.82.14:4228 , piece_id=2E4FIXOY2RAX4BUTYTW66HSFH3HFGNQYLHIRH2H5JUO3RCZDYQEQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.940016547 (223h54m49.371096678s) [noise=true , address=104.36.82.35:4587 , piece_id=4IDMSU4AGF2EXSXU3VJP23J47DBV2BX2WNXI7Q3SRETDCOHGTSDA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.974323059 (223h54m49.40540319s) [noise=true , address=104.36.82.17:4359 , piece_id=DHYNAHQ3NAJURDPLZJJY3A7IMOXWQXSI7T5GCODTEKGXPIRBH3ZA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.993699504 (223h54m49.424779635s) [noise=true , address=45.91.116.9:4265 , piece_id=XRCTSMY2KBYSFD7XCAZRQLG2ZBFSTVQ4JHWOLTGSXY3WFXU773XA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.997353635 (223h54m49.428433766s) [noise=true , address=104.36.82.21:4478 , piece_id=IY5KC377HYAU2XFEH2VG3SHTWCFGK54KOUEUZQ5TEZQBOZXAMY7A, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.017027348 (223h54m49.448107479s) [noise=true , address=77.90.31.12:4614 , piece_id=HD7OC5VPWMGFYCEIX7KF6YKUZG4PA7KWVYSQAMRGZFV4X63DJFWQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.031039219 (223h54m49.46211935s) [noise=true , address=77.90.31.16:4759 , piece_id=22ZGABIKYBNOOWUZ2MCBWHX5ETZMUB6NDKQ35CU7NYA4POGXXKHQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.037083404 (223h54m49.468163525s) [noise=true , address=104.36.82.10:4081 , piece_id=B7H4OREJMPRHBBPKVZJKYYN72M3Y5RFSVGRBHPNYQL6KKUOMIWTQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.037108391 (223h54m49.468188522s) [seg_pos={0 0}, upload=232885]: Segment reached optimal threshold of 14 pieces.
Aug 18 01:20:55.037297984 (223h54m49.468378115s) [noise=true , address=77.90.31.13:4654 , piece_id=O53RNB3HMLVU5NJH4SK6JDKCQXHSB5JKOQ7Z76ENS3NIG4SVR5WQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8): protocol: expected piece hash; context canceled; EOF
Aug 18 01:20:55.037322210 (223h54m49.468402341s) [noise=true , address=104.36.82.8:4991 , piece_id=Y34CYOMWJ3MEPB2IRJJDGNCPHTNJXQREYBZOLSPDCP3WL7DBZ77A, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qhGin74NgTpgUFEFrMdhXaQC3v17PefWnKgLSotok56yRoxZx): protocol: write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection; write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection
Aug 18 01:20:55.037351246 (223h54m49.468431377s) [noise=true , address=45.91.116.6:4999 , piece_id=2TDE7ULW6NDHEPOAMLRJJZ473HU23XBM5EFXZSUBTKL4YCO5J5JA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12evc8vF5f1Z7cPrrC7G7BsGuDWjzttAE2FsQciV7nztBDmrCZB): protocol: write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection; write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection
Aug 18 01:20:55.037400019 (223h54m49.46848015s) [noise=true , address=77.90.31.15:4704 , piece_id=UVZKCHAAV47PGZTXXRETQAKEV5UUMRAHN6MLRCDYAWL7FQLDFWKQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: expected piece hash; context canceled; EOF
Aug 18 01:20:55.037412794 (223h54m49.468492925s) [seg_pos={0 0}, upload=232885]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 01:20:55.037468010 (223h54m49.468548141s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 01:20:55.037471677 (223h54m49.468551808s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 01:20:55.389966548 (223h54m49.821046729s) [upload=232885]: Done uploading segments...
Aug 18 01:20:55.389990333 (223h54m49.821070504s) [upload=232885]: Upload finished. err: <nil>
Duration: 5.907246513s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........................................XX.....X..X........] duration:
2.00815968s
FAIL (2025-08-18 01:45:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 01:38:16.026930657 (224h12m10.458010788s) [upload=233187]: Starting upload Aug 18 01:38:16.026975272 (224h12m10.458055403s) [upload=233187]: Done starting upload Aug 18 01:38:16.027021701 (224h12m10.458101822s) [upload=233187]: Uploading segments... Aug 18 01:38:16.027057609 (224h12m10.45813773s) [upload=233187]: Got next segment. Inline: true Aug 18 01:38:16.027061897 (224h12m10.458142028s) [upload=233187]: Waiting for error group managing segments... Aug 18 01:38:16.027094901 (224h12m10.458175032s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:38:16.027098749 (224h12m10.45817887s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 01:38:16.027101223 (224h12m10.458181354s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 01:38:16.331231433 (224h12m10.762311564s) [upload=233187]: Done uploading segments... Aug 18 01:38:16.331248626 (224h12m10.762328747s) [upload=233187]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.008186622s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X................X.................................] duration:
5.857181346s
FAIL (2025-08-18 01:45:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 01:20:52.452488492 (223h54m46.883568644s) [upload=232885]: Starting upload
Aug 18 01:20:52.452565580 (223h54m46.883645711s) [upload=232885]: Done starting upload
Aug 18 01:20:52.452625986 (223h54m46.883706117s) [upload=232885]: Uploading segments...
Aug 18 01:20:52.452770703 (223h54m46.883850834s) [upload=232885]: Got next segment. Inline: false
Aug 18 01:20:52.452823614 (223h54m46.883903736s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 01:20:52.452827682 (223h54m46.883907813s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 01:20:52.921867859 (223h54m47.35294803s) [seg_pos={0 0}, upload=232885]: Begin upload segment...
Aug 18 01:20:52.921915100 (223h54m47.352995231s) [seg_pos={0 0}, upload=232885]: Done begin upload segment.
Aug 18 01:20:52.921937854 (223h54m47.353017985s) [noise=true , address=64.49.13.155:4915 , piece_id=JZ7N6GIEFNO643AIWZ6Z4ZGXOAZRYGDS35WEDBTUJAGMSDXTGPXQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.921999131 (223h54m47.353079262s) [noise=true , address=104.36.82.21:4478 , piece_id=IY5KC377HYAU2XFEH2VG3SHTWCFGK54KOUEUZQ5TEZQBOZXAMY7A, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922310636 (223h54m47.353390767s) [noise=true , address=77.90.31.13:4654 , piece_id=O53RNB3HMLVU5NJH4SK6JDKCQXHSB5JKOQ7Z76ENS3NIG4SVR5WQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922421298 (223h54m47.353501419s) [noise=true , address=104.36.82.14:4228 , piece_id=2E4FIXOY2RAX4BUTYTW66HSFH3HFGNQYLHIRH2H5JUO3RCZDYQEQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922635819 (223h54m47.35371594s) [noise=true , address=104.36.82.17:4359 , piece_id=DHYNAHQ3NAJURDPLZJJY3A7IMOXWQXSI7T5GCODTEKGXPIRBH3ZA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922706264 (223h54m47.353786385s) [noise=true , address=104.36.82.23:4459 , piece_id=6UDI3KG365RRERRZ2WOCLPZJPKGJU32YNO4GMZOHHIEMATZ5NXSQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922970529 (223h54m47.35405066s) [noise=true , address=77.90.31.15:4704 , piece_id=UVZKCHAAV47PGZTXXRETQAKEV5UUMRAHN6MLRCDYAWL7FQLDFWKQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923017830 (223h54m47.354097961s) [noise=true , address=45.91.116.8:4063 , piece_id=CQIZKY2YAS7PPH7IGCZ62MY3UIIAFCK6CO4IEL4ITZ6OYTHDVOPQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923248390 (223h54m47.354328521s) [noise=true , address=104.36.82.15:4290 , piece_id=ZWEXNPINOSTI2TEMBO6ERE5HPMCZ5OHXY5PZ52P225LS3MWL6VAA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923295100 (223h54m47.354375221s) [noise=true , address=77.90.31.12:4614 , piece_id=HD7OC5VPWMGFYCEIX7KF6YKUZG4PA7KWVYSQAMRGZFV4X63DJFWQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923576468 (223h54m47.354656599s) [noise=true , address=104.36.82.35:4587 , piece_id=4IDMSU4AGF2EXSXU3VJP23J47DBV2BX2WNXI7Q3SRETDCOHGTSDA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923584394 (223h54m47.354664525s) [noise=true , address=104.36.82.10:4081 , piece_id=B7H4OREJMPRHBBPKVZJKYYN72M3Y5RFSVGRBHPNYQL6KKUOMIWTQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923870110 (223h54m47.354950231s) [noise=true , address=104.36.82.36:4629 , piece_id=3Q2Y5YJCMWZUOIRCX7GSSD5RBNA3P7U4I6MG5XLRJDY5DCSAXQHA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924098226 (223h54m47.355178358s) [noise=true , address=104.36.82.8:4991 , piece_id=Y34CYOMWJ3MEPB2IRJJDGNCPHTNJXQREYBZOLSPDCP3WL7DBZ77A, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924351632 (223h54m47.355431763s) [noise=true , address=45.91.116.6:4999 , piece_id=2TDE7ULW6NDHEPOAMLRJJZ473HU23XBM5EFXZSUBTKL4YCO5J5JA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924680081 (223h54m47.355760212s) [noise=true , address=77.90.31.14:4679 , piece_id=M44XZ7IROIEWSXD6TRUJF4EEOC7C3B67353B4L6GD6JXHTQ42LOQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.925734468 (223h54m47.356814599s) [noise=true , address=77.90.31.16:4759 , piece_id=22ZGABIKYBNOOWUZ2MCBWHX5ETZMUB6NDKQ35CU7NYA4POGXXKHQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.925969748 (223h54m47.357049879s) [noise=true , address=45.91.116.9:4265 , piece_id=XRCTSMY2KBYSFD7XCAZRQLG2ZBFSTVQ4JHWOLTGSXY3WFXU773XA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:54.116296228 (223h54m48.547376359s) [upload=232885]: Next returned nil segment
Aug 18 01:20:54.116312098 (223h54m48.547392229s) [upload=232885]: Waiting for error group managing segments...
Aug 18 01:20:54.420069145 (223h54m48.851149276s) [noise=true , address=64.49.13.155:4915 , piece_id=JZ7N6GIEFNO643AIWZ6Z4ZGXOAZRYGDS35WEDBTUJAGMSDXTGPXQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.864989040 (223h54m49.296069171s) [noise=true , address=104.36.82.23:4459 , piece_id=6UDI3KG365RRERRZ2WOCLPZJPKGJU32YNO4GMZOHHIEMATZ5NXSQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.884574575 (223h54m49.315654706s) [noise=true , address=77.90.31.14:4679 , piece_id=M44XZ7IROIEWSXD6TRUJF4EEOC7C3B67353B4L6GD6JXHTQ42LOQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.901503566 (223h54m49.332583697s) [noise=true , address=104.36.82.36:4629 , piece_id=3Q2Y5YJCMWZUOIRCX7GSSD5RBNA3P7U4I6MG5XLRJDY5DCSAXQHA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.924258746 (223h54m49.355338867s) [noise=true , address=104.36.82.15:4290 , piece_id=ZWEXNPINOSTI2TEMBO6ERE5HPMCZ5OHXY5PZ52P225LS3MWL6VAA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.925720423 (223h54m49.356800554s) [noise=true , address=45.91.116.8:4063 , piece_id=CQIZKY2YAS7PPH7IGCZ62MY3UIIAFCK6CO4IEL4ITZ6OYTHDVOPQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.928315268 (223h54m49.359395399s) [noise=true , address=104.36.82.14:4228 , piece_id=2E4FIXOY2RAX4BUTYTW66HSFH3HFGNQYLHIRH2H5JUO3RCZDYQEQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.940016547 (223h54m49.371096678s) [noise=true , address=104.36.82.35:4587 , piece_id=4IDMSU4AGF2EXSXU3VJP23J47DBV2BX2WNXI7Q3SRETDCOHGTSDA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.974323059 (223h54m49.40540319s) [noise=true , address=104.36.82.17:4359 , piece_id=DHYNAHQ3NAJURDPLZJJY3A7IMOXWQXSI7T5GCODTEKGXPIRBH3ZA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.993699504 (223h54m49.424779635s) [noise=true , address=45.91.116.9:4265 , piece_id=XRCTSMY2KBYSFD7XCAZRQLG2ZBFSTVQ4JHWOLTGSXY3WFXU773XA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.997353635 (223h54m49.428433766s) [noise=true , address=104.36.82.21:4478 , piece_id=IY5KC377HYAU2XFEH2VG3SHTWCFGK54KOUEUZQ5TEZQBOZXAMY7A, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.017027348 (223h54m49.448107479s) [noise=true , address=77.90.31.12:4614 , piece_id=HD7OC5VPWMGFYCEIX7KF6YKUZG4PA7KWVYSQAMRGZFV4X63DJFWQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.031039219 (223h54m49.46211935s) [noise=true , address=77.90.31.16:4759 , piece_id=22ZGABIKYBNOOWUZ2MCBWHX5ETZMUB6NDKQ35CU7NYA4POGXXKHQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.037083404 (223h54m49.468163525s) [noise=true , address=104.36.82.10:4081 , piece_id=B7H4OREJMPRHBBPKVZJKYYN72M3Y5RFSVGRBHPNYQL6KKUOMIWTQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.037108391 (223h54m49.468188522s) [seg_pos={0 0}, upload=232885]: Segment reached optimal threshold of 14 pieces.
Aug 18 01:20:55.037297984 (223h54m49.468378115s) [noise=true , address=77.90.31.13:4654 , piece_id=O53RNB3HMLVU5NJH4SK6JDKCQXHSB5JKOQ7Z76ENS3NIG4SVR5WQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8): protocol: expected piece hash; context canceled; EOF
Aug 18 01:20:55.037322210 (223h54m49.468402341s) [noise=true , address=104.36.82.8:4991 , piece_id=Y34CYOMWJ3MEPB2IRJJDGNCPHTNJXQREYBZOLSPDCP3WL7DBZ77A, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qhGin74NgTpgUFEFrMdhXaQC3v17PefWnKgLSotok56yRoxZx): protocol: write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection; write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection
Aug 18 01:20:55.037351246 (223h54m49.468431377s) [noise=true , address=45.91.116.6:4999 , piece_id=2TDE7ULW6NDHEPOAMLRJJZ473HU23XBM5EFXZSUBTKL4YCO5J5JA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12evc8vF5f1Z7cPrrC7G7BsGuDWjzttAE2FsQciV7nztBDmrCZB): protocol: write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection; write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection
Aug 18 01:20:55.037400019 (223h54m49.46848015s) [noise=true , address=77.90.31.15:4704 , piece_id=UVZKCHAAV47PGZTXXRETQAKEV5UUMRAHN6MLRCDYAWL7FQLDFWKQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: expected piece hash; context canceled; EOF
Aug 18 01:20:55.037412794 (223h54m49.468492925s) [seg_pos={0 0}, upload=232885]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 01:20:55.037468010 (223h54m49.468548141s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 01:20:55.037471677 (223h54m49.468551808s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 01:20:55.389966548 (223h54m49.821046729s) [upload=232885]: Done uploading segments...
Aug 18 01:20:55.389990333 (223h54m49.821070504s) [upload=232885]: Upload finished. err: <nil>
Duration: 5.85721459s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........................................XX.....X..X.......] duration:
1.974171848s
FAIL (2025-08-18 01:44:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 01:38:16.026930657 (224h12m10.458010788s) [upload=233187]: Starting upload Aug 18 01:38:16.026975272 (224h12m10.458055403s) [upload=233187]: Done starting upload Aug 18 01:38:16.027021701 (224h12m10.458101822s) [upload=233187]: Uploading segments... Aug 18 01:38:16.027057609 (224h12m10.45813773s) [upload=233187]: Got next segment. Inline: true Aug 18 01:38:16.027061897 (224h12m10.458142028s) [upload=233187]: Waiting for error group managing segments... Aug 18 01:38:16.027094901 (224h12m10.458175032s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:38:16.027098749 (224h12m10.45817887s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 01:38:16.027101223 (224h12m10.458181354s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 01:38:16.331231433 (224h12m10.762311564s) [upload=233187]: Done uploading segments... Aug 18 01:38:16.331248626 (224h12m10.762328747s) [upload=233187]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.974199852s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X................X................................] duration:
5.746884336s
FAIL (2025-08-18 01:44:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 01:20:52.452488492 (223h54m46.883568644s) [upload=232885]: Starting upload
Aug 18 01:20:52.452565580 (223h54m46.883645711s) [upload=232885]: Done starting upload
Aug 18 01:20:52.452625986 (223h54m46.883706117s) [upload=232885]: Uploading segments...
Aug 18 01:20:52.452770703 (223h54m46.883850834s) [upload=232885]: Got next segment. Inline: false
Aug 18 01:20:52.452823614 (223h54m46.883903736s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 01:20:52.452827682 (223h54m46.883907813s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 01:20:52.921867859 (223h54m47.35294803s) [seg_pos={0 0}, upload=232885]: Begin upload segment...
Aug 18 01:20:52.921915100 (223h54m47.352995231s) [seg_pos={0 0}, upload=232885]: Done begin upload segment.
Aug 18 01:20:52.921937854 (223h54m47.353017985s) [noise=true , address=64.49.13.155:4915 , piece_id=JZ7N6GIEFNO643AIWZ6Z4ZGXOAZRYGDS35WEDBTUJAGMSDXTGPXQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.921999131 (223h54m47.353079262s) [noise=true , address=104.36.82.21:4478 , piece_id=IY5KC377HYAU2XFEH2VG3SHTWCFGK54KOUEUZQ5TEZQBOZXAMY7A, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922310636 (223h54m47.353390767s) [noise=true , address=77.90.31.13:4654 , piece_id=O53RNB3HMLVU5NJH4SK6JDKCQXHSB5JKOQ7Z76ENS3NIG4SVR5WQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922421298 (223h54m47.353501419s) [noise=true , address=104.36.82.14:4228 , piece_id=2E4FIXOY2RAX4BUTYTW66HSFH3HFGNQYLHIRH2H5JUO3RCZDYQEQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922635819 (223h54m47.35371594s) [noise=true , address=104.36.82.17:4359 , piece_id=DHYNAHQ3NAJURDPLZJJY3A7IMOXWQXSI7T5GCODTEKGXPIRBH3ZA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922706264 (223h54m47.353786385s) [noise=true , address=104.36.82.23:4459 , piece_id=6UDI3KG365RRERRZ2WOCLPZJPKGJU32YNO4GMZOHHIEMATZ5NXSQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922970529 (223h54m47.35405066s) [noise=true , address=77.90.31.15:4704 , piece_id=UVZKCHAAV47PGZTXXRETQAKEV5UUMRAHN6MLRCDYAWL7FQLDFWKQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923017830 (223h54m47.354097961s) [noise=true , address=45.91.116.8:4063 , piece_id=CQIZKY2YAS7PPH7IGCZ62MY3UIIAFCK6CO4IEL4ITZ6OYTHDVOPQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923248390 (223h54m47.354328521s) [noise=true , address=104.36.82.15:4290 , piece_id=ZWEXNPINOSTI2TEMBO6ERE5HPMCZ5OHXY5PZ52P225LS3MWL6VAA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923295100 (223h54m47.354375221s) [noise=true , address=77.90.31.12:4614 , piece_id=HD7OC5VPWMGFYCEIX7KF6YKUZG4PA7KWVYSQAMRGZFV4X63DJFWQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923576468 (223h54m47.354656599s) [noise=true , address=104.36.82.35:4587 , piece_id=4IDMSU4AGF2EXSXU3VJP23J47DBV2BX2WNXI7Q3SRETDCOHGTSDA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923584394 (223h54m47.354664525s) [noise=true , address=104.36.82.10:4081 , piece_id=B7H4OREJMPRHBBPKVZJKYYN72M3Y5RFSVGRBHPNYQL6KKUOMIWTQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923870110 (223h54m47.354950231s) [noise=true , address=104.36.82.36:4629 , piece_id=3Q2Y5YJCMWZUOIRCX7GSSD5RBNA3P7U4I6MG5XLRJDY5DCSAXQHA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924098226 (223h54m47.355178358s) [noise=true , address=104.36.82.8:4991 , piece_id=Y34CYOMWJ3MEPB2IRJJDGNCPHTNJXQREYBZOLSPDCP3WL7DBZ77A, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924351632 (223h54m47.355431763s) [noise=true , address=45.91.116.6:4999 , piece_id=2TDE7ULW6NDHEPOAMLRJJZ473HU23XBM5EFXZSUBTKL4YCO5J5JA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924680081 (223h54m47.355760212s) [noise=true , address=77.90.31.14:4679 , piece_id=M44XZ7IROIEWSXD6TRUJF4EEOC7C3B67353B4L6GD6JXHTQ42LOQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.925734468 (223h54m47.356814599s) [noise=true , address=77.90.31.16:4759 , piece_id=22ZGABIKYBNOOWUZ2MCBWHX5ETZMUB6NDKQ35CU7NYA4POGXXKHQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.925969748 (223h54m47.357049879s) [noise=true , address=45.91.116.9:4265 , piece_id=XRCTSMY2KBYSFD7XCAZRQLG2ZBFSTVQ4JHWOLTGSXY3WFXU773XA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:54.116296228 (223h54m48.547376359s) [upload=232885]: Next returned nil segment
Aug 18 01:20:54.116312098 (223h54m48.547392229s) [upload=232885]: Waiting for error group managing segments...
Aug 18 01:20:54.420069145 (223h54m48.851149276s) [noise=true , address=64.49.13.155:4915 , piece_id=JZ7N6GIEFNO643AIWZ6Z4ZGXOAZRYGDS35WEDBTUJAGMSDXTGPXQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.864989040 (223h54m49.296069171s) [noise=true , address=104.36.82.23:4459 , piece_id=6UDI3KG365RRERRZ2WOCLPZJPKGJU32YNO4GMZOHHIEMATZ5NXSQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.884574575 (223h54m49.315654706s) [noise=true , address=77.90.31.14:4679 , piece_id=M44XZ7IROIEWSXD6TRUJF4EEOC7C3B67353B4L6GD6JXHTQ42LOQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.901503566 (223h54m49.332583697s) [noise=true , address=104.36.82.36:4629 , piece_id=3Q2Y5YJCMWZUOIRCX7GSSD5RBNA3P7U4I6MG5XLRJDY5DCSAXQHA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.924258746 (223h54m49.355338867s) [noise=true , address=104.36.82.15:4290 , piece_id=ZWEXNPINOSTI2TEMBO6ERE5HPMCZ5OHXY5PZ52P225LS3MWL6VAA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.925720423 (223h54m49.356800554s) [noise=true , address=45.91.116.8:4063 , piece_id=CQIZKY2YAS7PPH7IGCZ62MY3UIIAFCK6CO4IEL4ITZ6OYTHDVOPQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.928315268 (223h54m49.359395399s) [noise=true , address=104.36.82.14:4228 , piece_id=2E4FIXOY2RAX4BUTYTW66HSFH3HFGNQYLHIRH2H5JUO3RCZDYQEQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.940016547 (223h54m49.371096678s) [noise=true , address=104.36.82.35:4587 , piece_id=4IDMSU4AGF2EXSXU3VJP23J47DBV2BX2WNXI7Q3SRETDCOHGTSDA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.974323059 (223h54m49.40540319s) [noise=true , address=104.36.82.17:4359 , piece_id=DHYNAHQ3NAJURDPLZJJY3A7IMOXWQXSI7T5GCODTEKGXPIRBH3ZA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.993699504 (223h54m49.424779635s) [noise=true , address=45.91.116.9:4265 , piece_id=XRCTSMY2KBYSFD7XCAZRQLG2ZBFSTVQ4JHWOLTGSXY3WFXU773XA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.997353635 (223h54m49.428433766s) [noise=true , address=104.36.82.21:4478 , piece_id=IY5KC377HYAU2XFEH2VG3SHTWCFGK54KOUEUZQ5TEZQBOZXAMY7A, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.017027348 (223h54m49.448107479s) [noise=true , address=77.90.31.12:4614 , piece_id=HD7OC5VPWMGFYCEIX7KF6YKUZG4PA7KWVYSQAMRGZFV4X63DJFWQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.031039219 (223h54m49.46211935s) [noise=true , address=77.90.31.16:4759 , piece_id=22ZGABIKYBNOOWUZ2MCBWHX5ETZMUB6NDKQ35CU7NYA4POGXXKHQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.037083404 (223h54m49.468163525s) [noise=true , address=104.36.82.10:4081 , piece_id=B7H4OREJMPRHBBPKVZJKYYN72M3Y5RFSVGRBHPNYQL6KKUOMIWTQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.037108391 (223h54m49.468188522s) [seg_pos={0 0}, upload=232885]: Segment reached optimal threshold of 14 pieces.
Aug 18 01:20:55.037297984 (223h54m49.468378115s) [noise=true , address=77.90.31.13:4654 , piece_id=O53RNB3HMLVU5NJH4SK6JDKCQXHSB5JKOQ7Z76ENS3NIG4SVR5WQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8): protocol: expected piece hash; context canceled; EOF
Aug 18 01:20:55.037322210 (223h54m49.468402341s) [noise=true , address=104.36.82.8:4991 , piece_id=Y34CYOMWJ3MEPB2IRJJDGNCPHTNJXQREYBZOLSPDCP3WL7DBZ77A, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qhGin74NgTpgUFEFrMdhXaQC3v17PefWnKgLSotok56yRoxZx): protocol: write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection; write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection
Aug 18 01:20:55.037351246 (223h54m49.468431377s) [noise=true , address=45.91.116.6:4999 , piece_id=2TDE7ULW6NDHEPOAMLRJJZ473HU23XBM5EFXZSUBTKL4YCO5J5JA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12evc8vF5f1Z7cPrrC7G7BsGuDWjzttAE2FsQciV7nztBDmrCZB): protocol: write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection; write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection
Aug 18 01:20:55.037400019 (223h54m49.46848015s) [noise=true , address=77.90.31.15:4704 , piece_id=UVZKCHAAV47PGZTXXRETQAKEV5UUMRAHN6MLRCDYAWL7FQLDFWKQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: expected piece hash; context canceled; EOF
Aug 18 01:20:55.037412794 (223h54m49.468492925s) [seg_pos={0 0}, upload=232885]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 01:20:55.037468010 (223h54m49.468548141s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 01:20:55.037471677 (223h54m49.468551808s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 01:20:55.389966548 (223h54m49.821046729s) [upload=232885]: Done uploading segments...
Aug 18 01:20:55.389990333 (223h54m49.821070504s) [upload=232885]: Upload finished. err: <nil>
Duration: 5.746912209s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........................................XX.....X..X......] duration:
1.921909163s
FAIL (2025-08-18 01:43:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 01:38:16.026930657 (224h12m10.458010788s) [upload=233187]: Starting upload Aug 18 01:38:16.026975272 (224h12m10.458055403s) [upload=233187]: Done starting upload Aug 18 01:38:16.027021701 (224h12m10.458101822s) [upload=233187]: Uploading segments... Aug 18 01:38:16.027057609 (224h12m10.45813773s) [upload=233187]: Got next segment. Inline: true Aug 18 01:38:16.027061897 (224h12m10.458142028s) [upload=233187]: Waiting for error group managing segments... Aug 18 01:38:16.027094901 (224h12m10.458175032s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:38:16.027098749 (224h12m10.45817887s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 01:38:16.027101223 (224h12m10.458181354s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 01:38:16.331231433 (224h12m10.762311564s) [upload=233187]: Done uploading segments... Aug 18 01:38:16.331248626 (224h12m10.762328747s) [upload=233187]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.921934681s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............................................XX.....X..X.....] duration:
1.92228002s
FAIL (2025-08-18 01:43:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 01:38:16.026930657 (224h12m10.458010788s) [upload=233187]: Starting upload Aug 18 01:38:16.026975272 (224h12m10.458055403s) [upload=233187]: Done starting upload Aug 18 01:38:16.027021701 (224h12m10.458101822s) [upload=233187]: Uploading segments... Aug 18 01:38:16.027057609 (224h12m10.45813773s) [upload=233187]: Got next segment. Inline: true Aug 18 01:38:16.027061897 (224h12m10.458142028s) [upload=233187]: Waiting for error group managing segments... Aug 18 01:38:16.027094901 (224h12m10.458175032s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:38:16.027098749 (224h12m10.45817887s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 01:38:16.027101223 (224h12m10.458181354s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 01:38:16.331231433 (224h12m10.762311564s) [upload=233187]: Done uploading segments... Aug 18 01:38:16.331248626 (224h12m10.762328747s) [upload=233187]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.922301952s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X................X...............................] duration:
5.779154702s
FAIL (2025-08-18 01:43:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 01:20:52.452488492 (223h54m46.883568644s) [upload=232885]: Starting upload
Aug 18 01:20:52.452565580 (223h54m46.883645711s) [upload=232885]: Done starting upload
Aug 18 01:20:52.452625986 (223h54m46.883706117s) [upload=232885]: Uploading segments...
Aug 18 01:20:52.452770703 (223h54m46.883850834s) [upload=232885]: Got next segment. Inline: false
Aug 18 01:20:52.452823614 (223h54m46.883903736s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 01:20:52.452827682 (223h54m46.883907813s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 01:20:52.921867859 (223h54m47.35294803s) [seg_pos={0 0}, upload=232885]: Begin upload segment...
Aug 18 01:20:52.921915100 (223h54m47.352995231s) [seg_pos={0 0}, upload=232885]: Done begin upload segment.
Aug 18 01:20:52.921937854 (223h54m47.353017985s) [noise=true , address=64.49.13.155:4915 , piece_id=JZ7N6GIEFNO643AIWZ6Z4ZGXOAZRYGDS35WEDBTUJAGMSDXTGPXQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.921999131 (223h54m47.353079262s) [noise=true , address=104.36.82.21:4478 , piece_id=IY5KC377HYAU2XFEH2VG3SHTWCFGK54KOUEUZQ5TEZQBOZXAMY7A, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922310636 (223h54m47.353390767s) [noise=true , address=77.90.31.13:4654 , piece_id=O53RNB3HMLVU5NJH4SK6JDKCQXHSB5JKOQ7Z76ENS3NIG4SVR5WQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922421298 (223h54m47.353501419s) [noise=true , address=104.36.82.14:4228 , piece_id=2E4FIXOY2RAX4BUTYTW66HSFH3HFGNQYLHIRH2H5JUO3RCZDYQEQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922635819 (223h54m47.35371594s) [noise=true , address=104.36.82.17:4359 , piece_id=DHYNAHQ3NAJURDPLZJJY3A7IMOXWQXSI7T5GCODTEKGXPIRBH3ZA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922706264 (223h54m47.353786385s) [noise=true , address=104.36.82.23:4459 , piece_id=6UDI3KG365RRERRZ2WOCLPZJPKGJU32YNO4GMZOHHIEMATZ5NXSQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.922970529 (223h54m47.35405066s) [noise=true , address=77.90.31.15:4704 , piece_id=UVZKCHAAV47PGZTXXRETQAKEV5UUMRAHN6MLRCDYAWL7FQLDFWKQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923017830 (223h54m47.354097961s) [noise=true , address=45.91.116.8:4063 , piece_id=CQIZKY2YAS7PPH7IGCZ62MY3UIIAFCK6CO4IEL4ITZ6OYTHDVOPQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923248390 (223h54m47.354328521s) [noise=true , address=104.36.82.15:4290 , piece_id=ZWEXNPINOSTI2TEMBO6ERE5HPMCZ5OHXY5PZ52P225LS3MWL6VAA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923295100 (223h54m47.354375221s) [noise=true , address=77.90.31.12:4614 , piece_id=HD7OC5VPWMGFYCEIX7KF6YKUZG4PA7KWVYSQAMRGZFV4X63DJFWQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923576468 (223h54m47.354656599s) [noise=true , address=104.36.82.35:4587 , piece_id=4IDMSU4AGF2EXSXU3VJP23J47DBV2BX2WNXI7Q3SRETDCOHGTSDA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923584394 (223h54m47.354664525s) [noise=true , address=104.36.82.10:4081 , piece_id=B7H4OREJMPRHBBPKVZJKYYN72M3Y5RFSVGRBHPNYQL6KKUOMIWTQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.923870110 (223h54m47.354950231s) [noise=true , address=104.36.82.36:4629 , piece_id=3Q2Y5YJCMWZUOIRCX7GSSD5RBNA3P7U4I6MG5XLRJDY5DCSAXQHA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924098226 (223h54m47.355178358s) [noise=true , address=104.36.82.8:4991 , piece_id=Y34CYOMWJ3MEPB2IRJJDGNCPHTNJXQREYBZOLSPDCP3WL7DBZ77A, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924351632 (223h54m47.355431763s) [noise=true , address=45.91.116.6:4999 , piece_id=2TDE7ULW6NDHEPOAMLRJJZ473HU23XBM5EFXZSUBTKL4YCO5J5JA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.924680081 (223h54m47.355760212s) [noise=true , address=77.90.31.14:4679 , piece_id=M44XZ7IROIEWSXD6TRUJF4EEOC7C3B67353B4L6GD6JXHTQ42LOQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.925734468 (223h54m47.356814599s) [noise=true , address=77.90.31.16:4759 , piece_id=22ZGABIKYBNOOWUZ2MCBWHX5ETZMUB6NDKQ35CU7NYA4POGXXKHQ, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:52.925969748 (223h54m47.357049879s) [noise=true , address=45.91.116.9:4265 , piece_id=XRCTSMY2KBYSFD7XCAZRQLG2ZBFSTVQ4JHWOLTGSXY3WFXU773XA, seg_pos={0 0}, upload=232885]: Uploading piece...
Aug 18 01:20:54.116296228 (223h54m48.547376359s) [upload=232885]: Next returned nil segment
Aug 18 01:20:54.116312098 (223h54m48.547392229s) [upload=232885]: Waiting for error group managing segments...
Aug 18 01:20:54.420069145 (223h54m48.851149276s) [noise=true , address=64.49.13.155:4915 , piece_id=JZ7N6GIEFNO643AIWZ6Z4ZGXOAZRYGDS35WEDBTUJAGMSDXTGPXQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.864989040 (223h54m49.296069171s) [noise=true , address=104.36.82.23:4459 , piece_id=6UDI3KG365RRERRZ2WOCLPZJPKGJU32YNO4GMZOHHIEMATZ5NXSQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.884574575 (223h54m49.315654706s) [noise=true , address=77.90.31.14:4679 , piece_id=M44XZ7IROIEWSXD6TRUJF4EEOC7C3B67353B4L6GD6JXHTQ42LOQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.901503566 (223h54m49.332583697s) [noise=true , address=104.36.82.36:4629 , piece_id=3Q2Y5YJCMWZUOIRCX7GSSD5RBNA3P7U4I6MG5XLRJDY5DCSAXQHA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.924258746 (223h54m49.355338867s) [noise=true , address=104.36.82.15:4290 , piece_id=ZWEXNPINOSTI2TEMBO6ERE5HPMCZ5OHXY5PZ52P225LS3MWL6VAA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.925720423 (223h54m49.356800554s) [noise=true , address=45.91.116.8:4063 , piece_id=CQIZKY2YAS7PPH7IGCZ62MY3UIIAFCK6CO4IEL4ITZ6OYTHDVOPQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.928315268 (223h54m49.359395399s) [noise=true , address=104.36.82.14:4228 , piece_id=2E4FIXOY2RAX4BUTYTW66HSFH3HFGNQYLHIRH2H5JUO3RCZDYQEQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.940016547 (223h54m49.371096678s) [noise=true , address=104.36.82.35:4587 , piece_id=4IDMSU4AGF2EXSXU3VJP23J47DBV2BX2WNXI7Q3SRETDCOHGTSDA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.974323059 (223h54m49.40540319s) [noise=true , address=104.36.82.17:4359 , piece_id=DHYNAHQ3NAJURDPLZJJY3A7IMOXWQXSI7T5GCODTEKGXPIRBH3ZA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.993699504 (223h54m49.424779635s) [noise=true , address=45.91.116.9:4265 , piece_id=XRCTSMY2KBYSFD7XCAZRQLG2ZBFSTVQ4JHWOLTGSXY3WFXU773XA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:54.997353635 (223h54m49.428433766s) [noise=true , address=104.36.82.21:4478 , piece_id=IY5KC377HYAU2XFEH2VG3SHTWCFGK54KOUEUZQ5TEZQBOZXAMY7A, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.017027348 (223h54m49.448107479s) [noise=true , address=77.90.31.12:4614 , piece_id=HD7OC5VPWMGFYCEIX7KF6YKUZG4PA7KWVYSQAMRGZFV4X63DJFWQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.031039219 (223h54m49.46211935s) [noise=true , address=77.90.31.16:4759 , piece_id=22ZGABIKYBNOOWUZ2MCBWHX5ETZMUB6NDKQ35CU7NYA4POGXXKHQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.037083404 (223h54m49.468163525s) [noise=true , address=104.36.82.10:4081 , piece_id=B7H4OREJMPRHBBPKVZJKYYN72M3Y5RFSVGRBHPNYQL6KKUOMIWTQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: <nil>
Aug 18 01:20:55.037108391 (223h54m49.468188522s) [seg_pos={0 0}, upload=232885]: Segment reached optimal threshold of 14 pieces.
Aug 18 01:20:55.037297984 (223h54m49.468378115s) [noise=true , address=77.90.31.13:4654 , piece_id=O53RNB3HMLVU5NJH4SK6JDKCQXHSB5JKOQ7Z76ENS3NIG4SVR5WQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8): protocol: expected piece hash; context canceled; EOF
Aug 18 01:20:55.037322210 (223h54m49.468402341s) [noise=true , address=104.36.82.8:4991 , piece_id=Y34CYOMWJ3MEPB2IRJJDGNCPHTNJXQREYBZOLSPDCP3WL7DBZ77A, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qhGin74NgTpgUFEFrMdhXaQC3v17PefWnKgLSotok56yRoxZx): protocol: write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection; write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38340->104.36.82.8:4991: use of closed network connection
Aug 18 01:20:55.037351246 (223h54m49.468431377s) [noise=true , address=45.91.116.6:4999 , piece_id=2TDE7ULW6NDHEPOAMLRJJZ473HU23XBM5EFXZSUBTKL4YCO5J5JA, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12evc8vF5f1Z7cPrrC7G7BsGuDWjzttAE2FsQciV7nztBDmrCZB): protocol: write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection; write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46310->45.91.116.6:4999: use of closed network connection
Aug 18 01:20:55.037400019 (223h54m49.46848015s) [noise=true , address=77.90.31.15:4704 , piece_id=UVZKCHAAV47PGZTXXRETQAKEV5UUMRAHN6MLRCDYAWL7FQLDFWKQ, seg_pos={0 0}, upload=232885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14tJRdZ1guwwsYwPf3LtENRWqYx2jBQpi7uAMMPaB32Gks9zmj): protocol: expected piece hash; context canceled; EOF
Aug 18 01:20:55.037412794 (223h54m49.468492925s) [seg_pos={0 0}, upload=232885]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 01:20:55.037468010 (223h54m49.468548141s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 01:20:55.037471677 (223h54m49.468551808s) [upload=232885]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 01:20:55.389966548 (223h54m49.821046729s) [upload=232885]: Done uploading segments...
Aug 18 01:20:55.389990333 (223h54m49.821070504s) [upload=232885]: Upload finished. err: <nil>
Duration: 5.779178768s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............................................XX.....X..X....] duration:
1.921272412s
FAIL (2025-08-18 01:42:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 01:38:16.026930657 (224h12m10.458010788s) [upload=233187]: Starting upload Aug 18 01:38:16.026975272 (224h12m10.458055403s) [upload=233187]: Done starting upload Aug 18 01:38:16.027021701 (224h12m10.458101822s) [upload=233187]: Uploading segments... Aug 18 01:38:16.027057609 (224h12m10.45813773s) [upload=233187]: Got next segment. Inline: true Aug 18 01:38:16.027061897 (224h12m10.458142028s) [upload=233187]: Waiting for error group managing segments... Aug 18 01:38:16.027094901 (224h12m10.458175032s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 01:38:16.027098749 (224h12m10.45817887s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 01:38:16.027101223 (224h12m10.458181354s) [upload=233187]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 01:38:16.331231433 (224h12m10.762311564s) [upload=233187]: Done uploading segments... Aug 18 01:38:16.331248626 (224h12m10.762328747s) [upload=233187]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.92129806s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|