Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..................X.....X..X.....X..............X........X..] duration:
5.80253717s
FAIL (2025-08-21 08:41:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:39:29.549231527 (303h13m23.980311648s) [upload=315405]: Starting upload Aug 21 08:39:29.549272336 (303h13m23.980352467s) [upload=315405]: Done starting upload Aug 21 08:39:29.549459815 (303h13m23.980539946s) [upload=315405]: Uploading segments... Aug 21 08:39:29.549502375 (303h13m23.980582506s) [upload=315405]: Got next segment. Inline: false Aug 21 08:39:29.549531000 (303h13m23.980611131s) [upload=315405]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:39:29.549535229 (303h13m23.98061536s) [upload=315405]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 08:39:29.774200435 (303h13m24.205280566s) [upload=315405]: Next segment err: metaclient: Too Many Requests Aug 21 08:39:29.774238508 (303h13m24.205318639s) [upload=315405]: Done uploading segments... Aug 21 08:39:29.774252464 (303h13m24.205332585s) [upload=315405]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.802567408s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [X.X....X......X...X..X......................................] duration:
1.937802366s
FAIL (2025-08-21 08:40:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.937829508s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [X..................X.....X..X.....X..............X........X.] duration:
6.462928598s
FAIL (2025-08-21 08:40:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:39:29.549231527 (303h13m23.980311648s) [upload=315405]: Starting upload Aug 21 08:39:29.549272336 (303h13m23.980352467s) [upload=315405]: Done starting upload Aug 21 08:39:29.549459815 (303h13m23.980539946s) [upload=315405]: Uploading segments... Aug 21 08:39:29.549502375 (303h13m23.980582506s) [upload=315405]: Got next segment. Inline: false Aug 21 08:39:29.549531000 (303h13m23.980611131s) [upload=315405]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:39:29.549535229 (303h13m23.98061536s) [upload=315405]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 08:39:29.774200435 (303h13m24.205280566s) [upload=315405]: Next segment err: metaclient: Too Many Requests Aug 21 08:39:29.774238508 (303h13m24.205318639s) [upload=315405]: Done uploading segments... Aug 21 08:39:29.774252464 (303h13m24.205332585s) [upload=315405]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.462957213s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.X.X....X......X...X..X.....................................] duration:
1.835313904s
FAIL (2025-08-21 08:40:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.835346666s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.X..................X.....X..X.....X..............X........X] duration:
877.792435ms
FAIL (2025-08-21 08:39:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:39:29.549231527 (303h13m23.980311648s) [upload=315405]: Starting upload Aug 21 08:39:29.549272336 (303h13m23.980352467s) [upload=315405]: Done starting upload Aug 21 08:39:29.549459815 (303h13m23.980539946s) [upload=315405]: Uploading segments... Aug 21 08:39:29.549502375 (303h13m23.980582506s) [upload=315405]: Got next segment. Inline: false Aug 21 08:39:29.549531000 (303h13m23.980611131s) [upload=315405]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:39:29.549535229 (303h13m23.98061536s) [upload=315405]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 08:39:29.774200435 (303h13m24.205280566s) [upload=315405]: Next segment err: metaclient: Too Many Requests Aug 21 08:39:29.774238508 (303h13m24.205318639s) [upload=315405]: Done uploading segments... Aug 21 08:39:29.774252464 (303h13m24.205332585s) [upload=315405]: Upload finished. err: metaclient: Too Many Requests
Duration: 877.809106ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..X.X....X......X...X..X....................................] duration:
1.839068878s
FAIL (2025-08-21 08:39:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.839101271s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..X..................X.....X..X.....X..............X........] duration:
5.573515598s
FAIL (2025-08-21 08:38:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 08:32:44.291596413 (303h6m38.722676544s) [upload=315290]: Starting upload
Aug 21 08:32:44.291654895 (303h6m38.722735026s) [upload=315290]: Done starting upload
Aug 21 08:32:44.291758664 (303h6m38.722838815s) [upload=315290]: Uploading segments...
Aug 21 08:32:44.291898331 (303h6m38.722978472s) [upload=315290]: Got next segment. Inline: false
Aug 21 08:32:44.291926134 (303h6m38.723006265s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:32:44.291930582 (303h6m38.723010713s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:32:44.738163778 (303h6m39.169243909s) [seg_pos={0 0}, upload=315290]: Begin upload segment...
Aug 21 08:32:44.738227320 (303h6m39.169307451s) [seg_pos={0 0}, upload=315290]: Done begin upload segment.
Aug 21 08:32:44.738253380 (303h6m39.169333511s) [noise=true , address=45.91.116.11:4123 , piece_id=DQY2VDS6G4IKAHCMZZM56XB7ITWUCYK7IJOQLAQUZX5PU6B64KAA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738284550 (303h6m39.169364681s) [noise=true , address=77.90.31.10:4546 , piece_id=PAWKSB2WXPD5ZTEWSFBXITHJQNCNO6SWZBW674UTN4OZFJ5LHLWQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738659918 (303h6m39.169740049s) [noise=true , address=79.127.201.214:4309 , piece_id=RGQEAB7D4M6ZMHMYBMZZUUO3MWRWNJ2NN5JGSWWCTF4GYOZCU22A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738781741 (303h6m39.169861872s) [noise=true , address=104.36.82.18:4381 , piece_id=6UGBZRYNKWRJLE5P7EXFPEITS6A3TVZ7TO4YQOPBRLP4URFQQWAA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739071375 (303h6m39.170151496s) [noise=true , address=104.36.82.60:4344 , piece_id=VR3M4HZL7BMYP7M7FHEJXF5GC3KV6TEHJR4NK3FIRVGI5ACP4O5A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739109368 (303h6m39.170189519s) [noise=true , address=77.90.31.11:4579 , piece_id=CI4OJMHG6FTRFIWBNY7WU6IZCA4WPQJMPXYBB45F2SLYYK2G57PA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739461611 (303h6m39.170541742s) [noise=true , address=104.36.82.5:4857 , piece_id=X5CGC5D4YMYK7VSDNWNRK6H6HOARSAMIEKNMZJY5UEPLR3QC55VQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739707502 (303h6m39.170787623s) [noise=true , address=77.90.31.21:4892 , piece_id=HT2FX75PM54GJQ5SZVRRBDOFE5LHWNYGUC4375ITHFOVE5RE36FA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739979432 (303h6m39.171059563s) [noise=true , address=79.127.220.98:4428 , piece_id=HEOYTV6HLP7DROD4A5LI52FEPB42LNUDU3DTF2FQ6CAGWSUGQAOA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.740334211 (303h6m39.171414342s) [noise=true , address=45.91.116.14:4201 , piece_id=NKKPHWYDX4CNVJLQKWQNBHX5WG5KTXEE3YDZKXG3TCIEEX3B6Q7A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.740702757 (303h6m39.171782888s) [noise=true , address=77.90.31.18:4823 , piece_id=M6WHF47D2LPGQTWYNQ54X4T54YDVYG45LSPESERPTMO3HGBEKH3Q, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741073696 (303h6m39.172153827s) [noise=true , address=77.90.31.13:4625 , piece_id=7GIUTOH7EMHBQPMGGGR4NKN3OT33ROXRBGTQAPJL6RUYGN66GHJQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741307855 (303h6m39.172387986s) [noise=true , address=104.36.82.23:4470 , piece_id=SNS3SF7ONWF44XRIWOIU6X3UCMBSNRGOVTDLNVYHWOBVU77DTWQA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741570477 (303h6m39.172650608s) [noise=true , address=77.90.31.12:4603 , piece_id=LYGOPXZ2Z4G2X2P57I7IAHMZ4JAWS5M7LIMKII4TU7YESK34H4BA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741776291 (303h6m39.172856422s) [noise=true , address=45.91.116.6:4004 , piece_id=54EGRMVODNBFJG4SSIC5OA6UK7RG7XMGCQ34OB756IYT5Y34XH3A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742098488 (303h6m39.173178619s) [noise=true , address=79.127.219.48:4106 , piece_id=JKVOH7BP7GGGSJICQPAIUPWYXQ4ER64LWHUZJ26QR2CBGNYQSFJA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742361460 (303h6m39.173441591s) [noise=true , address=77.90.31.17:4792 , piece_id=YCHJKRJJPI5XWGDSJFDUIE6QPWBV7FQ7W7ZQWRZLMVLYF4TOLVFQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742575059 (303h6m39.17365519s) [noise=true , address=77.90.31.16:4750 , piece_id=7LU6NJRAMHJ4S7VH5Z43DBVGYJIBQL3TU3DJK2C7FMQMJXWOJYWA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:46.208660569 (303h6m40.63974069s) [upload=315290]: Next returned nil segment
Aug 21 08:32:46.208680407 (303h6m40.639760538s) [upload=315290]: Waiting for error group managing segments...
Aug 21 08:32:46.584651402 (303h6m41.015731534s) [noise=true , address=79.127.220.98:4428 , piece_id=HEOYTV6HLP7DROD4A5LI52FEPB42LNUDU3DTF2FQ6CAGWSUGQAOA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.627652681 (303h6m41.058732812s) [noise=true , address=77.90.31.11:4579 , piece_id=CI4OJMHG6FTRFIWBNY7WU6IZCA4WPQJMPXYBB45F2SLYYK2G57PA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.639164989 (303h6m41.07024512s) [noise=true , address=77.90.31.10:4546 , piece_id=PAWKSB2WXPD5ZTEWSFBXITHJQNCNO6SWZBW674UTN4OZFJ5LHLWQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.644526758 (303h6m41.075606889s) [noise=true , address=45.91.116.6:4004 , piece_id=54EGRMVODNBFJG4SSIC5OA6UK7RG7XMGCQ34OB756IYT5Y34XH3A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.647891717 (303h6m41.078971848s) [noise=true , address=77.90.31.13:4625 , piece_id=7GIUTOH7EMHBQPMGGGR4NKN3OT33ROXRBGTQAPJL6RUYGN66GHJQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.661037670 (303h6m41.092117801s) [noise=true , address=45.91.116.14:4201 , piece_id=NKKPHWYDX4CNVJLQKWQNBHX5WG5KTXEE3YDZKXG3TCIEEX3B6Q7A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.661700518 (303h6m41.092780639s) [noise=true , address=77.90.31.12:4603 , piece_id=LYGOPXZ2Z4G2X2P57I7IAHMZ4JAWS5M7LIMKII4TU7YESK34H4BA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.668984736 (303h6m41.100064867s) [noise=true , address=104.36.82.5:4857 , piece_id=X5CGC5D4YMYK7VSDNWNRK6H6HOARSAMIEKNMZJY5UEPLR3QC55VQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.720272381 (303h6m41.151352502s) [noise=true , address=77.90.31.21:4892 , piece_id=HT2FX75PM54GJQ5SZVRRBDOFE5LHWNYGUC4375ITHFOVE5RE36FA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.727460995 (303h6m41.158541126s) [noise=true , address=104.36.82.60:4344 , piece_id=VR3M4HZL7BMYP7M7FHEJXF5GC3KV6TEHJR4NK3FIRVGI5ACP4O5A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.748559526 (303h6m41.179639657s) [noise=true , address=79.127.219.48:4106 , piece_id=JKVOH7BP7GGGSJICQPAIUPWYXQ4ER64LWHUZJ26QR2CBGNYQSFJA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.751055311 (303h6m41.182135432s) [noise=true , address=77.90.31.16:4750 , piece_id=7LU6NJRAMHJ4S7VH5Z43DBVGYJIBQL3TU3DJK2C7FMQMJXWOJYWA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.805486109 (303h6m41.23656624s) [noise=true , address=77.90.31.18:4823 , piece_id=M6WHF47D2LPGQTWYNQ54X4T54YDVYG45LSPESERPTMO3HGBEKH3Q, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.859109913 (303h6m41.290190044s) [noise=true , address=79.127.201.214:4309 , piece_id=RGQEAB7D4M6ZMHMYBMZZUUO3MWRWNJ2NN5JGSWWCTF4GYOZCU22A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.859129040 (303h6m41.290209171s) [seg_pos={0 0}, upload=315290]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:32:46.859262125 (303h6m41.290342256s) [noise=true , address=77.90.31.17:4792 , piece_id=YCHJKRJJPI5XWGDSJFDUIE6QPWBV7FQ7W7ZQWRZLMVLYF4TOLVFQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SPFgYZnbwjEupjaghfs61qwFM678KNPwpDmRNqV1j2opNgZCN): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859414826 (303h6m41.290494958s) [noise=true , address=104.36.82.23:4470 , piece_id=SNS3SF7ONWF44XRIWOIU6X3UCMBSNRGOVTDLNVYHWOBVU77DTWQA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FT9cn7mxuyJ7xBeCJgyTcJKFRmHEqboqeGWLvygNceEo4LQVF): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859471805 (303h6m41.290551936s) [noise=true , address=104.36.82.18:4381 , piece_id=6UGBZRYNKWRJLE5P7EXFPEITS6A3TVZ7TO4YQOPBRLP4URFQQWAA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RhN3jMBTt6LXsgym5RNMM4CvjhcSRhgjbRvSpE1TQTgQdJi9): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859616393 (303h6m41.290696524s) [noise=true , address=45.91.116.11:4123 , piece_id=DQY2VDS6G4IKAHCMZZM56XB7ITWUCYK7IJOQLAQUZX5PU6B64KAA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kjHfRVsDASQz36zUAHrXsLJausE7UTNzHgiFWpys4bQK21cAE): protocol: write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection; write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection
Aug 21 08:32:46.859628385 (303h6m41.290708516s) [seg_pos={0 0}, upload=315290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:32:46.859704171 (303h6m41.290784302s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:32:46.859708469 (303h6m41.2907886s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:32:47.160630836 (303h6m41.591710967s) [upload=315290]: Done uploading segments...
Aug 21 08:32:47.160650694 (303h6m41.591730826s) [upload=315290]: Upload finished. err: <nil>
Duration: 5.573541637s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...X.X....X......X...X..X...................................] duration:
1.838882543s
FAIL (2025-08-21 08:38:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.838904174s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...X..................X.....X..X.....X..............X.......] duration:
5.637782407s
FAIL (2025-08-21 08:38:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 08:32:44.291596413 (303h6m38.722676544s) [upload=315290]: Starting upload
Aug 21 08:32:44.291654895 (303h6m38.722735026s) [upload=315290]: Done starting upload
Aug 21 08:32:44.291758664 (303h6m38.722838815s) [upload=315290]: Uploading segments...
Aug 21 08:32:44.291898331 (303h6m38.722978472s) [upload=315290]: Got next segment. Inline: false
Aug 21 08:32:44.291926134 (303h6m38.723006265s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:32:44.291930582 (303h6m38.723010713s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:32:44.738163778 (303h6m39.169243909s) [seg_pos={0 0}, upload=315290]: Begin upload segment...
Aug 21 08:32:44.738227320 (303h6m39.169307451s) [seg_pos={0 0}, upload=315290]: Done begin upload segment.
Aug 21 08:32:44.738253380 (303h6m39.169333511s) [noise=true , address=45.91.116.11:4123 , piece_id=DQY2VDS6G4IKAHCMZZM56XB7ITWUCYK7IJOQLAQUZX5PU6B64KAA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738284550 (303h6m39.169364681s) [noise=true , address=77.90.31.10:4546 , piece_id=PAWKSB2WXPD5ZTEWSFBXITHJQNCNO6SWZBW674UTN4OZFJ5LHLWQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738659918 (303h6m39.169740049s) [noise=true , address=79.127.201.214:4309 , piece_id=RGQEAB7D4M6ZMHMYBMZZUUO3MWRWNJ2NN5JGSWWCTF4GYOZCU22A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738781741 (303h6m39.169861872s) [noise=true , address=104.36.82.18:4381 , piece_id=6UGBZRYNKWRJLE5P7EXFPEITS6A3TVZ7TO4YQOPBRLP4URFQQWAA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739071375 (303h6m39.170151496s) [noise=true , address=104.36.82.60:4344 , piece_id=VR3M4HZL7BMYP7M7FHEJXF5GC3KV6TEHJR4NK3FIRVGI5ACP4O5A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739109368 (303h6m39.170189519s) [noise=true , address=77.90.31.11:4579 , piece_id=CI4OJMHG6FTRFIWBNY7WU6IZCA4WPQJMPXYBB45F2SLYYK2G57PA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739461611 (303h6m39.170541742s) [noise=true , address=104.36.82.5:4857 , piece_id=X5CGC5D4YMYK7VSDNWNRK6H6HOARSAMIEKNMZJY5UEPLR3QC55VQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739707502 (303h6m39.170787623s) [noise=true , address=77.90.31.21:4892 , piece_id=HT2FX75PM54GJQ5SZVRRBDOFE5LHWNYGUC4375ITHFOVE5RE36FA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739979432 (303h6m39.171059563s) [noise=true , address=79.127.220.98:4428 , piece_id=HEOYTV6HLP7DROD4A5LI52FEPB42LNUDU3DTF2FQ6CAGWSUGQAOA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.740334211 (303h6m39.171414342s) [noise=true , address=45.91.116.14:4201 , piece_id=NKKPHWYDX4CNVJLQKWQNBHX5WG5KTXEE3YDZKXG3TCIEEX3B6Q7A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.740702757 (303h6m39.171782888s) [noise=true , address=77.90.31.18:4823 , piece_id=M6WHF47D2LPGQTWYNQ54X4T54YDVYG45LSPESERPTMO3HGBEKH3Q, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741073696 (303h6m39.172153827s) [noise=true , address=77.90.31.13:4625 , piece_id=7GIUTOH7EMHBQPMGGGR4NKN3OT33ROXRBGTQAPJL6RUYGN66GHJQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741307855 (303h6m39.172387986s) [noise=true , address=104.36.82.23:4470 , piece_id=SNS3SF7ONWF44XRIWOIU6X3UCMBSNRGOVTDLNVYHWOBVU77DTWQA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741570477 (303h6m39.172650608s) [noise=true , address=77.90.31.12:4603 , piece_id=LYGOPXZ2Z4G2X2P57I7IAHMZ4JAWS5M7LIMKII4TU7YESK34H4BA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741776291 (303h6m39.172856422s) [noise=true , address=45.91.116.6:4004 , piece_id=54EGRMVODNBFJG4SSIC5OA6UK7RG7XMGCQ34OB756IYT5Y34XH3A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742098488 (303h6m39.173178619s) [noise=true , address=79.127.219.48:4106 , piece_id=JKVOH7BP7GGGSJICQPAIUPWYXQ4ER64LWHUZJ26QR2CBGNYQSFJA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742361460 (303h6m39.173441591s) [noise=true , address=77.90.31.17:4792 , piece_id=YCHJKRJJPI5XWGDSJFDUIE6QPWBV7FQ7W7ZQWRZLMVLYF4TOLVFQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742575059 (303h6m39.17365519s) [noise=true , address=77.90.31.16:4750 , piece_id=7LU6NJRAMHJ4S7VH5Z43DBVGYJIBQL3TU3DJK2C7FMQMJXWOJYWA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:46.208660569 (303h6m40.63974069s) [upload=315290]: Next returned nil segment
Aug 21 08:32:46.208680407 (303h6m40.639760538s) [upload=315290]: Waiting for error group managing segments...
Aug 21 08:32:46.584651402 (303h6m41.015731534s) [noise=true , address=79.127.220.98:4428 , piece_id=HEOYTV6HLP7DROD4A5LI52FEPB42LNUDU3DTF2FQ6CAGWSUGQAOA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.627652681 (303h6m41.058732812s) [noise=true , address=77.90.31.11:4579 , piece_id=CI4OJMHG6FTRFIWBNY7WU6IZCA4WPQJMPXYBB45F2SLYYK2G57PA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.639164989 (303h6m41.07024512s) [noise=true , address=77.90.31.10:4546 , piece_id=PAWKSB2WXPD5ZTEWSFBXITHJQNCNO6SWZBW674UTN4OZFJ5LHLWQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.644526758 (303h6m41.075606889s) [noise=true , address=45.91.116.6:4004 , piece_id=54EGRMVODNBFJG4SSIC5OA6UK7RG7XMGCQ34OB756IYT5Y34XH3A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.647891717 (303h6m41.078971848s) [noise=true , address=77.90.31.13:4625 , piece_id=7GIUTOH7EMHBQPMGGGR4NKN3OT33ROXRBGTQAPJL6RUYGN66GHJQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.661037670 (303h6m41.092117801s) [noise=true , address=45.91.116.14:4201 , piece_id=NKKPHWYDX4CNVJLQKWQNBHX5WG5KTXEE3YDZKXG3TCIEEX3B6Q7A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.661700518 (303h6m41.092780639s) [noise=true , address=77.90.31.12:4603 , piece_id=LYGOPXZ2Z4G2X2P57I7IAHMZ4JAWS5M7LIMKII4TU7YESK34H4BA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.668984736 (303h6m41.100064867s) [noise=true , address=104.36.82.5:4857 , piece_id=X5CGC5D4YMYK7VSDNWNRK6H6HOARSAMIEKNMZJY5UEPLR3QC55VQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.720272381 (303h6m41.151352502s) [noise=true , address=77.90.31.21:4892 , piece_id=HT2FX75PM54GJQ5SZVRRBDOFE5LHWNYGUC4375ITHFOVE5RE36FA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.727460995 (303h6m41.158541126s) [noise=true , address=104.36.82.60:4344 , piece_id=VR3M4HZL7BMYP7M7FHEJXF5GC3KV6TEHJR4NK3FIRVGI5ACP4O5A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.748559526 (303h6m41.179639657s) [noise=true , address=79.127.219.48:4106 , piece_id=JKVOH7BP7GGGSJICQPAIUPWYXQ4ER64LWHUZJ26QR2CBGNYQSFJA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.751055311 (303h6m41.182135432s) [noise=true , address=77.90.31.16:4750 , piece_id=7LU6NJRAMHJ4S7VH5Z43DBVGYJIBQL3TU3DJK2C7FMQMJXWOJYWA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.805486109 (303h6m41.23656624s) [noise=true , address=77.90.31.18:4823 , piece_id=M6WHF47D2LPGQTWYNQ54X4T54YDVYG45LSPESERPTMO3HGBEKH3Q, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.859109913 (303h6m41.290190044s) [noise=true , address=79.127.201.214:4309 , piece_id=RGQEAB7D4M6ZMHMYBMZZUUO3MWRWNJ2NN5JGSWWCTF4GYOZCU22A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.859129040 (303h6m41.290209171s) [seg_pos={0 0}, upload=315290]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:32:46.859262125 (303h6m41.290342256s) [noise=true , address=77.90.31.17:4792 , piece_id=YCHJKRJJPI5XWGDSJFDUIE6QPWBV7FQ7W7ZQWRZLMVLYF4TOLVFQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SPFgYZnbwjEupjaghfs61qwFM678KNPwpDmRNqV1j2opNgZCN): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859414826 (303h6m41.290494958s) [noise=true , address=104.36.82.23:4470 , piece_id=SNS3SF7ONWF44XRIWOIU6X3UCMBSNRGOVTDLNVYHWOBVU77DTWQA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FT9cn7mxuyJ7xBeCJgyTcJKFRmHEqboqeGWLvygNceEo4LQVF): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859471805 (303h6m41.290551936s) [noise=true , address=104.36.82.18:4381 , piece_id=6UGBZRYNKWRJLE5P7EXFPEITS6A3TVZ7TO4YQOPBRLP4URFQQWAA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RhN3jMBTt6LXsgym5RNMM4CvjhcSRhgjbRvSpE1TQTgQdJi9): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859616393 (303h6m41.290696524s) [noise=true , address=45.91.116.11:4123 , piece_id=DQY2VDS6G4IKAHCMZZM56XB7ITWUCYK7IJOQLAQUZX5PU6B64KAA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kjHfRVsDASQz36zUAHrXsLJausE7UTNzHgiFWpys4bQK21cAE): protocol: write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection; write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection
Aug 21 08:32:46.859628385 (303h6m41.290708516s) [seg_pos={0 0}, upload=315290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:32:46.859704171 (303h6m41.290784302s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:32:46.859708469 (303h6m41.2907886s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:32:47.160630836 (303h6m41.591710967s) [upload=315290]: Done uploading segments...
Aug 21 08:32:47.160650694 (303h6m41.591730826s) [upload=315290]: Upload finished. err: <nil>
Duration: 5.637808316s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [....X.X....X......X...X..X..................................] duration:
3.21770941s
FAIL (2025-08-21 08:37:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.217729178s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [....X..................X.....X..X.....X..............X......] duration:
5.584774901s
FAIL (2025-08-21 08:37:18 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 08:32:44.291596413 (303h6m38.722676544s) [upload=315290]: Starting upload
Aug 21 08:32:44.291654895 (303h6m38.722735026s) [upload=315290]: Done starting upload
Aug 21 08:32:44.291758664 (303h6m38.722838815s) [upload=315290]: Uploading segments...
Aug 21 08:32:44.291898331 (303h6m38.722978472s) [upload=315290]: Got next segment. Inline: false
Aug 21 08:32:44.291926134 (303h6m38.723006265s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:32:44.291930582 (303h6m38.723010713s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:32:44.738163778 (303h6m39.169243909s) [seg_pos={0 0}, upload=315290]: Begin upload segment...
Aug 21 08:32:44.738227320 (303h6m39.169307451s) [seg_pos={0 0}, upload=315290]: Done begin upload segment.
Aug 21 08:32:44.738253380 (303h6m39.169333511s) [noise=true , address=45.91.116.11:4123 , piece_id=DQY2VDS6G4IKAHCMZZM56XB7ITWUCYK7IJOQLAQUZX5PU6B64KAA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738284550 (303h6m39.169364681s) [noise=true , address=77.90.31.10:4546 , piece_id=PAWKSB2WXPD5ZTEWSFBXITHJQNCNO6SWZBW674UTN4OZFJ5LHLWQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738659918 (303h6m39.169740049s) [noise=true , address=79.127.201.214:4309 , piece_id=RGQEAB7D4M6ZMHMYBMZZUUO3MWRWNJ2NN5JGSWWCTF4GYOZCU22A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738781741 (303h6m39.169861872s) [noise=true , address=104.36.82.18:4381 , piece_id=6UGBZRYNKWRJLE5P7EXFPEITS6A3TVZ7TO4YQOPBRLP4URFQQWAA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739071375 (303h6m39.170151496s) [noise=true , address=104.36.82.60:4344 , piece_id=VR3M4HZL7BMYP7M7FHEJXF5GC3KV6TEHJR4NK3FIRVGI5ACP4O5A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739109368 (303h6m39.170189519s) [noise=true , address=77.90.31.11:4579 , piece_id=CI4OJMHG6FTRFIWBNY7WU6IZCA4WPQJMPXYBB45F2SLYYK2G57PA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739461611 (303h6m39.170541742s) [noise=true , address=104.36.82.5:4857 , piece_id=X5CGC5D4YMYK7VSDNWNRK6H6HOARSAMIEKNMZJY5UEPLR3QC55VQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739707502 (303h6m39.170787623s) [noise=true , address=77.90.31.21:4892 , piece_id=HT2FX75PM54GJQ5SZVRRBDOFE5LHWNYGUC4375ITHFOVE5RE36FA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739979432 (303h6m39.171059563s) [noise=true , address=79.127.220.98:4428 , piece_id=HEOYTV6HLP7DROD4A5LI52FEPB42LNUDU3DTF2FQ6CAGWSUGQAOA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.740334211 (303h6m39.171414342s) [noise=true , address=45.91.116.14:4201 , piece_id=NKKPHWYDX4CNVJLQKWQNBHX5WG5KTXEE3YDZKXG3TCIEEX3B6Q7A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.740702757 (303h6m39.171782888s) [noise=true , address=77.90.31.18:4823 , piece_id=M6WHF47D2LPGQTWYNQ54X4T54YDVYG45LSPESERPTMO3HGBEKH3Q, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741073696 (303h6m39.172153827s) [noise=true , address=77.90.31.13:4625 , piece_id=7GIUTOH7EMHBQPMGGGR4NKN3OT33ROXRBGTQAPJL6RUYGN66GHJQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741307855 (303h6m39.172387986s) [noise=true , address=104.36.82.23:4470 , piece_id=SNS3SF7ONWF44XRIWOIU6X3UCMBSNRGOVTDLNVYHWOBVU77DTWQA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741570477 (303h6m39.172650608s) [noise=true , address=77.90.31.12:4603 , piece_id=LYGOPXZ2Z4G2X2P57I7IAHMZ4JAWS5M7LIMKII4TU7YESK34H4BA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741776291 (303h6m39.172856422s) [noise=true , address=45.91.116.6:4004 , piece_id=54EGRMVODNBFJG4SSIC5OA6UK7RG7XMGCQ34OB756IYT5Y34XH3A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742098488 (303h6m39.173178619s) [noise=true , address=79.127.219.48:4106 , piece_id=JKVOH7BP7GGGSJICQPAIUPWYXQ4ER64LWHUZJ26QR2CBGNYQSFJA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742361460 (303h6m39.173441591s) [noise=true , address=77.90.31.17:4792 , piece_id=YCHJKRJJPI5XWGDSJFDUIE6QPWBV7FQ7W7ZQWRZLMVLYF4TOLVFQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742575059 (303h6m39.17365519s) [noise=true , address=77.90.31.16:4750 , piece_id=7LU6NJRAMHJ4S7VH5Z43DBVGYJIBQL3TU3DJK2C7FMQMJXWOJYWA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:46.208660569 (303h6m40.63974069s) [upload=315290]: Next returned nil segment
Aug 21 08:32:46.208680407 (303h6m40.639760538s) [upload=315290]: Waiting for error group managing segments...
Aug 21 08:32:46.584651402 (303h6m41.015731534s) [noise=true , address=79.127.220.98:4428 , piece_id=HEOYTV6HLP7DROD4A5LI52FEPB42LNUDU3DTF2FQ6CAGWSUGQAOA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.627652681 (303h6m41.058732812s) [noise=true , address=77.90.31.11:4579 , piece_id=CI4OJMHG6FTRFIWBNY7WU6IZCA4WPQJMPXYBB45F2SLYYK2G57PA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.639164989 (303h6m41.07024512s) [noise=true , address=77.90.31.10:4546 , piece_id=PAWKSB2WXPD5ZTEWSFBXITHJQNCNO6SWZBW674UTN4OZFJ5LHLWQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.644526758 (303h6m41.075606889s) [noise=true , address=45.91.116.6:4004 , piece_id=54EGRMVODNBFJG4SSIC5OA6UK7RG7XMGCQ34OB756IYT5Y34XH3A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.647891717 (303h6m41.078971848s) [noise=true , address=77.90.31.13:4625 , piece_id=7GIUTOH7EMHBQPMGGGR4NKN3OT33ROXRBGTQAPJL6RUYGN66GHJQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.661037670 (303h6m41.092117801s) [noise=true , address=45.91.116.14:4201 , piece_id=NKKPHWYDX4CNVJLQKWQNBHX5WG5KTXEE3YDZKXG3TCIEEX3B6Q7A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.661700518 (303h6m41.092780639s) [noise=true , address=77.90.31.12:4603 , piece_id=LYGOPXZ2Z4G2X2P57I7IAHMZ4JAWS5M7LIMKII4TU7YESK34H4BA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.668984736 (303h6m41.100064867s) [noise=true , address=104.36.82.5:4857 , piece_id=X5CGC5D4YMYK7VSDNWNRK6H6HOARSAMIEKNMZJY5UEPLR3QC55VQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.720272381 (303h6m41.151352502s) [noise=true , address=77.90.31.21:4892 , piece_id=HT2FX75PM54GJQ5SZVRRBDOFE5LHWNYGUC4375ITHFOVE5RE36FA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.727460995 (303h6m41.158541126s) [noise=true , address=104.36.82.60:4344 , piece_id=VR3M4HZL7BMYP7M7FHEJXF5GC3KV6TEHJR4NK3FIRVGI5ACP4O5A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.748559526 (303h6m41.179639657s) [noise=true , address=79.127.219.48:4106 , piece_id=JKVOH7BP7GGGSJICQPAIUPWYXQ4ER64LWHUZJ26QR2CBGNYQSFJA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.751055311 (303h6m41.182135432s) [noise=true , address=77.90.31.16:4750 , piece_id=7LU6NJRAMHJ4S7VH5Z43DBVGYJIBQL3TU3DJK2C7FMQMJXWOJYWA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.805486109 (303h6m41.23656624s) [noise=true , address=77.90.31.18:4823 , piece_id=M6WHF47D2LPGQTWYNQ54X4T54YDVYG45LSPESERPTMO3HGBEKH3Q, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.859109913 (303h6m41.290190044s) [noise=true , address=79.127.201.214:4309 , piece_id=RGQEAB7D4M6ZMHMYBMZZUUO3MWRWNJ2NN5JGSWWCTF4GYOZCU22A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.859129040 (303h6m41.290209171s) [seg_pos={0 0}, upload=315290]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:32:46.859262125 (303h6m41.290342256s) [noise=true , address=77.90.31.17:4792 , piece_id=YCHJKRJJPI5XWGDSJFDUIE6QPWBV7FQ7W7ZQWRZLMVLYF4TOLVFQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SPFgYZnbwjEupjaghfs61qwFM678KNPwpDmRNqV1j2opNgZCN): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859414826 (303h6m41.290494958s) [noise=true , address=104.36.82.23:4470 , piece_id=SNS3SF7ONWF44XRIWOIU6X3UCMBSNRGOVTDLNVYHWOBVU77DTWQA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FT9cn7mxuyJ7xBeCJgyTcJKFRmHEqboqeGWLvygNceEo4LQVF): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859471805 (303h6m41.290551936s) [noise=true , address=104.36.82.18:4381 , piece_id=6UGBZRYNKWRJLE5P7EXFPEITS6A3TVZ7TO4YQOPBRLP4URFQQWAA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RhN3jMBTt6LXsgym5RNMM4CvjhcSRhgjbRvSpE1TQTgQdJi9): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859616393 (303h6m41.290696524s) [noise=true , address=45.91.116.11:4123 , piece_id=DQY2VDS6G4IKAHCMZZM56XB7ITWUCYK7IJOQLAQUZX5PU6B64KAA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kjHfRVsDASQz36zUAHrXsLJausE7UTNzHgiFWpys4bQK21cAE): protocol: write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection; write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection
Aug 21 08:32:46.859628385 (303h6m41.290708516s) [seg_pos={0 0}, upload=315290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:32:46.859704171 (303h6m41.290784302s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:32:46.859708469 (303h6m41.2907886s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:32:47.160630836 (303h6m41.591710967s) [upload=315290]: Done uploading segments...
Aug 21 08:32:47.160650694 (303h6m41.591730826s) [upload=315290]: Upload finished. err: <nil>
Duration: 5.584793767s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.....X.X....X......X...X..X.................................] duration:
1.846807767s
FAIL (2025-08-21 08:37:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.846838184s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [......X.X....X......X...X..X................................] duration:
2.019983562s
FAIL (2025-08-21 08:36:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.020008139s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.....X..................X.....X..X.....X..............X.....] duration:
6.05294403s
FAIL (2025-08-21 08:36:25 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 08:32:44.291596413 (303h6m38.722676544s) [upload=315290]: Starting upload
Aug 21 08:32:44.291654895 (303h6m38.722735026s) [upload=315290]: Done starting upload
Aug 21 08:32:44.291758664 (303h6m38.722838815s) [upload=315290]: Uploading segments...
Aug 21 08:32:44.291898331 (303h6m38.722978472s) [upload=315290]: Got next segment. Inline: false
Aug 21 08:32:44.291926134 (303h6m38.723006265s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:32:44.291930582 (303h6m38.723010713s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:32:44.738163778 (303h6m39.169243909s) [seg_pos={0 0}, upload=315290]: Begin upload segment...
Aug 21 08:32:44.738227320 (303h6m39.169307451s) [seg_pos={0 0}, upload=315290]: Done begin upload segment.
Aug 21 08:32:44.738253380 (303h6m39.169333511s) [noise=true , address=45.91.116.11:4123 , piece_id=DQY2VDS6G4IKAHCMZZM56XB7ITWUCYK7IJOQLAQUZX5PU6B64KAA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738284550 (303h6m39.169364681s) [noise=true , address=77.90.31.10:4546 , piece_id=PAWKSB2WXPD5ZTEWSFBXITHJQNCNO6SWZBW674UTN4OZFJ5LHLWQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738659918 (303h6m39.169740049s) [noise=true , address=79.127.201.214:4309 , piece_id=RGQEAB7D4M6ZMHMYBMZZUUO3MWRWNJ2NN5JGSWWCTF4GYOZCU22A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738781741 (303h6m39.169861872s) [noise=true , address=104.36.82.18:4381 , piece_id=6UGBZRYNKWRJLE5P7EXFPEITS6A3TVZ7TO4YQOPBRLP4URFQQWAA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739071375 (303h6m39.170151496s) [noise=true , address=104.36.82.60:4344 , piece_id=VR3M4HZL7BMYP7M7FHEJXF5GC3KV6TEHJR4NK3FIRVGI5ACP4O5A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739109368 (303h6m39.170189519s) [noise=true , address=77.90.31.11:4579 , piece_id=CI4OJMHG6FTRFIWBNY7WU6IZCA4WPQJMPXYBB45F2SLYYK2G57PA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739461611 (303h6m39.170541742s) [noise=true , address=104.36.82.5:4857 , piece_id=X5CGC5D4YMYK7VSDNWNRK6H6HOARSAMIEKNMZJY5UEPLR3QC55VQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739707502 (303h6m39.170787623s) [noise=true , address=77.90.31.21:4892 , piece_id=HT2FX75PM54GJQ5SZVRRBDOFE5LHWNYGUC4375ITHFOVE5RE36FA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739979432 (303h6m39.171059563s) [noise=true , address=79.127.220.98:4428 , piece_id=HEOYTV6HLP7DROD4A5LI52FEPB42LNUDU3DTF2FQ6CAGWSUGQAOA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.740334211 (303h6m39.171414342s) [noise=true , address=45.91.116.14:4201 , piece_id=NKKPHWYDX4CNVJLQKWQNBHX5WG5KTXEE3YDZKXG3TCIEEX3B6Q7A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.740702757 (303h6m39.171782888s) [noise=true , address=77.90.31.18:4823 , piece_id=M6WHF47D2LPGQTWYNQ54X4T54YDVYG45LSPESERPTMO3HGBEKH3Q, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741073696 (303h6m39.172153827s) [noise=true , address=77.90.31.13:4625 , piece_id=7GIUTOH7EMHBQPMGGGR4NKN3OT33ROXRBGTQAPJL6RUYGN66GHJQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741307855 (303h6m39.172387986s) [noise=true , address=104.36.82.23:4470 , piece_id=SNS3SF7ONWF44XRIWOIU6X3UCMBSNRGOVTDLNVYHWOBVU77DTWQA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741570477 (303h6m39.172650608s) [noise=true , address=77.90.31.12:4603 , piece_id=LYGOPXZ2Z4G2X2P57I7IAHMZ4JAWS5M7LIMKII4TU7YESK34H4BA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741776291 (303h6m39.172856422s) [noise=true , address=45.91.116.6:4004 , piece_id=54EGRMVODNBFJG4SSIC5OA6UK7RG7XMGCQ34OB756IYT5Y34XH3A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742098488 (303h6m39.173178619s) [noise=true , address=79.127.219.48:4106 , piece_id=JKVOH7BP7GGGSJICQPAIUPWYXQ4ER64LWHUZJ26QR2CBGNYQSFJA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742361460 (303h6m39.173441591s) [noise=true , address=77.90.31.17:4792 , piece_id=YCHJKRJJPI5XWGDSJFDUIE6QPWBV7FQ7W7ZQWRZLMVLYF4TOLVFQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742575059 (303h6m39.17365519s) [noise=true , address=77.90.31.16:4750 , piece_id=7LU6NJRAMHJ4S7VH5Z43DBVGYJIBQL3TU3DJK2C7FMQMJXWOJYWA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:46.208660569 (303h6m40.63974069s) [upload=315290]: Next returned nil segment
Aug 21 08:32:46.208680407 (303h6m40.639760538s) [upload=315290]: Waiting for error group managing segments...
Aug 21 08:32:46.584651402 (303h6m41.015731534s) [noise=true , address=79.127.220.98:4428 , piece_id=HEOYTV6HLP7DROD4A5LI52FEPB42LNUDU3DTF2FQ6CAGWSUGQAOA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.627652681 (303h6m41.058732812s) [noise=true , address=77.90.31.11:4579 , piece_id=CI4OJMHG6FTRFIWBNY7WU6IZCA4WPQJMPXYBB45F2SLYYK2G57PA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.639164989 (303h6m41.07024512s) [noise=true , address=77.90.31.10:4546 , piece_id=PAWKSB2WXPD5ZTEWSFBXITHJQNCNO6SWZBW674UTN4OZFJ5LHLWQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.644526758 (303h6m41.075606889s) [noise=true , address=45.91.116.6:4004 , piece_id=54EGRMVODNBFJG4SSIC5OA6UK7RG7XMGCQ34OB756IYT5Y34XH3A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.647891717 (303h6m41.078971848s) [noise=true , address=77.90.31.13:4625 , piece_id=7GIUTOH7EMHBQPMGGGR4NKN3OT33ROXRBGTQAPJL6RUYGN66GHJQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.661037670 (303h6m41.092117801s) [noise=true , address=45.91.116.14:4201 , piece_id=NKKPHWYDX4CNVJLQKWQNBHX5WG5KTXEE3YDZKXG3TCIEEX3B6Q7A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.661700518 (303h6m41.092780639s) [noise=true , address=77.90.31.12:4603 , piece_id=LYGOPXZ2Z4G2X2P57I7IAHMZ4JAWS5M7LIMKII4TU7YESK34H4BA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.668984736 (303h6m41.100064867s) [noise=true , address=104.36.82.5:4857 , piece_id=X5CGC5D4YMYK7VSDNWNRK6H6HOARSAMIEKNMZJY5UEPLR3QC55VQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.720272381 (303h6m41.151352502s) [noise=true , address=77.90.31.21:4892 , piece_id=HT2FX75PM54GJQ5SZVRRBDOFE5LHWNYGUC4375ITHFOVE5RE36FA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.727460995 (303h6m41.158541126s) [noise=true , address=104.36.82.60:4344 , piece_id=VR3M4HZL7BMYP7M7FHEJXF5GC3KV6TEHJR4NK3FIRVGI5ACP4O5A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.748559526 (303h6m41.179639657s) [noise=true , address=79.127.219.48:4106 , piece_id=JKVOH7BP7GGGSJICQPAIUPWYXQ4ER64LWHUZJ26QR2CBGNYQSFJA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.751055311 (303h6m41.182135432s) [noise=true , address=77.90.31.16:4750 , piece_id=7LU6NJRAMHJ4S7VH5Z43DBVGYJIBQL3TU3DJK2C7FMQMJXWOJYWA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.805486109 (303h6m41.23656624s) [noise=true , address=77.90.31.18:4823 , piece_id=M6WHF47D2LPGQTWYNQ54X4T54YDVYG45LSPESERPTMO3HGBEKH3Q, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.859109913 (303h6m41.290190044s) [noise=true , address=79.127.201.214:4309 , piece_id=RGQEAB7D4M6ZMHMYBMZZUUO3MWRWNJ2NN5JGSWWCTF4GYOZCU22A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.859129040 (303h6m41.290209171s) [seg_pos={0 0}, upload=315290]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:32:46.859262125 (303h6m41.290342256s) [noise=true , address=77.90.31.17:4792 , piece_id=YCHJKRJJPI5XWGDSJFDUIE6QPWBV7FQ7W7ZQWRZLMVLYF4TOLVFQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SPFgYZnbwjEupjaghfs61qwFM678KNPwpDmRNqV1j2opNgZCN): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859414826 (303h6m41.290494958s) [noise=true , address=104.36.82.23:4470 , piece_id=SNS3SF7ONWF44XRIWOIU6X3UCMBSNRGOVTDLNVYHWOBVU77DTWQA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FT9cn7mxuyJ7xBeCJgyTcJKFRmHEqboqeGWLvygNceEo4LQVF): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859471805 (303h6m41.290551936s) [noise=true , address=104.36.82.18:4381 , piece_id=6UGBZRYNKWRJLE5P7EXFPEITS6A3TVZ7TO4YQOPBRLP4URFQQWAA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RhN3jMBTt6LXsgym5RNMM4CvjhcSRhgjbRvSpE1TQTgQdJi9): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859616393 (303h6m41.290696524s) [noise=true , address=45.91.116.11:4123 , piece_id=DQY2VDS6G4IKAHCMZZM56XB7ITWUCYK7IJOQLAQUZX5PU6B64KAA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kjHfRVsDASQz36zUAHrXsLJausE7UTNzHgiFWpys4bQK21cAE): protocol: write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection; write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection
Aug 21 08:32:46.859628385 (303h6m41.290708516s) [seg_pos={0 0}, upload=315290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:32:46.859704171 (303h6m41.290784302s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:32:46.859708469 (303h6m41.2907886s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:32:47.160630836 (303h6m41.591710967s) [upload=315290]: Done uploading segments...
Aug 21 08:32:47.160650694 (303h6m41.591730826s) [upload=315290]: Upload finished. err: <nil>
Duration: 6.052958046s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [......X..................X.....X..X.....X..............X....] duration:
5.912081162s
FAIL (2025-08-21 08:35:40 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 08:32:44.291596413 (303h6m38.722676544s) [upload=315290]: Starting upload
Aug 21 08:32:44.291654895 (303h6m38.722735026s) [upload=315290]: Done starting upload
Aug 21 08:32:44.291758664 (303h6m38.722838815s) [upload=315290]: Uploading segments...
Aug 21 08:32:44.291898331 (303h6m38.722978472s) [upload=315290]: Got next segment. Inline: false
Aug 21 08:32:44.291926134 (303h6m38.723006265s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:32:44.291930582 (303h6m38.723010713s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:32:44.738163778 (303h6m39.169243909s) [seg_pos={0 0}, upload=315290]: Begin upload segment...
Aug 21 08:32:44.738227320 (303h6m39.169307451s) [seg_pos={0 0}, upload=315290]: Done begin upload segment.
Aug 21 08:32:44.738253380 (303h6m39.169333511s) [noise=true , address=45.91.116.11:4123 , piece_id=DQY2VDS6G4IKAHCMZZM56XB7ITWUCYK7IJOQLAQUZX5PU6B64KAA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738284550 (303h6m39.169364681s) [noise=true , address=77.90.31.10:4546 , piece_id=PAWKSB2WXPD5ZTEWSFBXITHJQNCNO6SWZBW674UTN4OZFJ5LHLWQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738659918 (303h6m39.169740049s) [noise=true , address=79.127.201.214:4309 , piece_id=RGQEAB7D4M6ZMHMYBMZZUUO3MWRWNJ2NN5JGSWWCTF4GYOZCU22A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738781741 (303h6m39.169861872s) [noise=true , address=104.36.82.18:4381 , piece_id=6UGBZRYNKWRJLE5P7EXFPEITS6A3TVZ7TO4YQOPBRLP4URFQQWAA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739071375 (303h6m39.170151496s) [noise=true , address=104.36.82.60:4344 , piece_id=VR3M4HZL7BMYP7M7FHEJXF5GC3KV6TEHJR4NK3FIRVGI5ACP4O5A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739109368 (303h6m39.170189519s) [noise=true , address=77.90.31.11:4579 , piece_id=CI4OJMHG6FTRFIWBNY7WU6IZCA4WPQJMPXYBB45F2SLYYK2G57PA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739461611 (303h6m39.170541742s) [noise=true , address=104.36.82.5:4857 , piece_id=X5CGC5D4YMYK7VSDNWNRK6H6HOARSAMIEKNMZJY5UEPLR3QC55VQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739707502 (303h6m39.170787623s) [noise=true , address=77.90.31.21:4892 , piece_id=HT2FX75PM54GJQ5SZVRRBDOFE5LHWNYGUC4375ITHFOVE5RE36FA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739979432 (303h6m39.171059563s) [noise=true , address=79.127.220.98:4428 , piece_id=HEOYTV6HLP7DROD4A5LI52FEPB42LNUDU3DTF2FQ6CAGWSUGQAOA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.740334211 (303h6m39.171414342s) [noise=true , address=45.91.116.14:4201 , piece_id=NKKPHWYDX4CNVJLQKWQNBHX5WG5KTXEE3YDZKXG3TCIEEX3B6Q7A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.740702757 (303h6m39.171782888s) [noise=true , address=77.90.31.18:4823 , piece_id=M6WHF47D2LPGQTWYNQ54X4T54YDVYG45LSPESERPTMO3HGBEKH3Q, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741073696 (303h6m39.172153827s) [noise=true , address=77.90.31.13:4625 , piece_id=7GIUTOH7EMHBQPMGGGR4NKN3OT33ROXRBGTQAPJL6RUYGN66GHJQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741307855 (303h6m39.172387986s) [noise=true , address=104.36.82.23:4470 , piece_id=SNS3SF7ONWF44XRIWOIU6X3UCMBSNRGOVTDLNVYHWOBVU77DTWQA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741570477 (303h6m39.172650608s) [noise=true , address=77.90.31.12:4603 , piece_id=LYGOPXZ2Z4G2X2P57I7IAHMZ4JAWS5M7LIMKII4TU7YESK34H4BA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741776291 (303h6m39.172856422s) [noise=true , address=45.91.116.6:4004 , piece_id=54EGRMVODNBFJG4SSIC5OA6UK7RG7XMGCQ34OB756IYT5Y34XH3A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742098488 (303h6m39.173178619s) [noise=true , address=79.127.219.48:4106 , piece_id=JKVOH7BP7GGGSJICQPAIUPWYXQ4ER64LWHUZJ26QR2CBGNYQSFJA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742361460 (303h6m39.173441591s) [noise=true , address=77.90.31.17:4792 , piece_id=YCHJKRJJPI5XWGDSJFDUIE6QPWBV7FQ7W7ZQWRZLMVLYF4TOLVFQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742575059 (303h6m39.17365519s) [noise=true , address=77.90.31.16:4750 , piece_id=7LU6NJRAMHJ4S7VH5Z43DBVGYJIBQL3TU3DJK2C7FMQMJXWOJYWA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:46.208660569 (303h6m40.63974069s) [upload=315290]: Next returned nil segment
Aug 21 08:32:46.208680407 (303h6m40.639760538s) [upload=315290]: Waiting for error group managing segments...
Aug 21 08:32:46.584651402 (303h6m41.015731534s) [noise=true , address=79.127.220.98:4428 , piece_id=HEOYTV6HLP7DROD4A5LI52FEPB42LNUDU3DTF2FQ6CAGWSUGQAOA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.627652681 (303h6m41.058732812s) [noise=true , address=77.90.31.11:4579 , piece_id=CI4OJMHG6FTRFIWBNY7WU6IZCA4WPQJMPXYBB45F2SLYYK2G57PA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.639164989 (303h6m41.07024512s) [noise=true , address=77.90.31.10:4546 , piece_id=PAWKSB2WXPD5ZTEWSFBXITHJQNCNO6SWZBW674UTN4OZFJ5LHLWQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.644526758 (303h6m41.075606889s) [noise=true , address=45.91.116.6:4004 , piece_id=54EGRMVODNBFJG4SSIC5OA6UK7RG7XMGCQ34OB756IYT5Y34XH3A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.647891717 (303h6m41.078971848s) [noise=true , address=77.90.31.13:4625 , piece_id=7GIUTOH7EMHBQPMGGGR4NKN3OT33ROXRBGTQAPJL6RUYGN66GHJQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.661037670 (303h6m41.092117801s) [noise=true , address=45.91.116.14:4201 , piece_id=NKKPHWYDX4CNVJLQKWQNBHX5WG5KTXEE3YDZKXG3TCIEEX3B6Q7A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.661700518 (303h6m41.092780639s) [noise=true , address=77.90.31.12:4603 , piece_id=LYGOPXZ2Z4G2X2P57I7IAHMZ4JAWS5M7LIMKII4TU7YESK34H4BA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.668984736 (303h6m41.100064867s) [noise=true , address=104.36.82.5:4857 , piece_id=X5CGC5D4YMYK7VSDNWNRK6H6HOARSAMIEKNMZJY5UEPLR3QC55VQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.720272381 (303h6m41.151352502s) [noise=true , address=77.90.31.21:4892 , piece_id=HT2FX75PM54GJQ5SZVRRBDOFE5LHWNYGUC4375ITHFOVE5RE36FA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.727460995 (303h6m41.158541126s) [noise=true , address=104.36.82.60:4344 , piece_id=VR3M4HZL7BMYP7M7FHEJXF5GC3KV6TEHJR4NK3FIRVGI5ACP4O5A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.748559526 (303h6m41.179639657s) [noise=true , address=79.127.219.48:4106 , piece_id=JKVOH7BP7GGGSJICQPAIUPWYXQ4ER64LWHUZJ26QR2CBGNYQSFJA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.751055311 (303h6m41.182135432s) [noise=true , address=77.90.31.16:4750 , piece_id=7LU6NJRAMHJ4S7VH5Z43DBVGYJIBQL3TU3DJK2C7FMQMJXWOJYWA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.805486109 (303h6m41.23656624s) [noise=true , address=77.90.31.18:4823 , piece_id=M6WHF47D2LPGQTWYNQ54X4T54YDVYG45LSPESERPTMO3HGBEKH3Q, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.859109913 (303h6m41.290190044s) [noise=true , address=79.127.201.214:4309 , piece_id=RGQEAB7D4M6ZMHMYBMZZUUO3MWRWNJ2NN5JGSWWCTF4GYOZCU22A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.859129040 (303h6m41.290209171s) [seg_pos={0 0}, upload=315290]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:32:46.859262125 (303h6m41.290342256s) [noise=true , address=77.90.31.17:4792 , piece_id=YCHJKRJJPI5XWGDSJFDUIE6QPWBV7FQ7W7ZQWRZLMVLYF4TOLVFQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SPFgYZnbwjEupjaghfs61qwFM678KNPwpDmRNqV1j2opNgZCN): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859414826 (303h6m41.290494958s) [noise=true , address=104.36.82.23:4470 , piece_id=SNS3SF7ONWF44XRIWOIU6X3UCMBSNRGOVTDLNVYHWOBVU77DTWQA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FT9cn7mxuyJ7xBeCJgyTcJKFRmHEqboqeGWLvygNceEo4LQVF): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859471805 (303h6m41.290551936s) [noise=true , address=104.36.82.18:4381 , piece_id=6UGBZRYNKWRJLE5P7EXFPEITS6A3TVZ7TO4YQOPBRLP4URFQQWAA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RhN3jMBTt6LXsgym5RNMM4CvjhcSRhgjbRvSpE1TQTgQdJi9): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859616393 (303h6m41.290696524s) [noise=true , address=45.91.116.11:4123 , piece_id=DQY2VDS6G4IKAHCMZZM56XB7ITWUCYK7IJOQLAQUZX5PU6B64KAA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kjHfRVsDASQz36zUAHrXsLJausE7UTNzHgiFWpys4bQK21cAE): protocol: write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection; write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection
Aug 21 08:32:46.859628385 (303h6m41.290708516s) [seg_pos={0 0}, upload=315290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:32:46.859704171 (303h6m41.290784302s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:32:46.859708469 (303h6m41.2907886s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:32:47.160630836 (303h6m41.591710967s) [upload=315290]: Done uploading segments...
Aug 21 08:32:47.160650694 (303h6m41.591730826s) [upload=315290]: Upload finished. err: <nil>
Duration: 5.912105758s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.......X.X....X......X...X..X...............................] duration:
2.001510696s
FAIL (2025-08-21 08:35:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.001530033s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.......X..................X.....X..X.....X..............X...] duration:
6.116943417s
FAIL (2025-08-21 08:35:20 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 08:32:44.291596413 (303h6m38.722676544s) [upload=315290]: Starting upload
Aug 21 08:32:44.291654895 (303h6m38.722735026s) [upload=315290]: Done starting upload
Aug 21 08:32:44.291758664 (303h6m38.722838815s) [upload=315290]: Uploading segments...
Aug 21 08:32:44.291898331 (303h6m38.722978472s) [upload=315290]: Got next segment. Inline: false
Aug 21 08:32:44.291926134 (303h6m38.723006265s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:32:44.291930582 (303h6m38.723010713s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:32:44.738163778 (303h6m39.169243909s) [seg_pos={0 0}, upload=315290]: Begin upload segment...
Aug 21 08:32:44.738227320 (303h6m39.169307451s) [seg_pos={0 0}, upload=315290]: Done begin upload segment.
Aug 21 08:32:44.738253380 (303h6m39.169333511s) [noise=true , address=45.91.116.11:4123 , piece_id=DQY2VDS6G4IKAHCMZZM56XB7ITWUCYK7IJOQLAQUZX5PU6B64KAA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738284550 (303h6m39.169364681s) [noise=true , address=77.90.31.10:4546 , piece_id=PAWKSB2WXPD5ZTEWSFBXITHJQNCNO6SWZBW674UTN4OZFJ5LHLWQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738659918 (303h6m39.169740049s) [noise=true , address=79.127.201.214:4309 , piece_id=RGQEAB7D4M6ZMHMYBMZZUUO3MWRWNJ2NN5JGSWWCTF4GYOZCU22A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738781741 (303h6m39.169861872s) [noise=true , address=104.36.82.18:4381 , piece_id=6UGBZRYNKWRJLE5P7EXFPEITS6A3TVZ7TO4YQOPBRLP4URFQQWAA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739071375 (303h6m39.170151496s) [noise=true , address=104.36.82.60:4344 , piece_id=VR3M4HZL7BMYP7M7FHEJXF5GC3KV6TEHJR4NK3FIRVGI5ACP4O5A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739109368 (303h6m39.170189519s) [noise=true , address=77.90.31.11:4579 , piece_id=CI4OJMHG6FTRFIWBNY7WU6IZCA4WPQJMPXYBB45F2SLYYK2G57PA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739461611 (303h6m39.170541742s) [noise=true , address=104.36.82.5:4857 , piece_id=X5CGC5D4YMYK7VSDNWNRK6H6HOARSAMIEKNMZJY5UEPLR3QC55VQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739707502 (303h6m39.170787623s) [noise=true , address=77.90.31.21:4892 , piece_id=HT2FX75PM54GJQ5SZVRRBDOFE5LHWNYGUC4375ITHFOVE5RE36FA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739979432 (303h6m39.171059563s) [noise=true , address=79.127.220.98:4428 , piece_id=HEOYTV6HLP7DROD4A5LI52FEPB42LNUDU3DTF2FQ6CAGWSUGQAOA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.740334211 (303h6m39.171414342s) [noise=true , address=45.91.116.14:4201 , piece_id=NKKPHWYDX4CNVJLQKWQNBHX5WG5KTXEE3YDZKXG3TCIEEX3B6Q7A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.740702757 (303h6m39.171782888s) [noise=true , address=77.90.31.18:4823 , piece_id=M6WHF47D2LPGQTWYNQ54X4T54YDVYG45LSPESERPTMO3HGBEKH3Q, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741073696 (303h6m39.172153827s) [noise=true , address=77.90.31.13:4625 , piece_id=7GIUTOH7EMHBQPMGGGR4NKN3OT33ROXRBGTQAPJL6RUYGN66GHJQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741307855 (303h6m39.172387986s) [noise=true , address=104.36.82.23:4470 , piece_id=SNS3SF7ONWF44XRIWOIU6X3UCMBSNRGOVTDLNVYHWOBVU77DTWQA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741570477 (303h6m39.172650608s) [noise=true , address=77.90.31.12:4603 , piece_id=LYGOPXZ2Z4G2X2P57I7IAHMZ4JAWS5M7LIMKII4TU7YESK34H4BA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741776291 (303h6m39.172856422s) [noise=true , address=45.91.116.6:4004 , piece_id=54EGRMVODNBFJG4SSIC5OA6UK7RG7XMGCQ34OB756IYT5Y34XH3A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742098488 (303h6m39.173178619s) [noise=true , address=79.127.219.48:4106 , piece_id=JKVOH7BP7GGGSJICQPAIUPWYXQ4ER64LWHUZJ26QR2CBGNYQSFJA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742361460 (303h6m39.173441591s) [noise=true , address=77.90.31.17:4792 , piece_id=YCHJKRJJPI5XWGDSJFDUIE6QPWBV7FQ7W7ZQWRZLMVLYF4TOLVFQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742575059 (303h6m39.17365519s) [noise=true , address=77.90.31.16:4750 , piece_id=7LU6NJRAMHJ4S7VH5Z43DBVGYJIBQL3TU3DJK2C7FMQMJXWOJYWA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:46.208660569 (303h6m40.63974069s) [upload=315290]: Next returned nil segment
Aug 21 08:32:46.208680407 (303h6m40.639760538s) [upload=315290]: Waiting for error group managing segments...
Aug 21 08:32:46.584651402 (303h6m41.015731534s) [noise=true , address=79.127.220.98:4428 , piece_id=HEOYTV6HLP7DROD4A5LI52FEPB42LNUDU3DTF2FQ6CAGWSUGQAOA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.627652681 (303h6m41.058732812s) [noise=true , address=77.90.31.11:4579 , piece_id=CI4OJMHG6FTRFIWBNY7WU6IZCA4WPQJMPXYBB45F2SLYYK2G57PA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.639164989 (303h6m41.07024512s) [noise=true , address=77.90.31.10:4546 , piece_id=PAWKSB2WXPD5ZTEWSFBXITHJQNCNO6SWZBW674UTN4OZFJ5LHLWQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.644526758 (303h6m41.075606889s) [noise=true , address=45.91.116.6:4004 , piece_id=54EGRMVODNBFJG4SSIC5OA6UK7RG7XMGCQ34OB756IYT5Y34XH3A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.647891717 (303h6m41.078971848s) [noise=true , address=77.90.31.13:4625 , piece_id=7GIUTOH7EMHBQPMGGGR4NKN3OT33ROXRBGTQAPJL6RUYGN66GHJQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.661037670 (303h6m41.092117801s) [noise=true , address=45.91.116.14:4201 , piece_id=NKKPHWYDX4CNVJLQKWQNBHX5WG5KTXEE3YDZKXG3TCIEEX3B6Q7A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.661700518 (303h6m41.092780639s) [noise=true , address=77.90.31.12:4603 , piece_id=LYGOPXZ2Z4G2X2P57I7IAHMZ4JAWS5M7LIMKII4TU7YESK34H4BA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.668984736 (303h6m41.100064867s) [noise=true , address=104.36.82.5:4857 , piece_id=X5CGC5D4YMYK7VSDNWNRK6H6HOARSAMIEKNMZJY5UEPLR3QC55VQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.720272381 (303h6m41.151352502s) [noise=true , address=77.90.31.21:4892 , piece_id=HT2FX75PM54GJQ5SZVRRBDOFE5LHWNYGUC4375ITHFOVE5RE36FA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.727460995 (303h6m41.158541126s) [noise=true , address=104.36.82.60:4344 , piece_id=VR3M4HZL7BMYP7M7FHEJXF5GC3KV6TEHJR4NK3FIRVGI5ACP4O5A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.748559526 (303h6m41.179639657s) [noise=true , address=79.127.219.48:4106 , piece_id=JKVOH7BP7GGGSJICQPAIUPWYXQ4ER64LWHUZJ26QR2CBGNYQSFJA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.751055311 (303h6m41.182135432s) [noise=true , address=77.90.31.16:4750 , piece_id=7LU6NJRAMHJ4S7VH5Z43DBVGYJIBQL3TU3DJK2C7FMQMJXWOJYWA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.805486109 (303h6m41.23656624s) [noise=true , address=77.90.31.18:4823 , piece_id=M6WHF47D2LPGQTWYNQ54X4T54YDVYG45LSPESERPTMO3HGBEKH3Q, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.859109913 (303h6m41.290190044s) [noise=true , address=79.127.201.214:4309 , piece_id=RGQEAB7D4M6ZMHMYBMZZUUO3MWRWNJ2NN5JGSWWCTF4GYOZCU22A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.859129040 (303h6m41.290209171s) [seg_pos={0 0}, upload=315290]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:32:46.859262125 (303h6m41.290342256s) [noise=true , address=77.90.31.17:4792 , piece_id=YCHJKRJJPI5XWGDSJFDUIE6QPWBV7FQ7W7ZQWRZLMVLYF4TOLVFQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SPFgYZnbwjEupjaghfs61qwFM678KNPwpDmRNqV1j2opNgZCN): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859414826 (303h6m41.290494958s) [noise=true , address=104.36.82.23:4470 , piece_id=SNS3SF7ONWF44XRIWOIU6X3UCMBSNRGOVTDLNVYHWOBVU77DTWQA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FT9cn7mxuyJ7xBeCJgyTcJKFRmHEqboqeGWLvygNceEo4LQVF): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859471805 (303h6m41.290551936s) [noise=true , address=104.36.82.18:4381 , piece_id=6UGBZRYNKWRJLE5P7EXFPEITS6A3TVZ7TO4YQOPBRLP4URFQQWAA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RhN3jMBTt6LXsgym5RNMM4CvjhcSRhgjbRvSpE1TQTgQdJi9): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859616393 (303h6m41.290696524s) [noise=true , address=45.91.116.11:4123 , piece_id=DQY2VDS6G4IKAHCMZZM56XB7ITWUCYK7IJOQLAQUZX5PU6B64KAA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kjHfRVsDASQz36zUAHrXsLJausE7UTNzHgiFWpys4bQK21cAE): protocol: write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection; write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection
Aug 21 08:32:46.859628385 (303h6m41.290708516s) [seg_pos={0 0}, upload=315290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:32:46.859704171 (303h6m41.290784302s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:32:46.859708469 (303h6m41.2907886s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:32:47.160630836 (303h6m41.591710967s) [upload=315290]: Done uploading segments...
Aug 21 08:32:47.160650694 (303h6m41.591730826s) [upload=315290]: Upload finished. err: <nil>
Duration: 6.11697164s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [........X.X....X......X...X..X..............................] duration:
1.848773428s
FAIL (2025-08-21 08:34:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.848799939s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [........X..................X.....X..X.....X..............X..] duration:
5.584941691s
FAIL (2025-08-21 08:34:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 08:32:44.291596413 (303h6m38.722676544s) [upload=315290]: Starting upload
Aug 21 08:32:44.291654895 (303h6m38.722735026s) [upload=315290]: Done starting upload
Aug 21 08:32:44.291758664 (303h6m38.722838815s) [upload=315290]: Uploading segments...
Aug 21 08:32:44.291898331 (303h6m38.722978472s) [upload=315290]: Got next segment. Inline: false
Aug 21 08:32:44.291926134 (303h6m38.723006265s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:32:44.291930582 (303h6m38.723010713s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:32:44.738163778 (303h6m39.169243909s) [seg_pos={0 0}, upload=315290]: Begin upload segment...
Aug 21 08:32:44.738227320 (303h6m39.169307451s) [seg_pos={0 0}, upload=315290]: Done begin upload segment.
Aug 21 08:32:44.738253380 (303h6m39.169333511s) [noise=true , address=45.91.116.11:4123 , piece_id=DQY2VDS6G4IKAHCMZZM56XB7ITWUCYK7IJOQLAQUZX5PU6B64KAA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738284550 (303h6m39.169364681s) [noise=true , address=77.90.31.10:4546 , piece_id=PAWKSB2WXPD5ZTEWSFBXITHJQNCNO6SWZBW674UTN4OZFJ5LHLWQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738659918 (303h6m39.169740049s) [noise=true , address=79.127.201.214:4309 , piece_id=RGQEAB7D4M6ZMHMYBMZZUUO3MWRWNJ2NN5JGSWWCTF4GYOZCU22A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738781741 (303h6m39.169861872s) [noise=true , address=104.36.82.18:4381 , piece_id=6UGBZRYNKWRJLE5P7EXFPEITS6A3TVZ7TO4YQOPBRLP4URFQQWAA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739071375 (303h6m39.170151496s) [noise=true , address=104.36.82.60:4344 , piece_id=VR3M4HZL7BMYP7M7FHEJXF5GC3KV6TEHJR4NK3FIRVGI5ACP4O5A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739109368 (303h6m39.170189519s) [noise=true , address=77.90.31.11:4579 , piece_id=CI4OJMHG6FTRFIWBNY7WU6IZCA4WPQJMPXYBB45F2SLYYK2G57PA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739461611 (303h6m39.170541742s) [noise=true , address=104.36.82.5:4857 , piece_id=X5CGC5D4YMYK7VSDNWNRK6H6HOARSAMIEKNMZJY5UEPLR3QC55VQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739707502 (303h6m39.170787623s) [noise=true , address=77.90.31.21:4892 , piece_id=HT2FX75PM54GJQ5SZVRRBDOFE5LHWNYGUC4375ITHFOVE5RE36FA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739979432 (303h6m39.171059563s) [noise=true , address=79.127.220.98:4428 , piece_id=HEOYTV6HLP7DROD4A5LI52FEPB42LNUDU3DTF2FQ6CAGWSUGQAOA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.740334211 (303h6m39.171414342s) [noise=true , address=45.91.116.14:4201 , piece_id=NKKPHWYDX4CNVJLQKWQNBHX5WG5KTXEE3YDZKXG3TCIEEX3B6Q7A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.740702757 (303h6m39.171782888s) [noise=true , address=77.90.31.18:4823 , piece_id=M6WHF47D2LPGQTWYNQ54X4T54YDVYG45LSPESERPTMO3HGBEKH3Q, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741073696 (303h6m39.172153827s) [noise=true , address=77.90.31.13:4625 , piece_id=7GIUTOH7EMHBQPMGGGR4NKN3OT33ROXRBGTQAPJL6RUYGN66GHJQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741307855 (303h6m39.172387986s) [noise=true , address=104.36.82.23:4470 , piece_id=SNS3SF7ONWF44XRIWOIU6X3UCMBSNRGOVTDLNVYHWOBVU77DTWQA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741570477 (303h6m39.172650608s) [noise=true , address=77.90.31.12:4603 , piece_id=LYGOPXZ2Z4G2X2P57I7IAHMZ4JAWS5M7LIMKII4TU7YESK34H4BA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741776291 (303h6m39.172856422s) [noise=true , address=45.91.116.6:4004 , piece_id=54EGRMVODNBFJG4SSIC5OA6UK7RG7XMGCQ34OB756IYT5Y34XH3A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742098488 (303h6m39.173178619s) [noise=true , address=79.127.219.48:4106 , piece_id=JKVOH7BP7GGGSJICQPAIUPWYXQ4ER64LWHUZJ26QR2CBGNYQSFJA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742361460 (303h6m39.173441591s) [noise=true , address=77.90.31.17:4792 , piece_id=YCHJKRJJPI5XWGDSJFDUIE6QPWBV7FQ7W7ZQWRZLMVLYF4TOLVFQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742575059 (303h6m39.17365519s) [noise=true , address=77.90.31.16:4750 , piece_id=7LU6NJRAMHJ4S7VH5Z43DBVGYJIBQL3TU3DJK2C7FMQMJXWOJYWA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:46.208660569 (303h6m40.63974069s) [upload=315290]: Next returned nil segment
Aug 21 08:32:46.208680407 (303h6m40.639760538s) [upload=315290]: Waiting for error group managing segments...
Aug 21 08:32:46.584651402 (303h6m41.015731534s) [noise=true , address=79.127.220.98:4428 , piece_id=HEOYTV6HLP7DROD4A5LI52FEPB42LNUDU3DTF2FQ6CAGWSUGQAOA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.627652681 (303h6m41.058732812s) [noise=true , address=77.90.31.11:4579 , piece_id=CI4OJMHG6FTRFIWBNY7WU6IZCA4WPQJMPXYBB45F2SLYYK2G57PA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.639164989 (303h6m41.07024512s) [noise=true , address=77.90.31.10:4546 , piece_id=PAWKSB2WXPD5ZTEWSFBXITHJQNCNO6SWZBW674UTN4OZFJ5LHLWQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.644526758 (303h6m41.075606889s) [noise=true , address=45.91.116.6:4004 , piece_id=54EGRMVODNBFJG4SSIC5OA6UK7RG7XMGCQ34OB756IYT5Y34XH3A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.647891717 (303h6m41.078971848s) [noise=true , address=77.90.31.13:4625 , piece_id=7GIUTOH7EMHBQPMGGGR4NKN3OT33ROXRBGTQAPJL6RUYGN66GHJQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.661037670 (303h6m41.092117801s) [noise=true , address=45.91.116.14:4201 , piece_id=NKKPHWYDX4CNVJLQKWQNBHX5WG5KTXEE3YDZKXG3TCIEEX3B6Q7A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.661700518 (303h6m41.092780639s) [noise=true , address=77.90.31.12:4603 , piece_id=LYGOPXZ2Z4G2X2P57I7IAHMZ4JAWS5M7LIMKII4TU7YESK34H4BA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.668984736 (303h6m41.100064867s) [noise=true , address=104.36.82.5:4857 , piece_id=X5CGC5D4YMYK7VSDNWNRK6H6HOARSAMIEKNMZJY5UEPLR3QC55VQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.720272381 (303h6m41.151352502s) [noise=true , address=77.90.31.21:4892 , piece_id=HT2FX75PM54GJQ5SZVRRBDOFE5LHWNYGUC4375ITHFOVE5RE36FA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.727460995 (303h6m41.158541126s) [noise=true , address=104.36.82.60:4344 , piece_id=VR3M4HZL7BMYP7M7FHEJXF5GC3KV6TEHJR4NK3FIRVGI5ACP4O5A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.748559526 (303h6m41.179639657s) [noise=true , address=79.127.219.48:4106 , piece_id=JKVOH7BP7GGGSJICQPAIUPWYXQ4ER64LWHUZJ26QR2CBGNYQSFJA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.751055311 (303h6m41.182135432s) [noise=true , address=77.90.31.16:4750 , piece_id=7LU6NJRAMHJ4S7VH5Z43DBVGYJIBQL3TU3DJK2C7FMQMJXWOJYWA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.805486109 (303h6m41.23656624s) [noise=true , address=77.90.31.18:4823 , piece_id=M6WHF47D2LPGQTWYNQ54X4T54YDVYG45LSPESERPTMO3HGBEKH3Q, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.859109913 (303h6m41.290190044s) [noise=true , address=79.127.201.214:4309 , piece_id=RGQEAB7D4M6ZMHMYBMZZUUO3MWRWNJ2NN5JGSWWCTF4GYOZCU22A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.859129040 (303h6m41.290209171s) [seg_pos={0 0}, upload=315290]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:32:46.859262125 (303h6m41.290342256s) [noise=true , address=77.90.31.17:4792 , piece_id=YCHJKRJJPI5XWGDSJFDUIE6QPWBV7FQ7W7ZQWRZLMVLYF4TOLVFQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SPFgYZnbwjEupjaghfs61qwFM678KNPwpDmRNqV1j2opNgZCN): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859414826 (303h6m41.290494958s) [noise=true , address=104.36.82.23:4470 , piece_id=SNS3SF7ONWF44XRIWOIU6X3UCMBSNRGOVTDLNVYHWOBVU77DTWQA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FT9cn7mxuyJ7xBeCJgyTcJKFRmHEqboqeGWLvygNceEo4LQVF): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859471805 (303h6m41.290551936s) [noise=true , address=104.36.82.18:4381 , piece_id=6UGBZRYNKWRJLE5P7EXFPEITS6A3TVZ7TO4YQOPBRLP4URFQQWAA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RhN3jMBTt6LXsgym5RNMM4CvjhcSRhgjbRvSpE1TQTgQdJi9): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859616393 (303h6m41.290696524s) [noise=true , address=45.91.116.11:4123 , piece_id=DQY2VDS6G4IKAHCMZZM56XB7ITWUCYK7IJOQLAQUZX5PU6B64KAA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kjHfRVsDASQz36zUAHrXsLJausE7UTNzHgiFWpys4bQK21cAE): protocol: write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection; write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection
Aug 21 08:32:46.859628385 (303h6m41.290708516s) [seg_pos={0 0}, upload=315290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:32:46.859704171 (303h6m41.290784302s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:32:46.859708469 (303h6m41.2907886s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:32:47.160630836 (303h6m41.591710967s) [upload=315290]: Done uploading segments...
Aug 21 08:32:47.160650694 (303h6m41.591730826s) [upload=315290]: Upload finished. err: <nil>
Duration: 5.584969954s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.........X.X....X......X...X..X.............................] duration:
1.852510857s
FAIL (2025-08-21 08:34:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.852536748s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..........X.X....X......X...X..X............................] duration:
2.153703744s
FAIL (2025-08-21 08:33:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.153724203s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...........X.X....X......X...X..X...........................] duration:
1.812851775s
FAIL (2025-08-21 08:33:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.812876402s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.........X..................X.....X..X.....X..............X.] duration:
5.532772781s
FAIL (2025-08-21 08:33:08 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 08:32:44.291596413 (303h6m38.722676544s) [upload=315290]: Starting upload
Aug 21 08:32:44.291654895 (303h6m38.722735026s) [upload=315290]: Done starting upload
Aug 21 08:32:44.291758664 (303h6m38.722838815s) [upload=315290]: Uploading segments...
Aug 21 08:32:44.291898331 (303h6m38.722978472s) [upload=315290]: Got next segment. Inline: false
Aug 21 08:32:44.291926134 (303h6m38.723006265s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:32:44.291930582 (303h6m38.723010713s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:32:44.738163778 (303h6m39.169243909s) [seg_pos={0 0}, upload=315290]: Begin upload segment...
Aug 21 08:32:44.738227320 (303h6m39.169307451s) [seg_pos={0 0}, upload=315290]: Done begin upload segment.
Aug 21 08:32:44.738253380 (303h6m39.169333511s) [noise=true , address=45.91.116.11:4123 , piece_id=DQY2VDS6G4IKAHCMZZM56XB7ITWUCYK7IJOQLAQUZX5PU6B64KAA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738284550 (303h6m39.169364681s) [noise=true , address=77.90.31.10:4546 , piece_id=PAWKSB2WXPD5ZTEWSFBXITHJQNCNO6SWZBW674UTN4OZFJ5LHLWQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738659918 (303h6m39.169740049s) [noise=true , address=79.127.201.214:4309 , piece_id=RGQEAB7D4M6ZMHMYBMZZUUO3MWRWNJ2NN5JGSWWCTF4GYOZCU22A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738781741 (303h6m39.169861872s) [noise=true , address=104.36.82.18:4381 , piece_id=6UGBZRYNKWRJLE5P7EXFPEITS6A3TVZ7TO4YQOPBRLP4URFQQWAA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739071375 (303h6m39.170151496s) [noise=true , address=104.36.82.60:4344 , piece_id=VR3M4HZL7BMYP7M7FHEJXF5GC3KV6TEHJR4NK3FIRVGI5ACP4O5A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739109368 (303h6m39.170189519s) [noise=true , address=77.90.31.11:4579 , piece_id=CI4OJMHG6FTRFIWBNY7WU6IZCA4WPQJMPXYBB45F2SLYYK2G57PA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739461611 (303h6m39.170541742s) [noise=true , address=104.36.82.5:4857 , piece_id=X5CGC5D4YMYK7VSDNWNRK6H6HOARSAMIEKNMZJY5UEPLR3QC55VQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739707502 (303h6m39.170787623s) [noise=true , address=77.90.31.21:4892 , piece_id=HT2FX75PM54GJQ5SZVRRBDOFE5LHWNYGUC4375ITHFOVE5RE36FA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739979432 (303h6m39.171059563s) [noise=true , address=79.127.220.98:4428 , piece_id=HEOYTV6HLP7DROD4A5LI52FEPB42LNUDU3DTF2FQ6CAGWSUGQAOA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.740334211 (303h6m39.171414342s) [noise=true , address=45.91.116.14:4201 , piece_id=NKKPHWYDX4CNVJLQKWQNBHX5WG5KTXEE3YDZKXG3TCIEEX3B6Q7A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.740702757 (303h6m39.171782888s) [noise=true , address=77.90.31.18:4823 , piece_id=M6WHF47D2LPGQTWYNQ54X4T54YDVYG45LSPESERPTMO3HGBEKH3Q, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741073696 (303h6m39.172153827s) [noise=true , address=77.90.31.13:4625 , piece_id=7GIUTOH7EMHBQPMGGGR4NKN3OT33ROXRBGTQAPJL6RUYGN66GHJQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741307855 (303h6m39.172387986s) [noise=true , address=104.36.82.23:4470 , piece_id=SNS3SF7ONWF44XRIWOIU6X3UCMBSNRGOVTDLNVYHWOBVU77DTWQA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741570477 (303h6m39.172650608s) [noise=true , address=77.90.31.12:4603 , piece_id=LYGOPXZ2Z4G2X2P57I7IAHMZ4JAWS5M7LIMKII4TU7YESK34H4BA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741776291 (303h6m39.172856422s) [noise=true , address=45.91.116.6:4004 , piece_id=54EGRMVODNBFJG4SSIC5OA6UK7RG7XMGCQ34OB756IYT5Y34XH3A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742098488 (303h6m39.173178619s) [noise=true , address=79.127.219.48:4106 , piece_id=JKVOH7BP7GGGSJICQPAIUPWYXQ4ER64LWHUZJ26QR2CBGNYQSFJA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742361460 (303h6m39.173441591s) [noise=true , address=77.90.31.17:4792 , piece_id=YCHJKRJJPI5XWGDSJFDUIE6QPWBV7FQ7W7ZQWRZLMVLYF4TOLVFQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742575059 (303h6m39.17365519s) [noise=true , address=77.90.31.16:4750 , piece_id=7LU6NJRAMHJ4S7VH5Z43DBVGYJIBQL3TU3DJK2C7FMQMJXWOJYWA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:46.208660569 (303h6m40.63974069s) [upload=315290]: Next returned nil segment
Aug 21 08:32:46.208680407 (303h6m40.639760538s) [upload=315290]: Waiting for error group managing segments...
Aug 21 08:32:46.584651402 (303h6m41.015731534s) [noise=true , address=79.127.220.98:4428 , piece_id=HEOYTV6HLP7DROD4A5LI52FEPB42LNUDU3DTF2FQ6CAGWSUGQAOA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.627652681 (303h6m41.058732812s) [noise=true , address=77.90.31.11:4579 , piece_id=CI4OJMHG6FTRFIWBNY7WU6IZCA4WPQJMPXYBB45F2SLYYK2G57PA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.639164989 (303h6m41.07024512s) [noise=true , address=77.90.31.10:4546 , piece_id=PAWKSB2WXPD5ZTEWSFBXITHJQNCNO6SWZBW674UTN4OZFJ5LHLWQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.644526758 (303h6m41.075606889s) [noise=true , address=45.91.116.6:4004 , piece_id=54EGRMVODNBFJG4SSIC5OA6UK7RG7XMGCQ34OB756IYT5Y34XH3A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.647891717 (303h6m41.078971848s) [noise=true , address=77.90.31.13:4625 , piece_id=7GIUTOH7EMHBQPMGGGR4NKN3OT33ROXRBGTQAPJL6RUYGN66GHJQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.661037670 (303h6m41.092117801s) [noise=true , address=45.91.116.14:4201 , piece_id=NKKPHWYDX4CNVJLQKWQNBHX5WG5KTXEE3YDZKXG3TCIEEX3B6Q7A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.661700518 (303h6m41.092780639s) [noise=true , address=77.90.31.12:4603 , piece_id=LYGOPXZ2Z4G2X2P57I7IAHMZ4JAWS5M7LIMKII4TU7YESK34H4BA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.668984736 (303h6m41.100064867s) [noise=true , address=104.36.82.5:4857 , piece_id=X5CGC5D4YMYK7VSDNWNRK6H6HOARSAMIEKNMZJY5UEPLR3QC55VQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.720272381 (303h6m41.151352502s) [noise=true , address=77.90.31.21:4892 , piece_id=HT2FX75PM54GJQ5SZVRRBDOFE5LHWNYGUC4375ITHFOVE5RE36FA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.727460995 (303h6m41.158541126s) [noise=true , address=104.36.82.60:4344 , piece_id=VR3M4HZL7BMYP7M7FHEJXF5GC3KV6TEHJR4NK3FIRVGI5ACP4O5A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.748559526 (303h6m41.179639657s) [noise=true , address=79.127.219.48:4106 , piece_id=JKVOH7BP7GGGSJICQPAIUPWYXQ4ER64LWHUZJ26QR2CBGNYQSFJA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.751055311 (303h6m41.182135432s) [noise=true , address=77.90.31.16:4750 , piece_id=7LU6NJRAMHJ4S7VH5Z43DBVGYJIBQL3TU3DJK2C7FMQMJXWOJYWA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.805486109 (303h6m41.23656624s) [noise=true , address=77.90.31.18:4823 , piece_id=M6WHF47D2LPGQTWYNQ54X4T54YDVYG45LSPESERPTMO3HGBEKH3Q, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.859109913 (303h6m41.290190044s) [noise=true , address=79.127.201.214:4309 , piece_id=RGQEAB7D4M6ZMHMYBMZZUUO3MWRWNJ2NN5JGSWWCTF4GYOZCU22A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.859129040 (303h6m41.290209171s) [seg_pos={0 0}, upload=315290]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:32:46.859262125 (303h6m41.290342256s) [noise=true , address=77.90.31.17:4792 , piece_id=YCHJKRJJPI5XWGDSJFDUIE6QPWBV7FQ7W7ZQWRZLMVLYF4TOLVFQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SPFgYZnbwjEupjaghfs61qwFM678KNPwpDmRNqV1j2opNgZCN): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859414826 (303h6m41.290494958s) [noise=true , address=104.36.82.23:4470 , piece_id=SNS3SF7ONWF44XRIWOIU6X3UCMBSNRGOVTDLNVYHWOBVU77DTWQA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FT9cn7mxuyJ7xBeCJgyTcJKFRmHEqboqeGWLvygNceEo4LQVF): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859471805 (303h6m41.290551936s) [noise=true , address=104.36.82.18:4381 , piece_id=6UGBZRYNKWRJLE5P7EXFPEITS6A3TVZ7TO4YQOPBRLP4URFQQWAA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RhN3jMBTt6LXsgym5RNMM4CvjhcSRhgjbRvSpE1TQTgQdJi9): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859616393 (303h6m41.290696524s) [noise=true , address=45.91.116.11:4123 , piece_id=DQY2VDS6G4IKAHCMZZM56XB7ITWUCYK7IJOQLAQUZX5PU6B64KAA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kjHfRVsDASQz36zUAHrXsLJausE7UTNzHgiFWpys4bQK21cAE): protocol: write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection; write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection
Aug 21 08:32:46.859628385 (303h6m41.290708516s) [seg_pos={0 0}, upload=315290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:32:46.859704171 (303h6m41.290784302s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:32:46.859708469 (303h6m41.2907886s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:32:47.160630836 (303h6m41.591710967s) [upload=315290]: Done uploading segments...
Aug 21 08:32:47.160650694 (303h6m41.591730826s) [upload=315290]: Upload finished. err: <nil>
Duration: 5.532799211s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..........X..................X.....X..X.....X..............X] duration:
4.259784435s
FAIL (2025-08-21 08:32:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 08:32:44.291596413 (303h6m38.722676544s) [upload=315290]: Starting upload
Aug 21 08:32:44.291654895 (303h6m38.722735026s) [upload=315290]: Done starting upload
Aug 21 08:32:44.291758664 (303h6m38.722838815s) [upload=315290]: Uploading segments...
Aug 21 08:32:44.291898331 (303h6m38.722978472s) [upload=315290]: Got next segment. Inline: false
Aug 21 08:32:44.291926134 (303h6m38.723006265s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:32:44.291930582 (303h6m38.723010713s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:32:44.738163778 (303h6m39.169243909s) [seg_pos={0 0}, upload=315290]: Begin upload segment...
Aug 21 08:32:44.738227320 (303h6m39.169307451s) [seg_pos={0 0}, upload=315290]: Done begin upload segment.
Aug 21 08:32:44.738253380 (303h6m39.169333511s) [noise=true , address=45.91.116.11:4123 , piece_id=DQY2VDS6G4IKAHCMZZM56XB7ITWUCYK7IJOQLAQUZX5PU6B64KAA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738284550 (303h6m39.169364681s) [noise=true , address=77.90.31.10:4546 , piece_id=PAWKSB2WXPD5ZTEWSFBXITHJQNCNO6SWZBW674UTN4OZFJ5LHLWQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738659918 (303h6m39.169740049s) [noise=true , address=79.127.201.214:4309 , piece_id=RGQEAB7D4M6ZMHMYBMZZUUO3MWRWNJ2NN5JGSWWCTF4GYOZCU22A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.738781741 (303h6m39.169861872s) [noise=true , address=104.36.82.18:4381 , piece_id=6UGBZRYNKWRJLE5P7EXFPEITS6A3TVZ7TO4YQOPBRLP4URFQQWAA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739071375 (303h6m39.170151496s) [noise=true , address=104.36.82.60:4344 , piece_id=VR3M4HZL7BMYP7M7FHEJXF5GC3KV6TEHJR4NK3FIRVGI5ACP4O5A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739109368 (303h6m39.170189519s) [noise=true , address=77.90.31.11:4579 , piece_id=CI4OJMHG6FTRFIWBNY7WU6IZCA4WPQJMPXYBB45F2SLYYK2G57PA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739461611 (303h6m39.170541742s) [noise=true , address=104.36.82.5:4857 , piece_id=X5CGC5D4YMYK7VSDNWNRK6H6HOARSAMIEKNMZJY5UEPLR3QC55VQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739707502 (303h6m39.170787623s) [noise=true , address=77.90.31.21:4892 , piece_id=HT2FX75PM54GJQ5SZVRRBDOFE5LHWNYGUC4375ITHFOVE5RE36FA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.739979432 (303h6m39.171059563s) [noise=true , address=79.127.220.98:4428 , piece_id=HEOYTV6HLP7DROD4A5LI52FEPB42LNUDU3DTF2FQ6CAGWSUGQAOA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.740334211 (303h6m39.171414342s) [noise=true , address=45.91.116.14:4201 , piece_id=NKKPHWYDX4CNVJLQKWQNBHX5WG5KTXEE3YDZKXG3TCIEEX3B6Q7A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.740702757 (303h6m39.171782888s) [noise=true , address=77.90.31.18:4823 , piece_id=M6WHF47D2LPGQTWYNQ54X4T54YDVYG45LSPESERPTMO3HGBEKH3Q, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741073696 (303h6m39.172153827s) [noise=true , address=77.90.31.13:4625 , piece_id=7GIUTOH7EMHBQPMGGGR4NKN3OT33ROXRBGTQAPJL6RUYGN66GHJQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741307855 (303h6m39.172387986s) [noise=true , address=104.36.82.23:4470 , piece_id=SNS3SF7ONWF44XRIWOIU6X3UCMBSNRGOVTDLNVYHWOBVU77DTWQA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741570477 (303h6m39.172650608s) [noise=true , address=77.90.31.12:4603 , piece_id=LYGOPXZ2Z4G2X2P57I7IAHMZ4JAWS5M7LIMKII4TU7YESK34H4BA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.741776291 (303h6m39.172856422s) [noise=true , address=45.91.116.6:4004 , piece_id=54EGRMVODNBFJG4SSIC5OA6UK7RG7XMGCQ34OB756IYT5Y34XH3A, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742098488 (303h6m39.173178619s) [noise=true , address=79.127.219.48:4106 , piece_id=JKVOH7BP7GGGSJICQPAIUPWYXQ4ER64LWHUZJ26QR2CBGNYQSFJA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742361460 (303h6m39.173441591s) [noise=true , address=77.90.31.17:4792 , piece_id=YCHJKRJJPI5XWGDSJFDUIE6QPWBV7FQ7W7ZQWRZLMVLYF4TOLVFQ, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:44.742575059 (303h6m39.17365519s) [noise=true , address=77.90.31.16:4750 , piece_id=7LU6NJRAMHJ4S7VH5Z43DBVGYJIBQL3TU3DJK2C7FMQMJXWOJYWA, seg_pos={0 0}, upload=315290]: Uploading piece...
Aug 21 08:32:46.208660569 (303h6m40.63974069s) [upload=315290]: Next returned nil segment
Aug 21 08:32:46.208680407 (303h6m40.639760538s) [upload=315290]: Waiting for error group managing segments...
Aug 21 08:32:46.584651402 (303h6m41.015731534s) [noise=true , address=79.127.220.98:4428 , piece_id=HEOYTV6HLP7DROD4A5LI52FEPB42LNUDU3DTF2FQ6CAGWSUGQAOA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.627652681 (303h6m41.058732812s) [noise=true , address=77.90.31.11:4579 , piece_id=CI4OJMHG6FTRFIWBNY7WU6IZCA4WPQJMPXYBB45F2SLYYK2G57PA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.639164989 (303h6m41.07024512s) [noise=true , address=77.90.31.10:4546 , piece_id=PAWKSB2WXPD5ZTEWSFBXITHJQNCNO6SWZBW674UTN4OZFJ5LHLWQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.644526758 (303h6m41.075606889s) [noise=true , address=45.91.116.6:4004 , piece_id=54EGRMVODNBFJG4SSIC5OA6UK7RG7XMGCQ34OB756IYT5Y34XH3A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.647891717 (303h6m41.078971848s) [noise=true , address=77.90.31.13:4625 , piece_id=7GIUTOH7EMHBQPMGGGR4NKN3OT33ROXRBGTQAPJL6RUYGN66GHJQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.661037670 (303h6m41.092117801s) [noise=true , address=45.91.116.14:4201 , piece_id=NKKPHWYDX4CNVJLQKWQNBHX5WG5KTXEE3YDZKXG3TCIEEX3B6Q7A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.661700518 (303h6m41.092780639s) [noise=true , address=77.90.31.12:4603 , piece_id=LYGOPXZ2Z4G2X2P57I7IAHMZ4JAWS5M7LIMKII4TU7YESK34H4BA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.668984736 (303h6m41.100064867s) [noise=true , address=104.36.82.5:4857 , piece_id=X5CGC5D4YMYK7VSDNWNRK6H6HOARSAMIEKNMZJY5UEPLR3QC55VQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.720272381 (303h6m41.151352502s) [noise=true , address=77.90.31.21:4892 , piece_id=HT2FX75PM54GJQ5SZVRRBDOFE5LHWNYGUC4375ITHFOVE5RE36FA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.727460995 (303h6m41.158541126s) [noise=true , address=104.36.82.60:4344 , piece_id=VR3M4HZL7BMYP7M7FHEJXF5GC3KV6TEHJR4NK3FIRVGI5ACP4O5A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.748559526 (303h6m41.179639657s) [noise=true , address=79.127.219.48:4106 , piece_id=JKVOH7BP7GGGSJICQPAIUPWYXQ4ER64LWHUZJ26QR2CBGNYQSFJA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.751055311 (303h6m41.182135432s) [noise=true , address=77.90.31.16:4750 , piece_id=7LU6NJRAMHJ4S7VH5Z43DBVGYJIBQL3TU3DJK2C7FMQMJXWOJYWA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.805486109 (303h6m41.23656624s) [noise=true , address=77.90.31.18:4823 , piece_id=M6WHF47D2LPGQTWYNQ54X4T54YDVYG45LSPESERPTMO3HGBEKH3Q, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.859109913 (303h6m41.290190044s) [noise=true , address=79.127.201.214:4309 , piece_id=RGQEAB7D4M6ZMHMYBMZZUUO3MWRWNJ2NN5JGSWWCTF4GYOZCU22A, seg_pos={0 0}, upload=315290]: Done uploading piece. err: <nil>
Aug 21 08:32:46.859129040 (303h6m41.290209171s) [seg_pos={0 0}, upload=315290]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:32:46.859262125 (303h6m41.290342256s) [noise=true , address=77.90.31.17:4792 , piece_id=YCHJKRJJPI5XWGDSJFDUIE6QPWBV7FQ7W7ZQWRZLMVLYF4TOLVFQ, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SPFgYZnbwjEupjaghfs61qwFM678KNPwpDmRNqV1j2opNgZCN): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859414826 (303h6m41.290494958s) [noise=true , address=104.36.82.23:4470 , piece_id=SNS3SF7ONWF44XRIWOIU6X3UCMBSNRGOVTDLNVYHWOBVU77DTWQA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FT9cn7mxuyJ7xBeCJgyTcJKFRmHEqboqeGWLvygNceEo4LQVF): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859471805 (303h6m41.290551936s) [noise=true , address=104.36.82.18:4381 , piece_id=6UGBZRYNKWRJLE5P7EXFPEITS6A3TVZ7TO4YQOPBRLP4URFQQWAA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RhN3jMBTt6LXsgym5RNMM4CvjhcSRhgjbRvSpE1TQTgQdJi9): protocol: expected piece hash; context canceled; EOF
Aug 21 08:32:46.859616393 (303h6m41.290696524s) [noise=true , address=45.91.116.11:4123 , piece_id=DQY2VDS6G4IKAHCMZZM56XB7ITWUCYK7IJOQLAQUZX5PU6B64KAA, seg_pos={0 0}, upload=315290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kjHfRVsDASQz36zUAHrXsLJausE7UTNzHgiFWpys4bQK21cAE): protocol: write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection; write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43176->45.91.116.11:4123: use of closed network connection
Aug 21 08:32:46.859628385 (303h6m41.290708516s) [seg_pos={0 0}, upload=315290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:32:46.859704171 (303h6m41.290784302s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:32:46.859708469 (303h6m41.2907886s) [upload=315290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:32:47.160630836 (303h6m41.591710967s) [upload=315290]: Done uploading segments...
Aug 21 08:32:47.160650694 (303h6m41.591730826s) [upload=315290]: Upload finished. err: <nil>
Duration: 4.259811757s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [............X.X....X......X...X..X..........................] duration:
1.847342209s
FAIL (2025-08-21 08:32:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.847380592s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...........X..................X.....X..X.....X..............] duration:
5.804809725s
FAIL (2025-08-21 08:32:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 08:22:50.617857206 (302h56m45.048937337s) [upload=315124]: Starting upload
Aug 21 08:22:50.617937189 (302h56m45.04901732s) [upload=315124]: Done starting upload
Aug 21 08:22:50.618097486 (302h56m45.049177667s) [upload=315124]: Uploading segments...
Aug 21 08:22:50.618363846 (302h56m45.049443977s) [upload=315124]: Got next segment. Inline: false
Aug 21 08:22:50.618457594 (302h56m45.049537756s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:22:50.618465591 (302h56m45.049545752s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:22:51.102693840 (302h56m45.533773971s) [seg_pos={0 0}, upload=315124]: Begin upload segment...
Aug 21 08:22:51.102743835 (302h56m45.533823956s) [seg_pos={0 0}, upload=315124]: Done begin upload segment.
Aug 21 08:22:51.102772089 (302h56m45.533852221s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.102816886 (302h56m45.533897057s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103154631 (302h56m45.534234763s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103325929 (302h56m45.53440606s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103432112 (302h56m45.534512233s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.104580289 (302h56m45.53566042s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105002427 (302h56m45.536082558s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105257976 (302h56m45.536338107s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105840851 (302h56m45.536920982s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106639810 (302h56m45.537719941s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106893956 (302h56m45.537974077s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107321134 (302h56m45.538401265s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107989602 (302h56m45.539069723s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108252655 (302h56m45.539332776s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108500671 (302h56m45.539580792s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108788000 (302h56m45.539868131s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109590405 (302h56m45.540670536s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109879138 (302h56m45.540959269s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:52.607264993 (302h56m47.038345124s) [upload=315124]: Next returned nil segment
Aug 21 08:22:52.607281043 (302h56m47.038361164s) [upload=315124]: Waiting for error group managing segments...
Aug 21 08:22:52.993440879 (302h56m47.42452101s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:52.994339859 (302h56m47.42541998s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.030923166 (302h56m47.462003287s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.045072480 (302h56m47.476152611s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.048431668 (302h56m47.479511799s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.058354743 (302h56m47.489434875s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.067002511 (302h56m47.498082642s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.069177272 (302h56m47.500257403s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.075997161 (302h56m47.507077292s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.076289810 (302h56m47.507369931s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.086108557 (302h56m47.517188689s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.117753797 (302h56m47.548833928s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.139783219 (302h56m47.57086334s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196138137 (302h56m47.627218268s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196161893 (302h56m47.627242024s) [seg_pos={0 0}, upload=315124]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:22:53.196294868 (302h56m47.627374989s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZAfYZ4wgpZVvatj6wtHona3hTaPcLxAmXC1DT2uKQyo8nLQQ7): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196352307 (302h56m47.627432428s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122EX4PNuiRTCG2gbgbaL5dAtD8s5SN7ZesShk7NqUTGCZ3gA2a): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196429455 (302h56m47.627509586s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S9DQZhV6SDULbA9WKndh12CpFih6xtNcpdwUApD9d2XThFdFk): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196508005 (302h56m47.627588136s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196544295 (302h56m47.627624416s) [seg_pos={0 0}, upload=315124]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:22:53.196625680 (302h56m47.627705812s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:22:53.196630980 (302h56m47.627711111s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:22:53.523344192 (302h56m47.954424313s) [upload=315124]: Done uploading segments...
Aug 21 08:22:53.523364170 (302h56m47.954444301s) [upload=315124]: Upload finished. err: <nil>
Duration: 5.8048392s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.............X.X....X......X...X..X.........................] duration:
1.846474058s
FAIL (2025-08-21 08:31:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.846499687s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..............X.X....X......X...X..X........................] duration:
1.953523945s
FAIL (2025-08-21 08:31:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.953551528s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [............X..................X.....X..X.....X.............] duration:
5.631085345s
FAIL (2025-08-21 08:31:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 08:22:50.617857206 (302h56m45.048937337s) [upload=315124]: Starting upload
Aug 21 08:22:50.617937189 (302h56m45.04901732s) [upload=315124]: Done starting upload
Aug 21 08:22:50.618097486 (302h56m45.049177667s) [upload=315124]: Uploading segments...
Aug 21 08:22:50.618363846 (302h56m45.049443977s) [upload=315124]: Got next segment. Inline: false
Aug 21 08:22:50.618457594 (302h56m45.049537756s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:22:50.618465591 (302h56m45.049545752s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:22:51.102693840 (302h56m45.533773971s) [seg_pos={0 0}, upload=315124]: Begin upload segment...
Aug 21 08:22:51.102743835 (302h56m45.533823956s) [seg_pos={0 0}, upload=315124]: Done begin upload segment.
Aug 21 08:22:51.102772089 (302h56m45.533852221s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.102816886 (302h56m45.533897057s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103154631 (302h56m45.534234763s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103325929 (302h56m45.53440606s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103432112 (302h56m45.534512233s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.104580289 (302h56m45.53566042s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105002427 (302h56m45.536082558s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105257976 (302h56m45.536338107s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105840851 (302h56m45.536920982s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106639810 (302h56m45.537719941s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106893956 (302h56m45.537974077s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107321134 (302h56m45.538401265s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107989602 (302h56m45.539069723s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108252655 (302h56m45.539332776s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108500671 (302h56m45.539580792s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108788000 (302h56m45.539868131s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109590405 (302h56m45.540670536s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109879138 (302h56m45.540959269s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:52.607264993 (302h56m47.038345124s) [upload=315124]: Next returned nil segment
Aug 21 08:22:52.607281043 (302h56m47.038361164s) [upload=315124]: Waiting for error group managing segments...
Aug 21 08:22:52.993440879 (302h56m47.42452101s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:52.994339859 (302h56m47.42541998s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.030923166 (302h56m47.462003287s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.045072480 (302h56m47.476152611s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.048431668 (302h56m47.479511799s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.058354743 (302h56m47.489434875s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.067002511 (302h56m47.498082642s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.069177272 (302h56m47.500257403s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.075997161 (302h56m47.507077292s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.076289810 (302h56m47.507369931s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.086108557 (302h56m47.517188689s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.117753797 (302h56m47.548833928s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.139783219 (302h56m47.57086334s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196138137 (302h56m47.627218268s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196161893 (302h56m47.627242024s) [seg_pos={0 0}, upload=315124]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:22:53.196294868 (302h56m47.627374989s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZAfYZ4wgpZVvatj6wtHona3hTaPcLxAmXC1DT2uKQyo8nLQQ7): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196352307 (302h56m47.627432428s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122EX4PNuiRTCG2gbgbaL5dAtD8s5SN7ZesShk7NqUTGCZ3gA2a): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196429455 (302h56m47.627509586s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S9DQZhV6SDULbA9WKndh12CpFih6xtNcpdwUApD9d2XThFdFk): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196508005 (302h56m47.627588136s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196544295 (302h56m47.627624416s) [seg_pos={0 0}, upload=315124]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:22:53.196625680 (302h56m47.627705812s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:22:53.196630980 (302h56m47.627711111s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:22:53.523344192 (302h56m47.954424313s) [upload=315124]: Done uploading segments...
Aug 21 08:22:53.523364170 (302h56m47.954444301s) [upload=315124]: Upload finished. err: <nil>
Duration: 5.631110875s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.............X..................X.....X..X.....X............] duration:
5.549304246s
FAIL (2025-08-21 08:30:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 08:22:50.617857206 (302h56m45.048937337s) [upload=315124]: Starting upload
Aug 21 08:22:50.617937189 (302h56m45.04901732s) [upload=315124]: Done starting upload
Aug 21 08:22:50.618097486 (302h56m45.049177667s) [upload=315124]: Uploading segments...
Aug 21 08:22:50.618363846 (302h56m45.049443977s) [upload=315124]: Got next segment. Inline: false
Aug 21 08:22:50.618457594 (302h56m45.049537756s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:22:50.618465591 (302h56m45.049545752s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:22:51.102693840 (302h56m45.533773971s) [seg_pos={0 0}, upload=315124]: Begin upload segment...
Aug 21 08:22:51.102743835 (302h56m45.533823956s) [seg_pos={0 0}, upload=315124]: Done begin upload segment.
Aug 21 08:22:51.102772089 (302h56m45.533852221s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.102816886 (302h56m45.533897057s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103154631 (302h56m45.534234763s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103325929 (302h56m45.53440606s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103432112 (302h56m45.534512233s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.104580289 (302h56m45.53566042s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105002427 (302h56m45.536082558s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105257976 (302h56m45.536338107s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105840851 (302h56m45.536920982s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106639810 (302h56m45.537719941s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106893956 (302h56m45.537974077s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107321134 (302h56m45.538401265s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107989602 (302h56m45.539069723s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108252655 (302h56m45.539332776s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108500671 (302h56m45.539580792s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108788000 (302h56m45.539868131s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109590405 (302h56m45.540670536s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109879138 (302h56m45.540959269s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:52.607264993 (302h56m47.038345124s) [upload=315124]: Next returned nil segment
Aug 21 08:22:52.607281043 (302h56m47.038361164s) [upload=315124]: Waiting for error group managing segments...
Aug 21 08:22:52.993440879 (302h56m47.42452101s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:52.994339859 (302h56m47.42541998s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.030923166 (302h56m47.462003287s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.045072480 (302h56m47.476152611s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.048431668 (302h56m47.479511799s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.058354743 (302h56m47.489434875s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.067002511 (302h56m47.498082642s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.069177272 (302h56m47.500257403s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.075997161 (302h56m47.507077292s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.076289810 (302h56m47.507369931s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.086108557 (302h56m47.517188689s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.117753797 (302h56m47.548833928s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.139783219 (302h56m47.57086334s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196138137 (302h56m47.627218268s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196161893 (302h56m47.627242024s) [seg_pos={0 0}, upload=315124]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:22:53.196294868 (302h56m47.627374989s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZAfYZ4wgpZVvatj6wtHona3hTaPcLxAmXC1DT2uKQyo8nLQQ7): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196352307 (302h56m47.627432428s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122EX4PNuiRTCG2gbgbaL5dAtD8s5SN7ZesShk7NqUTGCZ3gA2a): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196429455 (302h56m47.627509586s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S9DQZhV6SDULbA9WKndh12CpFih6xtNcpdwUApD9d2XThFdFk): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196508005 (302h56m47.627588136s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196544295 (302h56m47.627624416s) [seg_pos={0 0}, upload=315124]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:22:53.196625680 (302h56m47.627705812s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:22:53.196630980 (302h56m47.627711111s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:22:53.523344192 (302h56m47.954424313s) [upload=315124]: Done uploading segments...
Aug 21 08:22:53.523364170 (302h56m47.954444301s) [upload=315124]: Upload finished. err: <nil>
Duration: 5.549329054s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...............X.X....X......X...X..X.......................] duration:
1.844205402s
FAIL (2025-08-21 08:30:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.844233224s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..............X..................X.....X..X.....X...........] duration:
5.504185587s
FAIL (2025-08-21 08:30:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 08:22:50.617857206 (302h56m45.048937337s) [upload=315124]: Starting upload
Aug 21 08:22:50.617937189 (302h56m45.04901732s) [upload=315124]: Done starting upload
Aug 21 08:22:50.618097486 (302h56m45.049177667s) [upload=315124]: Uploading segments...
Aug 21 08:22:50.618363846 (302h56m45.049443977s) [upload=315124]: Got next segment. Inline: false
Aug 21 08:22:50.618457594 (302h56m45.049537756s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:22:50.618465591 (302h56m45.049545752s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:22:51.102693840 (302h56m45.533773971s) [seg_pos={0 0}, upload=315124]: Begin upload segment...
Aug 21 08:22:51.102743835 (302h56m45.533823956s) [seg_pos={0 0}, upload=315124]: Done begin upload segment.
Aug 21 08:22:51.102772089 (302h56m45.533852221s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.102816886 (302h56m45.533897057s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103154631 (302h56m45.534234763s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103325929 (302h56m45.53440606s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103432112 (302h56m45.534512233s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.104580289 (302h56m45.53566042s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105002427 (302h56m45.536082558s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105257976 (302h56m45.536338107s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105840851 (302h56m45.536920982s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106639810 (302h56m45.537719941s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106893956 (302h56m45.537974077s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107321134 (302h56m45.538401265s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107989602 (302h56m45.539069723s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108252655 (302h56m45.539332776s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108500671 (302h56m45.539580792s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108788000 (302h56m45.539868131s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109590405 (302h56m45.540670536s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109879138 (302h56m45.540959269s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:52.607264993 (302h56m47.038345124s) [upload=315124]: Next returned nil segment
Aug 21 08:22:52.607281043 (302h56m47.038361164s) [upload=315124]: Waiting for error group managing segments...
Aug 21 08:22:52.993440879 (302h56m47.42452101s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:52.994339859 (302h56m47.42541998s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.030923166 (302h56m47.462003287s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.045072480 (302h56m47.476152611s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.048431668 (302h56m47.479511799s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.058354743 (302h56m47.489434875s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.067002511 (302h56m47.498082642s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.069177272 (302h56m47.500257403s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.075997161 (302h56m47.507077292s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.076289810 (302h56m47.507369931s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.086108557 (302h56m47.517188689s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.117753797 (302h56m47.548833928s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.139783219 (302h56m47.57086334s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196138137 (302h56m47.627218268s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196161893 (302h56m47.627242024s) [seg_pos={0 0}, upload=315124]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:22:53.196294868 (302h56m47.627374989s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZAfYZ4wgpZVvatj6wtHona3hTaPcLxAmXC1DT2uKQyo8nLQQ7): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196352307 (302h56m47.627432428s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122EX4PNuiRTCG2gbgbaL5dAtD8s5SN7ZesShk7NqUTGCZ3gA2a): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196429455 (302h56m47.627509586s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S9DQZhV6SDULbA9WKndh12CpFih6xtNcpdwUApD9d2XThFdFk): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196508005 (302h56m47.627588136s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196544295 (302h56m47.627624416s) [seg_pos={0 0}, upload=315124]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:22:53.196625680 (302h56m47.627705812s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:22:53.196630980 (302h56m47.627711111s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:22:53.523344192 (302h56m47.954424313s) [upload=315124]: Done uploading segments...
Aug 21 08:22:53.523364170 (302h56m47.954444301s) [upload=315124]: Upload finished. err: <nil>
Duration: 5.504213229s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...............X..................X.....X..X.....X..........] duration:
5.592765506s
FAIL (2025-08-21 08:29:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 08:22:50.617857206 (302h56m45.048937337s) [upload=315124]: Starting upload
Aug 21 08:22:50.617937189 (302h56m45.04901732s) [upload=315124]: Done starting upload
Aug 21 08:22:50.618097486 (302h56m45.049177667s) [upload=315124]: Uploading segments...
Aug 21 08:22:50.618363846 (302h56m45.049443977s) [upload=315124]: Got next segment. Inline: false
Aug 21 08:22:50.618457594 (302h56m45.049537756s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:22:50.618465591 (302h56m45.049545752s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:22:51.102693840 (302h56m45.533773971s) [seg_pos={0 0}, upload=315124]: Begin upload segment...
Aug 21 08:22:51.102743835 (302h56m45.533823956s) [seg_pos={0 0}, upload=315124]: Done begin upload segment.
Aug 21 08:22:51.102772089 (302h56m45.533852221s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.102816886 (302h56m45.533897057s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103154631 (302h56m45.534234763s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103325929 (302h56m45.53440606s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103432112 (302h56m45.534512233s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.104580289 (302h56m45.53566042s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105002427 (302h56m45.536082558s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105257976 (302h56m45.536338107s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105840851 (302h56m45.536920982s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106639810 (302h56m45.537719941s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106893956 (302h56m45.537974077s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107321134 (302h56m45.538401265s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107989602 (302h56m45.539069723s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108252655 (302h56m45.539332776s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108500671 (302h56m45.539580792s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108788000 (302h56m45.539868131s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109590405 (302h56m45.540670536s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109879138 (302h56m45.540959269s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:52.607264993 (302h56m47.038345124s) [upload=315124]: Next returned nil segment
Aug 21 08:22:52.607281043 (302h56m47.038361164s) [upload=315124]: Waiting for error group managing segments...
Aug 21 08:22:52.993440879 (302h56m47.42452101s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:52.994339859 (302h56m47.42541998s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.030923166 (302h56m47.462003287s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.045072480 (302h56m47.476152611s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.048431668 (302h56m47.479511799s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.058354743 (302h56m47.489434875s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.067002511 (302h56m47.498082642s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.069177272 (302h56m47.500257403s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.075997161 (302h56m47.507077292s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.076289810 (302h56m47.507369931s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.086108557 (302h56m47.517188689s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.117753797 (302h56m47.548833928s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.139783219 (302h56m47.57086334s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196138137 (302h56m47.627218268s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196161893 (302h56m47.627242024s) [seg_pos={0 0}, upload=315124]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:22:53.196294868 (302h56m47.627374989s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZAfYZ4wgpZVvatj6wtHona3hTaPcLxAmXC1DT2uKQyo8nLQQ7): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196352307 (302h56m47.627432428s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122EX4PNuiRTCG2gbgbaL5dAtD8s5SN7ZesShk7NqUTGCZ3gA2a): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196429455 (302h56m47.627509586s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S9DQZhV6SDULbA9WKndh12CpFih6xtNcpdwUApD9d2XThFdFk): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196508005 (302h56m47.627588136s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196544295 (302h56m47.627624416s) [seg_pos={0 0}, upload=315124]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:22:53.196625680 (302h56m47.627705812s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:22:53.196630980 (302h56m47.627711111s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:22:53.523344192 (302h56m47.954424313s) [upload=315124]: Done uploading segments...
Aug 21 08:22:53.523364170 (302h56m47.954444301s) [upload=315124]: Upload finished. err: <nil>
Duration: 5.592790624s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [................X..................X.....X..X.....X.........] duration:
5.901932762s
FAIL (2025-08-21 08:29:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 08:22:50.617857206 (302h56m45.048937337s) [upload=315124]: Starting upload
Aug 21 08:22:50.617937189 (302h56m45.04901732s) [upload=315124]: Done starting upload
Aug 21 08:22:50.618097486 (302h56m45.049177667s) [upload=315124]: Uploading segments...
Aug 21 08:22:50.618363846 (302h56m45.049443977s) [upload=315124]: Got next segment. Inline: false
Aug 21 08:22:50.618457594 (302h56m45.049537756s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:22:50.618465591 (302h56m45.049545752s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:22:51.102693840 (302h56m45.533773971s) [seg_pos={0 0}, upload=315124]: Begin upload segment...
Aug 21 08:22:51.102743835 (302h56m45.533823956s) [seg_pos={0 0}, upload=315124]: Done begin upload segment.
Aug 21 08:22:51.102772089 (302h56m45.533852221s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.102816886 (302h56m45.533897057s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103154631 (302h56m45.534234763s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103325929 (302h56m45.53440606s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103432112 (302h56m45.534512233s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.104580289 (302h56m45.53566042s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105002427 (302h56m45.536082558s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105257976 (302h56m45.536338107s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105840851 (302h56m45.536920982s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106639810 (302h56m45.537719941s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106893956 (302h56m45.537974077s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107321134 (302h56m45.538401265s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107989602 (302h56m45.539069723s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108252655 (302h56m45.539332776s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108500671 (302h56m45.539580792s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108788000 (302h56m45.539868131s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109590405 (302h56m45.540670536s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109879138 (302h56m45.540959269s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:52.607264993 (302h56m47.038345124s) [upload=315124]: Next returned nil segment
Aug 21 08:22:52.607281043 (302h56m47.038361164s) [upload=315124]: Waiting for error group managing segments...
Aug 21 08:22:52.993440879 (302h56m47.42452101s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:52.994339859 (302h56m47.42541998s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.030923166 (302h56m47.462003287s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.045072480 (302h56m47.476152611s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.048431668 (302h56m47.479511799s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.058354743 (302h56m47.489434875s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.067002511 (302h56m47.498082642s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.069177272 (302h56m47.500257403s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.075997161 (302h56m47.507077292s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.076289810 (302h56m47.507369931s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.086108557 (302h56m47.517188689s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.117753797 (302h56m47.548833928s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.139783219 (302h56m47.57086334s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196138137 (302h56m47.627218268s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196161893 (302h56m47.627242024s) [seg_pos={0 0}, upload=315124]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:22:53.196294868 (302h56m47.627374989s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZAfYZ4wgpZVvatj6wtHona3hTaPcLxAmXC1DT2uKQyo8nLQQ7): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196352307 (302h56m47.627432428s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122EX4PNuiRTCG2gbgbaL5dAtD8s5SN7ZesShk7NqUTGCZ3gA2a): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196429455 (302h56m47.627509586s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S9DQZhV6SDULbA9WKndh12CpFih6xtNcpdwUApD9d2XThFdFk): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196508005 (302h56m47.627588136s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196544295 (302h56m47.627624416s) [seg_pos={0 0}, upload=315124]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:22:53.196625680 (302h56m47.627705812s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:22:53.196630980 (302h56m47.627711111s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:22:53.523344192 (302h56m47.954424313s) [upload=315124]: Done uploading segments...
Aug 21 08:22:53.523364170 (302h56m47.954444301s) [upload=315124]: Upload finished. err: <nil>
Duration: 5.901962328s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [................X.X....X......X...X..X......................] duration:
1.829826885s
FAIL (2025-08-21 08:29:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.829852776s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.................X..................X.....X..X.....X........] duration:
5.748970267s
FAIL (2025-08-21 08:28:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 08:22:50.617857206 (302h56m45.048937337s) [upload=315124]: Starting upload
Aug 21 08:22:50.617937189 (302h56m45.04901732s) [upload=315124]: Done starting upload
Aug 21 08:22:50.618097486 (302h56m45.049177667s) [upload=315124]: Uploading segments...
Aug 21 08:22:50.618363846 (302h56m45.049443977s) [upload=315124]: Got next segment. Inline: false
Aug 21 08:22:50.618457594 (302h56m45.049537756s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:22:50.618465591 (302h56m45.049545752s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:22:51.102693840 (302h56m45.533773971s) [seg_pos={0 0}, upload=315124]: Begin upload segment...
Aug 21 08:22:51.102743835 (302h56m45.533823956s) [seg_pos={0 0}, upload=315124]: Done begin upload segment.
Aug 21 08:22:51.102772089 (302h56m45.533852221s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.102816886 (302h56m45.533897057s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103154631 (302h56m45.534234763s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103325929 (302h56m45.53440606s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103432112 (302h56m45.534512233s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.104580289 (302h56m45.53566042s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105002427 (302h56m45.536082558s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105257976 (302h56m45.536338107s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105840851 (302h56m45.536920982s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106639810 (302h56m45.537719941s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106893956 (302h56m45.537974077s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107321134 (302h56m45.538401265s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107989602 (302h56m45.539069723s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108252655 (302h56m45.539332776s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108500671 (302h56m45.539580792s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108788000 (302h56m45.539868131s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109590405 (302h56m45.540670536s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109879138 (302h56m45.540959269s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:52.607264993 (302h56m47.038345124s) [upload=315124]: Next returned nil segment
Aug 21 08:22:52.607281043 (302h56m47.038361164s) [upload=315124]: Waiting for error group managing segments...
Aug 21 08:22:52.993440879 (302h56m47.42452101s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:52.994339859 (302h56m47.42541998s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.030923166 (302h56m47.462003287s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.045072480 (302h56m47.476152611s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.048431668 (302h56m47.479511799s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.058354743 (302h56m47.489434875s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.067002511 (302h56m47.498082642s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.069177272 (302h56m47.500257403s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.075997161 (302h56m47.507077292s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.076289810 (302h56m47.507369931s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.086108557 (302h56m47.517188689s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.117753797 (302h56m47.548833928s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.139783219 (302h56m47.57086334s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196138137 (302h56m47.627218268s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196161893 (302h56m47.627242024s) [seg_pos={0 0}, upload=315124]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:22:53.196294868 (302h56m47.627374989s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZAfYZ4wgpZVvatj6wtHona3hTaPcLxAmXC1DT2uKQyo8nLQQ7): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196352307 (302h56m47.627432428s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122EX4PNuiRTCG2gbgbaL5dAtD8s5SN7ZesShk7NqUTGCZ3gA2a): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196429455 (302h56m47.627509586s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S9DQZhV6SDULbA9WKndh12CpFih6xtNcpdwUApD9d2XThFdFk): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196508005 (302h56m47.627588136s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196544295 (302h56m47.627624416s) [seg_pos={0 0}, upload=315124]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:22:53.196625680 (302h56m47.627705812s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:22:53.196630980 (302h56m47.627711111s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:22:53.523344192 (302h56m47.954424313s) [upload=315124]: Done uploading segments...
Aug 21 08:22:53.523364170 (302h56m47.954444301s) [upload=315124]: Upload finished. err: <nil>
Duration: 5.749004172s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.................X.X....X......X...X..X.....................] duration:
1.82300253s
FAIL (2025-08-21 08:28:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.823026645s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..................X.X....X......X...X..X....................] duration:
1.898855195s
FAIL (2025-08-21 08:28:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.898880665s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...................X.X....X......X...X..X...................] duration:
1.969735195s
FAIL (2025-08-21 08:28:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.969763279s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..................X..................X.....X..X.....X.......] duration:
5.684872579s
FAIL (2025-08-21 08:27:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 08:22:50.617857206 (302h56m45.048937337s) [upload=315124]: Starting upload
Aug 21 08:22:50.617937189 (302h56m45.04901732s) [upload=315124]: Done starting upload
Aug 21 08:22:50.618097486 (302h56m45.049177667s) [upload=315124]: Uploading segments...
Aug 21 08:22:50.618363846 (302h56m45.049443977s) [upload=315124]: Got next segment. Inline: false
Aug 21 08:22:50.618457594 (302h56m45.049537756s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:22:50.618465591 (302h56m45.049545752s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:22:51.102693840 (302h56m45.533773971s) [seg_pos={0 0}, upload=315124]: Begin upload segment...
Aug 21 08:22:51.102743835 (302h56m45.533823956s) [seg_pos={0 0}, upload=315124]: Done begin upload segment.
Aug 21 08:22:51.102772089 (302h56m45.533852221s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.102816886 (302h56m45.533897057s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103154631 (302h56m45.534234763s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103325929 (302h56m45.53440606s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103432112 (302h56m45.534512233s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.104580289 (302h56m45.53566042s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105002427 (302h56m45.536082558s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105257976 (302h56m45.536338107s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105840851 (302h56m45.536920982s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106639810 (302h56m45.537719941s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106893956 (302h56m45.537974077s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107321134 (302h56m45.538401265s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107989602 (302h56m45.539069723s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108252655 (302h56m45.539332776s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108500671 (302h56m45.539580792s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108788000 (302h56m45.539868131s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109590405 (302h56m45.540670536s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109879138 (302h56m45.540959269s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:52.607264993 (302h56m47.038345124s) [upload=315124]: Next returned nil segment
Aug 21 08:22:52.607281043 (302h56m47.038361164s) [upload=315124]: Waiting for error group managing segments...
Aug 21 08:22:52.993440879 (302h56m47.42452101s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:52.994339859 (302h56m47.42541998s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.030923166 (302h56m47.462003287s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.045072480 (302h56m47.476152611s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.048431668 (302h56m47.479511799s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.058354743 (302h56m47.489434875s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.067002511 (302h56m47.498082642s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.069177272 (302h56m47.500257403s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.075997161 (302h56m47.507077292s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.076289810 (302h56m47.507369931s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.086108557 (302h56m47.517188689s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.117753797 (302h56m47.548833928s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.139783219 (302h56m47.57086334s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196138137 (302h56m47.627218268s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196161893 (302h56m47.627242024s) [seg_pos={0 0}, upload=315124]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:22:53.196294868 (302h56m47.627374989s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZAfYZ4wgpZVvatj6wtHona3hTaPcLxAmXC1DT2uKQyo8nLQQ7): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196352307 (302h56m47.627432428s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122EX4PNuiRTCG2gbgbaL5dAtD8s5SN7ZesShk7NqUTGCZ3gA2a): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196429455 (302h56m47.627509586s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S9DQZhV6SDULbA9WKndh12CpFih6xtNcpdwUApD9d2XThFdFk): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196508005 (302h56m47.627588136s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196544295 (302h56m47.627624416s) [seg_pos={0 0}, upload=315124]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:22:53.196625680 (302h56m47.627705812s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:22:53.196630980 (302h56m47.627711111s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:22:53.523344192 (302h56m47.954424313s) [upload=315124]: Done uploading segments...
Aug 21 08:22:53.523364170 (302h56m47.954444301s) [upload=315124]: Upload finished. err: <nil>
Duration: 5.684897046s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...................X..................X.....X..X.....X......] duration:
5.663178241s
FAIL (2025-08-21 08:27:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 08:22:50.617857206 (302h56m45.048937337s) [upload=315124]: Starting upload
Aug 21 08:22:50.617937189 (302h56m45.04901732s) [upload=315124]: Done starting upload
Aug 21 08:22:50.618097486 (302h56m45.049177667s) [upload=315124]: Uploading segments...
Aug 21 08:22:50.618363846 (302h56m45.049443977s) [upload=315124]: Got next segment. Inline: false
Aug 21 08:22:50.618457594 (302h56m45.049537756s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:22:50.618465591 (302h56m45.049545752s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:22:51.102693840 (302h56m45.533773971s) [seg_pos={0 0}, upload=315124]: Begin upload segment...
Aug 21 08:22:51.102743835 (302h56m45.533823956s) [seg_pos={0 0}, upload=315124]: Done begin upload segment.
Aug 21 08:22:51.102772089 (302h56m45.533852221s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.102816886 (302h56m45.533897057s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103154631 (302h56m45.534234763s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103325929 (302h56m45.53440606s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103432112 (302h56m45.534512233s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.104580289 (302h56m45.53566042s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105002427 (302h56m45.536082558s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105257976 (302h56m45.536338107s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105840851 (302h56m45.536920982s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106639810 (302h56m45.537719941s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106893956 (302h56m45.537974077s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107321134 (302h56m45.538401265s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107989602 (302h56m45.539069723s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108252655 (302h56m45.539332776s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108500671 (302h56m45.539580792s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108788000 (302h56m45.539868131s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109590405 (302h56m45.540670536s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109879138 (302h56m45.540959269s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:52.607264993 (302h56m47.038345124s) [upload=315124]: Next returned nil segment
Aug 21 08:22:52.607281043 (302h56m47.038361164s) [upload=315124]: Waiting for error group managing segments...
Aug 21 08:22:52.993440879 (302h56m47.42452101s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:52.994339859 (302h56m47.42541998s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.030923166 (302h56m47.462003287s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.045072480 (302h56m47.476152611s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.048431668 (302h56m47.479511799s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.058354743 (302h56m47.489434875s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.067002511 (302h56m47.498082642s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.069177272 (302h56m47.500257403s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.075997161 (302h56m47.507077292s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.076289810 (302h56m47.507369931s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.086108557 (302h56m47.517188689s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.117753797 (302h56m47.548833928s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.139783219 (302h56m47.57086334s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196138137 (302h56m47.627218268s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196161893 (302h56m47.627242024s) [seg_pos={0 0}, upload=315124]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:22:53.196294868 (302h56m47.627374989s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZAfYZ4wgpZVvatj6wtHona3hTaPcLxAmXC1DT2uKQyo8nLQQ7): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196352307 (302h56m47.627432428s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122EX4PNuiRTCG2gbgbaL5dAtD8s5SN7ZesShk7NqUTGCZ3gA2a): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196429455 (302h56m47.627509586s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S9DQZhV6SDULbA9WKndh12CpFih6xtNcpdwUApD9d2XThFdFk): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196508005 (302h56m47.627588136s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196544295 (302h56m47.627624416s) [seg_pos={0 0}, upload=315124]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:22:53.196625680 (302h56m47.627705812s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:22:53.196630980 (302h56m47.627711111s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:22:53.523344192 (302h56m47.954424313s) [upload=315124]: Done uploading segments...
Aug 21 08:22:53.523364170 (302h56m47.954444301s) [upload=315124]: Upload finished. err: <nil>
Duration: 5.663210012s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [X...................X.X....X......X...X..X..................] duration:
1.829133742s
FAIL (2025-08-21 08:26:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.829158108s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [....................X..................X.....X..X.....X.....] duration:
5.76438511s
FAIL (2025-08-21 08:26:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 08:22:50.617857206 (302h56m45.048937337s) [upload=315124]: Starting upload
Aug 21 08:22:50.617937189 (302h56m45.04901732s) [upload=315124]: Done starting upload
Aug 21 08:22:50.618097486 (302h56m45.049177667s) [upload=315124]: Uploading segments...
Aug 21 08:22:50.618363846 (302h56m45.049443977s) [upload=315124]: Got next segment. Inline: false
Aug 21 08:22:50.618457594 (302h56m45.049537756s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:22:50.618465591 (302h56m45.049545752s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:22:51.102693840 (302h56m45.533773971s) [seg_pos={0 0}, upload=315124]: Begin upload segment...
Aug 21 08:22:51.102743835 (302h56m45.533823956s) [seg_pos={0 0}, upload=315124]: Done begin upload segment.
Aug 21 08:22:51.102772089 (302h56m45.533852221s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.102816886 (302h56m45.533897057s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103154631 (302h56m45.534234763s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103325929 (302h56m45.53440606s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103432112 (302h56m45.534512233s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.104580289 (302h56m45.53566042s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105002427 (302h56m45.536082558s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105257976 (302h56m45.536338107s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105840851 (302h56m45.536920982s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106639810 (302h56m45.537719941s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106893956 (302h56m45.537974077s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107321134 (302h56m45.538401265s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107989602 (302h56m45.539069723s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108252655 (302h56m45.539332776s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108500671 (302h56m45.539580792s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108788000 (302h56m45.539868131s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109590405 (302h56m45.540670536s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109879138 (302h56m45.540959269s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:52.607264993 (302h56m47.038345124s) [upload=315124]: Next returned nil segment
Aug 21 08:22:52.607281043 (302h56m47.038361164s) [upload=315124]: Waiting for error group managing segments...
Aug 21 08:22:52.993440879 (302h56m47.42452101s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:52.994339859 (302h56m47.42541998s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.030923166 (302h56m47.462003287s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.045072480 (302h56m47.476152611s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.048431668 (302h56m47.479511799s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.058354743 (302h56m47.489434875s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.067002511 (302h56m47.498082642s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.069177272 (302h56m47.500257403s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.075997161 (302h56m47.507077292s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.076289810 (302h56m47.507369931s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.086108557 (302h56m47.517188689s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.117753797 (302h56m47.548833928s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.139783219 (302h56m47.57086334s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196138137 (302h56m47.627218268s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196161893 (302h56m47.627242024s) [seg_pos={0 0}, upload=315124]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:22:53.196294868 (302h56m47.627374989s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZAfYZ4wgpZVvatj6wtHona3hTaPcLxAmXC1DT2uKQyo8nLQQ7): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196352307 (302h56m47.627432428s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122EX4PNuiRTCG2gbgbaL5dAtD8s5SN7ZesShk7NqUTGCZ3gA2a): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196429455 (302h56m47.627509586s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S9DQZhV6SDULbA9WKndh12CpFih6xtNcpdwUApD9d2XThFdFk): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196508005 (302h56m47.627588136s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196544295 (302h56m47.627624416s) [seg_pos={0 0}, upload=315124]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:22:53.196625680 (302h56m47.627705812s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:22:53.196630980 (302h56m47.627711111s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:22:53.523344192 (302h56m47.954424313s) [upload=315124]: Done uploading segments...
Aug 21 08:22:53.523364170 (302h56m47.954444301s) [upload=315124]: Upload finished. err: <nil>
Duration: 5.764410859s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.X...................X.X....X......X...X..X.................] duration:
1.814352038s
FAIL (2025-08-21 08:25:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.814378557s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.....................X..................X.....X..X.....X....] duration:
5.540585725s
FAIL (2025-08-21 08:25:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 08:22:50.617857206 (302h56m45.048937337s) [upload=315124]: Starting upload
Aug 21 08:22:50.617937189 (302h56m45.04901732s) [upload=315124]: Done starting upload
Aug 21 08:22:50.618097486 (302h56m45.049177667s) [upload=315124]: Uploading segments...
Aug 21 08:22:50.618363846 (302h56m45.049443977s) [upload=315124]: Got next segment. Inline: false
Aug 21 08:22:50.618457594 (302h56m45.049537756s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:22:50.618465591 (302h56m45.049545752s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:22:51.102693840 (302h56m45.533773971s) [seg_pos={0 0}, upload=315124]: Begin upload segment...
Aug 21 08:22:51.102743835 (302h56m45.533823956s) [seg_pos={0 0}, upload=315124]: Done begin upload segment.
Aug 21 08:22:51.102772089 (302h56m45.533852221s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.102816886 (302h56m45.533897057s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103154631 (302h56m45.534234763s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103325929 (302h56m45.53440606s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103432112 (302h56m45.534512233s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.104580289 (302h56m45.53566042s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105002427 (302h56m45.536082558s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105257976 (302h56m45.536338107s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105840851 (302h56m45.536920982s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106639810 (302h56m45.537719941s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106893956 (302h56m45.537974077s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107321134 (302h56m45.538401265s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107989602 (302h56m45.539069723s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108252655 (302h56m45.539332776s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108500671 (302h56m45.539580792s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108788000 (302h56m45.539868131s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109590405 (302h56m45.540670536s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109879138 (302h56m45.540959269s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:52.607264993 (302h56m47.038345124s) [upload=315124]: Next returned nil segment
Aug 21 08:22:52.607281043 (302h56m47.038361164s) [upload=315124]: Waiting for error group managing segments...
Aug 21 08:22:52.993440879 (302h56m47.42452101s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:52.994339859 (302h56m47.42541998s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.030923166 (302h56m47.462003287s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.045072480 (302h56m47.476152611s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.048431668 (302h56m47.479511799s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.058354743 (302h56m47.489434875s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.067002511 (302h56m47.498082642s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.069177272 (302h56m47.500257403s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.075997161 (302h56m47.507077292s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.076289810 (302h56m47.507369931s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.086108557 (302h56m47.517188689s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.117753797 (302h56m47.548833928s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.139783219 (302h56m47.57086334s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196138137 (302h56m47.627218268s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196161893 (302h56m47.627242024s) [seg_pos={0 0}, upload=315124]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:22:53.196294868 (302h56m47.627374989s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZAfYZ4wgpZVvatj6wtHona3hTaPcLxAmXC1DT2uKQyo8nLQQ7): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196352307 (302h56m47.627432428s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122EX4PNuiRTCG2gbgbaL5dAtD8s5SN7ZesShk7NqUTGCZ3gA2a): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196429455 (302h56m47.627509586s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S9DQZhV6SDULbA9WKndh12CpFih6xtNcpdwUApD9d2XThFdFk): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196508005 (302h56m47.627588136s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196544295 (302h56m47.627624416s) [seg_pos={0 0}, upload=315124]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:22:53.196625680 (302h56m47.627705812s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:22:53.196630980 (302h56m47.627711111s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:22:53.523344192 (302h56m47.954424313s) [upload=315124]: Done uploading segments...
Aug 21 08:22:53.523364170 (302h56m47.954444301s) [upload=315124]: Upload finished. err: <nil>
Duration: 5.540603699s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [......................X..................X.....X..X.....X...] duration:
5.514860899s
FAIL (2025-08-21 08:24:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 08:22:50.617857206 (302h56m45.048937337s) [upload=315124]: Starting upload
Aug 21 08:22:50.617937189 (302h56m45.04901732s) [upload=315124]: Done starting upload
Aug 21 08:22:50.618097486 (302h56m45.049177667s) [upload=315124]: Uploading segments...
Aug 21 08:22:50.618363846 (302h56m45.049443977s) [upload=315124]: Got next segment. Inline: false
Aug 21 08:22:50.618457594 (302h56m45.049537756s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:22:50.618465591 (302h56m45.049545752s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:22:51.102693840 (302h56m45.533773971s) [seg_pos={0 0}, upload=315124]: Begin upload segment...
Aug 21 08:22:51.102743835 (302h56m45.533823956s) [seg_pos={0 0}, upload=315124]: Done begin upload segment.
Aug 21 08:22:51.102772089 (302h56m45.533852221s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.102816886 (302h56m45.533897057s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103154631 (302h56m45.534234763s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103325929 (302h56m45.53440606s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103432112 (302h56m45.534512233s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.104580289 (302h56m45.53566042s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105002427 (302h56m45.536082558s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105257976 (302h56m45.536338107s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105840851 (302h56m45.536920982s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106639810 (302h56m45.537719941s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106893956 (302h56m45.537974077s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107321134 (302h56m45.538401265s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107989602 (302h56m45.539069723s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108252655 (302h56m45.539332776s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108500671 (302h56m45.539580792s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108788000 (302h56m45.539868131s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109590405 (302h56m45.540670536s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109879138 (302h56m45.540959269s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:52.607264993 (302h56m47.038345124s) [upload=315124]: Next returned nil segment
Aug 21 08:22:52.607281043 (302h56m47.038361164s) [upload=315124]: Waiting for error group managing segments...
Aug 21 08:22:52.993440879 (302h56m47.42452101s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:52.994339859 (302h56m47.42541998s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.030923166 (302h56m47.462003287s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.045072480 (302h56m47.476152611s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.048431668 (302h56m47.479511799s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.058354743 (302h56m47.489434875s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.067002511 (302h56m47.498082642s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.069177272 (302h56m47.500257403s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.075997161 (302h56m47.507077292s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.076289810 (302h56m47.507369931s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.086108557 (302h56m47.517188689s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.117753797 (302h56m47.548833928s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.139783219 (302h56m47.57086334s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196138137 (302h56m47.627218268s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196161893 (302h56m47.627242024s) [seg_pos={0 0}, upload=315124]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:22:53.196294868 (302h56m47.627374989s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZAfYZ4wgpZVvatj6wtHona3hTaPcLxAmXC1DT2uKQyo8nLQQ7): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196352307 (302h56m47.627432428s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122EX4PNuiRTCG2gbgbaL5dAtD8s5SN7ZesShk7NqUTGCZ3gA2a): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196429455 (302h56m47.627509586s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S9DQZhV6SDULbA9WKndh12CpFih6xtNcpdwUApD9d2XThFdFk): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196508005 (302h56m47.627588136s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196544295 (302h56m47.627624416s) [seg_pos={0 0}, upload=315124]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:22:53.196625680 (302h56m47.627705812s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:22:53.196630980 (302h56m47.627711111s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:22:53.523344192 (302h56m47.954424313s) [upload=315124]: Done uploading segments...
Aug 21 08:22:53.523364170 (302h56m47.954444301s) [upload=315124]: Upload finished. err: <nil>
Duration: 5.514885346s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [..X...................X.X....X......X...X..X................] duration:
1.897385993s
FAIL (2025-08-21 08:24:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.89741147s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.......................X..................X.....X..X.....X..] duration:
5.486597726s
FAIL (2025-08-21 08:24:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 08:22:50.617857206 (302h56m45.048937337s) [upload=315124]: Starting upload
Aug 21 08:22:50.617937189 (302h56m45.04901732s) [upload=315124]: Done starting upload
Aug 21 08:22:50.618097486 (302h56m45.049177667s) [upload=315124]: Uploading segments...
Aug 21 08:22:50.618363846 (302h56m45.049443977s) [upload=315124]: Got next segment. Inline: false
Aug 21 08:22:50.618457594 (302h56m45.049537756s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:22:50.618465591 (302h56m45.049545752s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:22:51.102693840 (302h56m45.533773971s) [seg_pos={0 0}, upload=315124]: Begin upload segment...
Aug 21 08:22:51.102743835 (302h56m45.533823956s) [seg_pos={0 0}, upload=315124]: Done begin upload segment.
Aug 21 08:22:51.102772089 (302h56m45.533852221s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.102816886 (302h56m45.533897057s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103154631 (302h56m45.534234763s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103325929 (302h56m45.53440606s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103432112 (302h56m45.534512233s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.104580289 (302h56m45.53566042s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105002427 (302h56m45.536082558s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105257976 (302h56m45.536338107s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105840851 (302h56m45.536920982s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106639810 (302h56m45.537719941s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106893956 (302h56m45.537974077s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107321134 (302h56m45.538401265s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107989602 (302h56m45.539069723s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108252655 (302h56m45.539332776s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108500671 (302h56m45.539580792s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108788000 (302h56m45.539868131s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109590405 (302h56m45.540670536s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109879138 (302h56m45.540959269s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:52.607264993 (302h56m47.038345124s) [upload=315124]: Next returned nil segment
Aug 21 08:22:52.607281043 (302h56m47.038361164s) [upload=315124]: Waiting for error group managing segments...
Aug 21 08:22:52.993440879 (302h56m47.42452101s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:52.994339859 (302h56m47.42541998s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.030923166 (302h56m47.462003287s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.045072480 (302h56m47.476152611s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.048431668 (302h56m47.479511799s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.058354743 (302h56m47.489434875s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.067002511 (302h56m47.498082642s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.069177272 (302h56m47.500257403s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.075997161 (302h56m47.507077292s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.076289810 (302h56m47.507369931s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.086108557 (302h56m47.517188689s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.117753797 (302h56m47.548833928s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.139783219 (302h56m47.57086334s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196138137 (302h56m47.627218268s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196161893 (302h56m47.627242024s) [seg_pos={0 0}, upload=315124]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:22:53.196294868 (302h56m47.627374989s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZAfYZ4wgpZVvatj6wtHona3hTaPcLxAmXC1DT2uKQyo8nLQQ7): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196352307 (302h56m47.627432428s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122EX4PNuiRTCG2gbgbaL5dAtD8s5SN7ZesShk7NqUTGCZ3gA2a): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196429455 (302h56m47.627509586s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S9DQZhV6SDULbA9WKndh12CpFih6xtNcpdwUApD9d2XThFdFk): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196508005 (302h56m47.627588136s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196544295 (302h56m47.627624416s) [seg_pos={0 0}, upload=315124]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:22:53.196625680 (302h56m47.627705812s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:22:53.196630980 (302h56m47.627711111s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:22:53.523344192 (302h56m47.954424313s) [upload=315124]: Done uploading segments...
Aug 21 08:22:53.523364170 (302h56m47.954444301s) [upload=315124]: Upload finished. err: <nil>
Duration: 5.486632802s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [........................X..................X.....X..X.....X.] duration:
5.612288179s
FAIL (2025-08-21 08:23:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 08:22:50.617857206 (302h56m45.048937337s) [upload=315124]: Starting upload
Aug 21 08:22:50.617937189 (302h56m45.04901732s) [upload=315124]: Done starting upload
Aug 21 08:22:50.618097486 (302h56m45.049177667s) [upload=315124]: Uploading segments...
Aug 21 08:22:50.618363846 (302h56m45.049443977s) [upload=315124]: Got next segment. Inline: false
Aug 21 08:22:50.618457594 (302h56m45.049537756s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:22:50.618465591 (302h56m45.049545752s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:22:51.102693840 (302h56m45.533773971s) [seg_pos={0 0}, upload=315124]: Begin upload segment...
Aug 21 08:22:51.102743835 (302h56m45.533823956s) [seg_pos={0 0}, upload=315124]: Done begin upload segment.
Aug 21 08:22:51.102772089 (302h56m45.533852221s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.102816886 (302h56m45.533897057s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103154631 (302h56m45.534234763s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103325929 (302h56m45.53440606s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.103432112 (302h56m45.534512233s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.104580289 (302h56m45.53566042s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105002427 (302h56m45.536082558s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105257976 (302h56m45.536338107s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.105840851 (302h56m45.536920982s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106639810 (302h56m45.537719941s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.106893956 (302h56m45.537974077s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107321134 (302h56m45.538401265s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.107989602 (302h56m45.539069723s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108252655 (302h56m45.539332776s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108500671 (302h56m45.539580792s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.108788000 (302h56m45.539868131s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109590405 (302h56m45.540670536s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:51.109879138 (302h56m45.540959269s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Uploading piece...
Aug 21 08:22:52.607264993 (302h56m47.038345124s) [upload=315124]: Next returned nil segment
Aug 21 08:22:52.607281043 (302h56m47.038361164s) [upload=315124]: Waiting for error group managing segments...
Aug 21 08:22:52.993440879 (302h56m47.42452101s) [noise=true , address=77.90.31.13:4658 , piece_id=KQWYLUS5LN66ZPFCEXKVX5WF2LGNSD4P77UAPQPXOWGGJ4EJCGMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:52.994339859 (302h56m47.42541998s) [noise=true , address=45.91.116.10:4107 , piece_id=OOOPHYUXVN7JMCNG3225R3E6NP3AKDB7AXCD4ZAESHIIUJ7KOTSA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.030923166 (302h56m47.462003287s) [noise=true , address=79.127.219.51:4205 , piece_id=JWYV55VTNFSJACTZI3H2ZQL6JJOJN3TBUG2RL2KEDIDXMXFYXLYA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.045072480 (302h56m47.476152611s) [noise=true , address=104.36.82.44:4884 , piece_id=ZOUIGGAJJCESNXVZNUP2GNP4WJMSDUZNPZHAN6GBJOQXTKIQKMBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.048431668 (302h56m47.479511799s) [noise=true , address=77.90.31.18:4831 , piece_id=72MW7W6WROTJT67MH5EPYOBXT3HDWBP2DCBEPREBHXOT7Q3BBJ7Q, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.058354743 (302h56m47.489434875s) [noise=true , address=77.90.31.10:4539 , piece_id=MLT5B4T2LZGTXWUJEZV3RFKTV7G5DYMRXYSH7OZ3HFSX5RGZPZHQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.067002511 (302h56m47.498082642s) [noise=true , address=45.91.116.9:4285 , piece_id=6GFODJUAS6TKML3VRGGJZ2DTFLVNAJ2RVWJKEF2Y7BGPB4YW3WVA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.069177272 (302h56m47.500257403s) [noise=true , address=45.91.116.14:4222 , piece_id=Y75AX4KSRH6V3EEO33MZON7BEO22T75LQN2PZTVSSYPDAVUB4P6A, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.075997161 (302h56m47.507077292s) [noise=true , address=77.90.31.17:4778 , piece_id=O7ABLFZVNQK6R2U6I3G5AXDTE3BSH76OUVV74ZLKWS6O5G6HWKIQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.076289810 (302h56m47.507369931s) [noise=true , address=104.36.82.10:4083 , piece_id=5Z2FRC6XAU6CU36RT6CCHCVQXAGZLWYVN6K2BPGAHQAC2J5XFHTA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.086108557 (302h56m47.517188689s) [noise=true , address=79.127.219.47:4068 , piece_id=EPIHSIZHK4GNMX2IRNPZAHQGLFGEGZ74PAZCXKIID7HN475CMBJA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.117753797 (302h56m47.548833928s) [noise=true , address=104.36.82.49:4003 , piece_id=4YZJL6CGQZXU3J2OV5P5MVMSOYFEXBLZUESNCF4BLKSWFYWTEGBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.139783219 (302h56m47.57086334s) [noise=true , address=77.90.31.21:4898 , piece_id=ZARPPTJLAZ4SSTP5EVR6YZIX7ZJN2J2KRML2OCUP66VPAT2S2DMA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196138137 (302h56m47.627218268s) [noise=true , address=79.127.201.214:4302 , piece_id=A7RVRX5CMEBACZNFRFGTCYE62BGRFSXO4EDLINF6OXWPD3TBLYBA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: <nil>
Aug 21 08:22:53.196161893 (302h56m47.627242024s) [seg_pos={0 0}, upload=315124]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:22:53.196294868 (302h56m47.627374989s) [noise=true , address=77.90.31.11:4572 , piece_id=RR7HEMDHJYS7FQVTAPENVBINZ6GFJ6PHCCOB7NKCY63EPUU236IQ, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZAfYZ4wgpZVvatj6wtHona3hTaPcLxAmXC1DT2uKQyo8nLQQ7): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196352307 (302h56m47.627432428s) [noise=true , address=104.36.82.60:4365 , piece_id=RUKISSMHDHNQ2FJLSHBOFN46BDMGPKC2QOBWZL2UMWKWKQON6ZWA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122EX4PNuiRTCG2gbgbaL5dAtD8s5SN7ZesShk7NqUTGCZ3gA2a): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196429455 (302h56m47.627509586s) [noise=true , address=104.36.82.60:4364 , piece_id=SM7TA3NIXWS74H6S5YELHJFJNRDLK6Y6DB6O4OQVOBZTVH4N6IEA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S9DQZhV6SDULbA9WKndh12CpFih6xtNcpdwUApD9d2XThFdFk): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196508005 (302h56m47.627588136s) [noise=true , address=79.127.201.215:4356 , piece_id=GA3AATXUV7DXACEHA2UENBEWTX5TW723RRVFUHC6WS52B52J2CIA, seg_pos={0 0}, upload=315124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 21 08:22:53.196544295 (302h56m47.627624416s) [seg_pos={0 0}, upload=315124]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:22:53.196625680 (302h56m47.627705812s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:22:53.196630980 (302h56m47.627711111s) [upload=315124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:22:53.523344192 (302h56m47.954424313s) [upload=315124]: Done uploading segments...
Aug 21 08:22:53.523364170 (302h56m47.954444301s) [upload=315124]: Upload finished. err: <nil>
Duration: 5.612314489s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [...X...................X.X....X......X...X..X...............] duration:
1.827749051s
FAIL (2025-08-21 08:23:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.827822853s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|