Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.943265592s
FAIL (2025-08-22 10:13:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 10:07:40.474452249 (328h41m34.90553237s) [upload=341968]: Starting upload Aug 22 10:07:40.474498527 (328h41m34.905578648s) [upload=341968]: Done starting upload Aug 22 10:07:40.474599440 (328h41m34.905679571s) [upload=341968]: Uploading segments... Aug 22 10:07:40.474634637 (328h41m34.905714768s) [upload=341968]: Got next segment. Inline: true Aug 22 10:07:40.474639096 (328h41m34.905719227s) [upload=341968]: Waiting for error group managing segments... Aug 22 10:07:40.474670787 (328h41m34.905750908s) [upload=341968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 10:07:40.474674604 (328h41m34.905754725s) [upload=341968]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 10:07:40.474677069 (328h41m34.9057572s) [upload=341968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 10:07:40.692455428 (328h41m35.123535559s) [upload=341968]: Done uploading segments... Aug 22 10:07:40.692473723 (328h41m35.123553854s) [upload=341968]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.943293575s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [.XX....XX....................X......X........X..........X...] duration:
5.765955791s
FAIL (2025-08-22 10:13:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after de9e4cb96f38d938b94ef8ddb31ff41ea52c6aa2280f68ef3674453d70c75e9a != before d97b902db9a3dd61d52f1d46e5ffe2f0eb42497dd753e577d88a03a16767778c
======LOGS======
Aug 22 10:11:47.859166359 (328h45m42.29024648s) [upload=342045]: Starting upload
Aug 22 10:11:47.859209371 (328h45m42.290289502s) [upload=342045]: Done starting upload
Aug 22 10:11:47.859374176 (328h45m42.290454297s) [upload=342045]: Uploading segments...
Aug 22 10:11:47.859398483 (328h45m42.290478604s) [upload=342045]: Got next segment. Inline: false
Aug 22 10:11:47.859442487 (328h45m42.290522619s) [upload=342045]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 10:11:47.859446946 (328h45m42.290527077s) [upload=342045]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 10:11:48.728225244 (328h45m43.159305375s) [seg_pos={0 0}, upload=342045]: Begin upload segment...
Aug 22 10:11:48.728270882 (328h45m43.159351013s) [seg_pos={0 0}, upload=342045]: Done begin upload segment.
Aug 22 10:11:48.728293475 (328h45m43.159373606s) [noise=true , address=79.127.219.51:4216 , piece_id=26I63ABHGGV2ZLN4YRFRTBJNEUA6SSV52JCTT7WREM7D6TXM5MRQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.728320517 (328h45m43.159400648s) [noise=true , address=77.90.31.15:4717 , piece_id=V5CF7G7LDPSSAAOFVKKAO57X5JUYVEUXB45OEJRP4XA2AHQVQCYA, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.728650799 (328h45m43.15973093s) [noise=true , address=77.90.31.12:4621 , piece_id=HKLI7SZVSNIH7PKW7ZVDTENVGMLVAWYT2MOKG7BBJUXE376WJQNQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.729366768 (328h45m43.1604469s) [noise=true , address=104.36.82.60:4370 , piece_id=6KADSWY7F5BNZZ3YQEBRBQFHOS3KOCLG4YYBH32RDCVLAYH2LBLQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.729676561 (328h45m43.160756692s) [noise=true , address=79.127.205.235:4669 , piece_id=KFHKTBAVBKBBK3VXPCCEA2BTGPUGQKGBKMIEDVL2VXLWALRTFLFQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.729984310 (328h45m43.161064441s) [noise=true , address=77.90.31.21:4897 , piece_id=MWUNEFJMU6UNN6Q63ZVYUDC7J4PV7ARHT556LCBTKPJYSGGFEBXA, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.730237874 (328h45m43.161317996s) [noise=true , address=45.91.116.8:4074 , piece_id=EX4N5ME6KBRK5UGKRMCCHHWIZC3B6BFBDAYFAXW6BE3WU3UDUQ3Q, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.730443579 (328h45m43.16152371s) [noise=true , address=79.127.201.215:4337 , piece_id=MSACTCEZKLWFWZZMUPGGZLWARHCRYKAQGNJ3SFVHTGRDKBNR3N6Q, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.730649653 (328h45m43.161729784s) [noise=true , address=77.90.31.17:4797 , piece_id=BR3FXKWZF4TAOASXPDIWXCSLSF55UQOQZATLTADXSRJTPKIXUCLQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.730878170 (328h45m43.161958301s) [noise=true , address=79.127.219.48:4094 , piece_id=3DNWAYLVRHISWQKX3NCW454ODB3IH6T6QZQWIGFBUBLL2GLKCAMQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.731070709 (328h45m43.16215084s) [noise=true , address=104.36.82.44:4897 , piece_id=D3DO2M7O64HO7RP4GUB2HCBB32AHSEFZBCC3Q2G7GIOXTJ7IXCDQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.731265822 (328h45m43.162345943s) [noise=true , address=79.127.201.215:4347 , piece_id=FJACS3JBJM474LADFST66IIFLHXVCBE6656ISNHNELPSWS3QN4CA, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.731483178 (328h45m43.162563309s) [noise=true , address=77.90.31.19:4844 , piece_id=ZPR4RXYDVC3ZSS5ZZHSECDNRIS7HA47BAVVGLKZLKDVH5ND4NFWQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.731673171 (328h45m43.162753303s) [noise=true , address=79.127.219.47:4061 , piece_id=HWUNDF7UOXSZ6P2ZRH7QVFHOOW2IMEQFNA5UNAS4HCOTG4YHH2GA, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.731867032 (328h45m43.162947163s) [noise=true , address=77.90.31.16:4767 , piece_id=B3I4TWAU43RXNSM5SR5JC6VCQM5CX3WBLYQW7R2DO4UW6OI2OGSQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.732104036 (328h45m43.163184157s) [noise=true , address=77.90.31.13:4637 , piece_id=UFZB6AFGPU7FF7OBKMEUZW5W2OJGDXSCVNW2WLM3ARCHFTOE67EQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.732298017 (328h45m43.163378148s) [noise=true , address=77.90.31.10:4521 , piece_id=BRUKJD2UV4NNUN2UTN5GTKS5VTYUSNBBF6UYUQTTODSKBPEXUPAA, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.732487620 (328h45m43.163567751s) [noise=true , address=77.90.31.11:4579 , piece_id=R4HZMZHS6VVSR2YKD2PTCDDF4MRW35NX62NKEGNKY53ETBJE7WRQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:49.870605774 (328h45m44.301685905s) [upload=342045]: Next returned nil segment
Aug 22 10:11:49.870622286 (328h45m44.301702417s) [upload=342045]: Waiting for error group managing segments...
Aug 22 10:11:50.169601003 (328h45m44.600681134s) [noise=true , address=79.127.205.235:4669 , piece_id=KFHKTBAVBKBBK3VXPCCEA2BTGPUGQKGBKMIEDVL2VXLWALRTFLFQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.630987206 (328h45m45.062067337s) [noise=true , address=79.127.219.48:4094 , piece_id=3DNWAYLVRHISWQKX3NCW454ODB3IH6T6QZQWIGFBUBLL2GLKCAMQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.632762563 (328h45m45.063842704s) [noise=true , address=77.90.31.10:4521 , piece_id=BRUKJD2UV4NNUN2UTN5GTKS5VTYUSNBBF6UYUQTTODSKBPEXUPAA, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.632859269 (328h45m45.06393942s) [noise=true , address=77.90.31.11:4579 , piece_id=R4HZMZHS6VVSR2YKD2PTCDDF4MRW35NX62NKEGNKY53ETBJE7WRQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.680975793 (328h45m45.112055924s) [noise=true , address=79.127.219.47:4061 , piece_id=HWUNDF7UOXSZ6P2ZRH7QVFHOOW2IMEQFNA5UNAS4HCOTG4YHH2GA, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.689902984 (328h45m45.120983115s) [noise=true , address=79.127.201.215:4337 , piece_id=MSACTCEZKLWFWZZMUPGGZLWARHCRYKAQGNJ3SFVHTGRDKBNR3N6Q, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.717942043 (328h45m45.149022164s) [noise=true , address=45.91.116.8:4074 , piece_id=EX4N5ME6KBRK5UGKRMCCHHWIZC3B6BFBDAYFAXW6BE3WU3UDUQ3Q, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.718195058 (328h45m45.149275179s) [noise=true , address=79.127.219.51:4216 , piece_id=26I63ABHGGV2ZLN4YRFRTBJNEUA6SSV52JCTT7WREM7D6TXM5MRQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.739927049 (328h45m45.17100718s) [noise=true , address=77.90.31.16:4767 , piece_id=B3I4TWAU43RXNSM5SR5JC6VCQM5CX3WBLYQW7R2DO4UW6OI2OGSQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.745177816 (328h45m45.176257947s) [noise=true , address=104.36.82.60:4370 , piece_id=6KADSWY7F5BNZZ3YQEBRBQFHOS3KOCLG4YYBH32RDCVLAYH2LBLQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.753707607 (328h45m45.184787748s) [noise=true , address=79.127.201.215:4347 , piece_id=FJACS3JBJM474LADFST66IIFLHXVCBE6656ISNHNELPSWS3QN4CA, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.771635800 (328h45m45.202715931s) [noise=true , address=77.90.31.15:4717 , piece_id=V5CF7G7LDPSSAAOFVKKAO57X5JUYVEUXB45OEJRP4XA2AHQVQCYA, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.779067961 (328h45m45.210148092s) [noise=true , address=77.90.31.13:4637 , piece_id=UFZB6AFGPU7FF7OBKMEUZW5W2OJGDXSCVNW2WLM3ARCHFTOE67EQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.790784388 (328h45m45.221864519s) [noise=true , address=77.90.31.19:4844 , piece_id=ZPR4RXYDVC3ZSS5ZZHSECDNRIS7HA47BAVVGLKZLKDVH5ND4NFWQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.790804657 (328h45m45.221884788s) [seg_pos={0 0}, upload=342045]: Segment reached optimal threshold of 14 pieces.
Aug 22 10:11:50.790918875 (328h45m45.221998996s) [noise=true , address=77.90.31.21:4897 , piece_id=MWUNEFJMU6UNN6Q63ZVYUDC7J4PV7ARHT556LCBTKPJYSGGFEBXA, seg_pos={0 0}, upload=342045]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 22 10:11:50.790976736 (328h45m45.222056857s) [noise=true , address=104.36.82.44:4897 , piece_id=D3DO2M7O64HO7RP4GUB2HCBB32AHSEFZBCC3Q2G7GIOXTJ7IXCDQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 22 10:11:50.791058652 (328h45m45.222138783s) [noise=true , address=77.90.31.12:4621 , piece_id=HKLI7SZVSNIH7PKW7ZVDTENVGMLVAWYT2MOKG7BBJUXE376WJQNQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oSWAY52TJGVyZk4HTfifZBHQv42QsrAsk1Ks9PH6FoEmAZiN3): protocol: expected piece hash; context canceled; EOF
Aug 22 10:11:50.791090354 (328h45m45.222170485s) [noise=true , address=77.90.31.17:4797 , piece_id=BR3FXKWZF4TAOASXPDIWXCSLSF55UQOQZATLTADXSRJTPKIXUCLQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FNxEAEnP3DqdDb16XaBCdmoqdUPEmMtLHDoTuQDBukr2nQWDW): protocol: expected piece hash; context canceled; EOF
Aug 22 10:11:50.791129639 (328h45m45.22220977s) [seg_pos={0 0}, upload=342045]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 10:11:50.791209822 (328h45m45.222289953s) [upload=342045]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 10:11:50.791214330 (328h45m45.222294462s) [upload=342045]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 10:11:51.280790263 (328h45m45.711870394s) [upload=342045]: Done uploading segments...
Aug 22 10:11:51.280806104 (328h45m45.711886235s) [upload=342045]: Upload finished. err: <nil>
Duration: 5.765981359s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.980131408s
FAIL (2025-08-22 10:13:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 10:07:40.474452249 (328h41m34.90553237s) [upload=341968]: Starting upload Aug 22 10:07:40.474498527 (328h41m34.905578648s) [upload=341968]: Done starting upload Aug 22 10:07:40.474599440 (328h41m34.905679571s) [upload=341968]: Uploading segments... Aug 22 10:07:40.474634637 (328h41m34.905714768s) [upload=341968]: Got next segment. Inline: true Aug 22 10:07:40.474639096 (328h41m34.905719227s) [upload=341968]: Waiting for error group managing segments... Aug 22 10:07:40.474670787 (328h41m34.905750908s) [upload=341968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 10:07:40.474674604 (328h41m34.905754725s) [upload=341968]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 10:07:40.474677069 (328h41m34.9057572s) [upload=341968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 10:07:40.692455428 (328h41m35.123535559s) [upload=341968]: Done uploading segments... Aug 22 10:07:40.692473723 (328h41m35.123553854s) [upload=341968]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.980159523s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [..XX....XX....................X......X........X..........X..] duration:
5.902360628s
FAIL (2025-08-22 10:13:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after de9e4cb96f38d938b94ef8ddb31ff41ea52c6aa2280f68ef3674453d70c75e9a != before d97b902db9a3dd61d52f1d46e5ffe2f0eb42497dd753e577d88a03a16767778c
======LOGS======
Aug 22 10:11:47.859166359 (328h45m42.29024648s) [upload=342045]: Starting upload
Aug 22 10:11:47.859209371 (328h45m42.290289502s) [upload=342045]: Done starting upload
Aug 22 10:11:47.859374176 (328h45m42.290454297s) [upload=342045]: Uploading segments...
Aug 22 10:11:47.859398483 (328h45m42.290478604s) [upload=342045]: Got next segment. Inline: false
Aug 22 10:11:47.859442487 (328h45m42.290522619s) [upload=342045]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 10:11:47.859446946 (328h45m42.290527077s) [upload=342045]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 10:11:48.728225244 (328h45m43.159305375s) [seg_pos={0 0}, upload=342045]: Begin upload segment...
Aug 22 10:11:48.728270882 (328h45m43.159351013s) [seg_pos={0 0}, upload=342045]: Done begin upload segment.
Aug 22 10:11:48.728293475 (328h45m43.159373606s) [noise=true , address=79.127.219.51:4216 , piece_id=26I63ABHGGV2ZLN4YRFRTBJNEUA6SSV52JCTT7WREM7D6TXM5MRQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.728320517 (328h45m43.159400648s) [noise=true , address=77.90.31.15:4717 , piece_id=V5CF7G7LDPSSAAOFVKKAO57X5JUYVEUXB45OEJRP4XA2AHQVQCYA, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.728650799 (328h45m43.15973093s) [noise=true , address=77.90.31.12:4621 , piece_id=HKLI7SZVSNIH7PKW7ZVDTENVGMLVAWYT2MOKG7BBJUXE376WJQNQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.729366768 (328h45m43.1604469s) [noise=true , address=104.36.82.60:4370 , piece_id=6KADSWY7F5BNZZ3YQEBRBQFHOS3KOCLG4YYBH32RDCVLAYH2LBLQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.729676561 (328h45m43.160756692s) [noise=true , address=79.127.205.235:4669 , piece_id=KFHKTBAVBKBBK3VXPCCEA2BTGPUGQKGBKMIEDVL2VXLWALRTFLFQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.729984310 (328h45m43.161064441s) [noise=true , address=77.90.31.21:4897 , piece_id=MWUNEFJMU6UNN6Q63ZVYUDC7J4PV7ARHT556LCBTKPJYSGGFEBXA, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.730237874 (328h45m43.161317996s) [noise=true , address=45.91.116.8:4074 , piece_id=EX4N5ME6KBRK5UGKRMCCHHWIZC3B6BFBDAYFAXW6BE3WU3UDUQ3Q, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.730443579 (328h45m43.16152371s) [noise=true , address=79.127.201.215:4337 , piece_id=MSACTCEZKLWFWZZMUPGGZLWARHCRYKAQGNJ3SFVHTGRDKBNR3N6Q, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.730649653 (328h45m43.161729784s) [noise=true , address=77.90.31.17:4797 , piece_id=BR3FXKWZF4TAOASXPDIWXCSLSF55UQOQZATLTADXSRJTPKIXUCLQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.730878170 (328h45m43.161958301s) [noise=true , address=79.127.219.48:4094 , piece_id=3DNWAYLVRHISWQKX3NCW454ODB3IH6T6QZQWIGFBUBLL2GLKCAMQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.731070709 (328h45m43.16215084s) [noise=true , address=104.36.82.44:4897 , piece_id=D3DO2M7O64HO7RP4GUB2HCBB32AHSEFZBCC3Q2G7GIOXTJ7IXCDQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.731265822 (328h45m43.162345943s) [noise=true , address=79.127.201.215:4347 , piece_id=FJACS3JBJM474LADFST66IIFLHXVCBE6656ISNHNELPSWS3QN4CA, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.731483178 (328h45m43.162563309s) [noise=true , address=77.90.31.19:4844 , piece_id=ZPR4RXYDVC3ZSS5ZZHSECDNRIS7HA47BAVVGLKZLKDVH5ND4NFWQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.731673171 (328h45m43.162753303s) [noise=true , address=79.127.219.47:4061 , piece_id=HWUNDF7UOXSZ6P2ZRH7QVFHOOW2IMEQFNA5UNAS4HCOTG4YHH2GA, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.731867032 (328h45m43.162947163s) [noise=true , address=77.90.31.16:4767 , piece_id=B3I4TWAU43RXNSM5SR5JC6VCQM5CX3WBLYQW7R2DO4UW6OI2OGSQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.732104036 (328h45m43.163184157s) [noise=true , address=77.90.31.13:4637 , piece_id=UFZB6AFGPU7FF7OBKMEUZW5W2OJGDXSCVNW2WLM3ARCHFTOE67EQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.732298017 (328h45m43.163378148s) [noise=true , address=77.90.31.10:4521 , piece_id=BRUKJD2UV4NNUN2UTN5GTKS5VTYUSNBBF6UYUQTTODSKBPEXUPAA, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.732487620 (328h45m43.163567751s) [noise=true , address=77.90.31.11:4579 , piece_id=R4HZMZHS6VVSR2YKD2PTCDDF4MRW35NX62NKEGNKY53ETBJE7WRQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:49.870605774 (328h45m44.301685905s) [upload=342045]: Next returned nil segment
Aug 22 10:11:49.870622286 (328h45m44.301702417s) [upload=342045]: Waiting for error group managing segments...
Aug 22 10:11:50.169601003 (328h45m44.600681134s) [noise=true , address=79.127.205.235:4669 , piece_id=KFHKTBAVBKBBK3VXPCCEA2BTGPUGQKGBKMIEDVL2VXLWALRTFLFQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.630987206 (328h45m45.062067337s) [noise=true , address=79.127.219.48:4094 , piece_id=3DNWAYLVRHISWQKX3NCW454ODB3IH6T6QZQWIGFBUBLL2GLKCAMQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.632762563 (328h45m45.063842704s) [noise=true , address=77.90.31.10:4521 , piece_id=BRUKJD2UV4NNUN2UTN5GTKS5VTYUSNBBF6UYUQTTODSKBPEXUPAA, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.632859269 (328h45m45.06393942s) [noise=true , address=77.90.31.11:4579 , piece_id=R4HZMZHS6VVSR2YKD2PTCDDF4MRW35NX62NKEGNKY53ETBJE7WRQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.680975793 (328h45m45.112055924s) [noise=true , address=79.127.219.47:4061 , piece_id=HWUNDF7UOXSZ6P2ZRH7QVFHOOW2IMEQFNA5UNAS4HCOTG4YHH2GA, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.689902984 (328h45m45.120983115s) [noise=true , address=79.127.201.215:4337 , piece_id=MSACTCEZKLWFWZZMUPGGZLWARHCRYKAQGNJ3SFVHTGRDKBNR3N6Q, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.717942043 (328h45m45.149022164s) [noise=true , address=45.91.116.8:4074 , piece_id=EX4N5ME6KBRK5UGKRMCCHHWIZC3B6BFBDAYFAXW6BE3WU3UDUQ3Q, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.718195058 (328h45m45.149275179s) [noise=true , address=79.127.219.51:4216 , piece_id=26I63ABHGGV2ZLN4YRFRTBJNEUA6SSV52JCTT7WREM7D6TXM5MRQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.739927049 (328h45m45.17100718s) [noise=true , address=77.90.31.16:4767 , piece_id=B3I4TWAU43RXNSM5SR5JC6VCQM5CX3WBLYQW7R2DO4UW6OI2OGSQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.745177816 (328h45m45.176257947s) [noise=true , address=104.36.82.60:4370 , piece_id=6KADSWY7F5BNZZ3YQEBRBQFHOS3KOCLG4YYBH32RDCVLAYH2LBLQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.753707607 (328h45m45.184787748s) [noise=true , address=79.127.201.215:4347 , piece_id=FJACS3JBJM474LADFST66IIFLHXVCBE6656ISNHNELPSWS3QN4CA, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.771635800 (328h45m45.202715931s) [noise=true , address=77.90.31.15:4717 , piece_id=V5CF7G7LDPSSAAOFVKKAO57X5JUYVEUXB45OEJRP4XA2AHQVQCYA, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.779067961 (328h45m45.210148092s) [noise=true , address=77.90.31.13:4637 , piece_id=UFZB6AFGPU7FF7OBKMEUZW5W2OJGDXSCVNW2WLM3ARCHFTOE67EQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.790784388 (328h45m45.221864519s) [noise=true , address=77.90.31.19:4844 , piece_id=ZPR4RXYDVC3ZSS5ZZHSECDNRIS7HA47BAVVGLKZLKDVH5ND4NFWQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.790804657 (328h45m45.221884788s) [seg_pos={0 0}, upload=342045]: Segment reached optimal threshold of 14 pieces.
Aug 22 10:11:50.790918875 (328h45m45.221998996s) [noise=true , address=77.90.31.21:4897 , piece_id=MWUNEFJMU6UNN6Q63ZVYUDC7J4PV7ARHT556LCBTKPJYSGGFEBXA, seg_pos={0 0}, upload=342045]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 22 10:11:50.790976736 (328h45m45.222056857s) [noise=true , address=104.36.82.44:4897 , piece_id=D3DO2M7O64HO7RP4GUB2HCBB32AHSEFZBCC3Q2G7GIOXTJ7IXCDQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 22 10:11:50.791058652 (328h45m45.222138783s) [noise=true , address=77.90.31.12:4621 , piece_id=HKLI7SZVSNIH7PKW7ZVDTENVGMLVAWYT2MOKG7BBJUXE376WJQNQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oSWAY52TJGVyZk4HTfifZBHQv42QsrAsk1Ks9PH6FoEmAZiN3): protocol: expected piece hash; context canceled; EOF
Aug 22 10:11:50.791090354 (328h45m45.222170485s) [noise=true , address=77.90.31.17:4797 , piece_id=BR3FXKWZF4TAOASXPDIWXCSLSF55UQOQZATLTADXSRJTPKIXUCLQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FNxEAEnP3DqdDb16XaBCdmoqdUPEmMtLHDoTuQDBukr2nQWDW): protocol: expected piece hash; context canceled; EOF
Aug 22 10:11:50.791129639 (328h45m45.22220977s) [seg_pos={0 0}, upload=342045]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 10:11:50.791209822 (328h45m45.222289953s) [upload=342045]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 10:11:50.791214330 (328h45m45.222294462s) [upload=342045]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 10:11:51.280790263 (328h45m45.711870394s) [upload=342045]: Done uploading segments...
Aug 22 10:11:51.280806104 (328h45m45.711886235s) [upload=342045]: Upload finished. err: <nil>
Duration: 5.902385917s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [...XX....XX....................X......X........X..........X.] duration:
5.57115611s
FAIL (2025-08-22 10:12:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after de9e4cb96f38d938b94ef8ddb31ff41ea52c6aa2280f68ef3674453d70c75e9a != before d97b902db9a3dd61d52f1d46e5ffe2f0eb42497dd753e577d88a03a16767778c
======LOGS======
Aug 22 10:11:47.859166359 (328h45m42.29024648s) [upload=342045]: Starting upload
Aug 22 10:11:47.859209371 (328h45m42.290289502s) [upload=342045]: Done starting upload
Aug 22 10:11:47.859374176 (328h45m42.290454297s) [upload=342045]: Uploading segments...
Aug 22 10:11:47.859398483 (328h45m42.290478604s) [upload=342045]: Got next segment. Inline: false
Aug 22 10:11:47.859442487 (328h45m42.290522619s) [upload=342045]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 10:11:47.859446946 (328h45m42.290527077s) [upload=342045]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 10:11:48.728225244 (328h45m43.159305375s) [seg_pos={0 0}, upload=342045]: Begin upload segment...
Aug 22 10:11:48.728270882 (328h45m43.159351013s) [seg_pos={0 0}, upload=342045]: Done begin upload segment.
Aug 22 10:11:48.728293475 (328h45m43.159373606s) [noise=true , address=79.127.219.51:4216 , piece_id=26I63ABHGGV2ZLN4YRFRTBJNEUA6SSV52JCTT7WREM7D6TXM5MRQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.728320517 (328h45m43.159400648s) [noise=true , address=77.90.31.15:4717 , piece_id=V5CF7G7LDPSSAAOFVKKAO57X5JUYVEUXB45OEJRP4XA2AHQVQCYA, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.728650799 (328h45m43.15973093s) [noise=true , address=77.90.31.12:4621 , piece_id=HKLI7SZVSNIH7PKW7ZVDTENVGMLVAWYT2MOKG7BBJUXE376WJQNQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.729366768 (328h45m43.1604469s) [noise=true , address=104.36.82.60:4370 , piece_id=6KADSWY7F5BNZZ3YQEBRBQFHOS3KOCLG4YYBH32RDCVLAYH2LBLQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.729676561 (328h45m43.160756692s) [noise=true , address=79.127.205.235:4669 , piece_id=KFHKTBAVBKBBK3VXPCCEA2BTGPUGQKGBKMIEDVL2VXLWALRTFLFQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.729984310 (328h45m43.161064441s) [noise=true , address=77.90.31.21:4897 , piece_id=MWUNEFJMU6UNN6Q63ZVYUDC7J4PV7ARHT556LCBTKPJYSGGFEBXA, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.730237874 (328h45m43.161317996s) [noise=true , address=45.91.116.8:4074 , piece_id=EX4N5ME6KBRK5UGKRMCCHHWIZC3B6BFBDAYFAXW6BE3WU3UDUQ3Q, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.730443579 (328h45m43.16152371s) [noise=true , address=79.127.201.215:4337 , piece_id=MSACTCEZKLWFWZZMUPGGZLWARHCRYKAQGNJ3SFVHTGRDKBNR3N6Q, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.730649653 (328h45m43.161729784s) [noise=true , address=77.90.31.17:4797 , piece_id=BR3FXKWZF4TAOASXPDIWXCSLSF55UQOQZATLTADXSRJTPKIXUCLQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.730878170 (328h45m43.161958301s) [noise=true , address=79.127.219.48:4094 , piece_id=3DNWAYLVRHISWQKX3NCW454ODB3IH6T6QZQWIGFBUBLL2GLKCAMQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.731070709 (328h45m43.16215084s) [noise=true , address=104.36.82.44:4897 , piece_id=D3DO2M7O64HO7RP4GUB2HCBB32AHSEFZBCC3Q2G7GIOXTJ7IXCDQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.731265822 (328h45m43.162345943s) [noise=true , address=79.127.201.215:4347 , piece_id=FJACS3JBJM474LADFST66IIFLHXVCBE6656ISNHNELPSWS3QN4CA, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.731483178 (328h45m43.162563309s) [noise=true , address=77.90.31.19:4844 , piece_id=ZPR4RXYDVC3ZSS5ZZHSECDNRIS7HA47BAVVGLKZLKDVH5ND4NFWQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.731673171 (328h45m43.162753303s) [noise=true , address=79.127.219.47:4061 , piece_id=HWUNDF7UOXSZ6P2ZRH7QVFHOOW2IMEQFNA5UNAS4HCOTG4YHH2GA, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.731867032 (328h45m43.162947163s) [noise=true , address=77.90.31.16:4767 , piece_id=B3I4TWAU43RXNSM5SR5JC6VCQM5CX3WBLYQW7R2DO4UW6OI2OGSQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.732104036 (328h45m43.163184157s) [noise=true , address=77.90.31.13:4637 , piece_id=UFZB6AFGPU7FF7OBKMEUZW5W2OJGDXSCVNW2WLM3ARCHFTOE67EQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.732298017 (328h45m43.163378148s) [noise=true , address=77.90.31.10:4521 , piece_id=BRUKJD2UV4NNUN2UTN5GTKS5VTYUSNBBF6UYUQTTODSKBPEXUPAA, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.732487620 (328h45m43.163567751s) [noise=true , address=77.90.31.11:4579 , piece_id=R4HZMZHS6VVSR2YKD2PTCDDF4MRW35NX62NKEGNKY53ETBJE7WRQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:49.870605774 (328h45m44.301685905s) [upload=342045]: Next returned nil segment
Aug 22 10:11:49.870622286 (328h45m44.301702417s) [upload=342045]: Waiting for error group managing segments...
Aug 22 10:11:50.169601003 (328h45m44.600681134s) [noise=true , address=79.127.205.235:4669 , piece_id=KFHKTBAVBKBBK3VXPCCEA2BTGPUGQKGBKMIEDVL2VXLWALRTFLFQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.630987206 (328h45m45.062067337s) [noise=true , address=79.127.219.48:4094 , piece_id=3DNWAYLVRHISWQKX3NCW454ODB3IH6T6QZQWIGFBUBLL2GLKCAMQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.632762563 (328h45m45.063842704s) [noise=true , address=77.90.31.10:4521 , piece_id=BRUKJD2UV4NNUN2UTN5GTKS5VTYUSNBBF6UYUQTTODSKBPEXUPAA, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.632859269 (328h45m45.06393942s) [noise=true , address=77.90.31.11:4579 , piece_id=R4HZMZHS6VVSR2YKD2PTCDDF4MRW35NX62NKEGNKY53ETBJE7WRQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.680975793 (328h45m45.112055924s) [noise=true , address=79.127.219.47:4061 , piece_id=HWUNDF7UOXSZ6P2ZRH7QVFHOOW2IMEQFNA5UNAS4HCOTG4YHH2GA, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.689902984 (328h45m45.120983115s) [noise=true , address=79.127.201.215:4337 , piece_id=MSACTCEZKLWFWZZMUPGGZLWARHCRYKAQGNJ3SFVHTGRDKBNR3N6Q, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.717942043 (328h45m45.149022164s) [noise=true , address=45.91.116.8:4074 , piece_id=EX4N5ME6KBRK5UGKRMCCHHWIZC3B6BFBDAYFAXW6BE3WU3UDUQ3Q, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.718195058 (328h45m45.149275179s) [noise=true , address=79.127.219.51:4216 , piece_id=26I63ABHGGV2ZLN4YRFRTBJNEUA6SSV52JCTT7WREM7D6TXM5MRQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.739927049 (328h45m45.17100718s) [noise=true , address=77.90.31.16:4767 , piece_id=B3I4TWAU43RXNSM5SR5JC6VCQM5CX3WBLYQW7R2DO4UW6OI2OGSQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.745177816 (328h45m45.176257947s) [noise=true , address=104.36.82.60:4370 , piece_id=6KADSWY7F5BNZZ3YQEBRBQFHOS3KOCLG4YYBH32RDCVLAYH2LBLQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.753707607 (328h45m45.184787748s) [noise=true , address=79.127.201.215:4347 , piece_id=FJACS3JBJM474LADFST66IIFLHXVCBE6656ISNHNELPSWS3QN4CA, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.771635800 (328h45m45.202715931s) [noise=true , address=77.90.31.15:4717 , piece_id=V5CF7G7LDPSSAAOFVKKAO57X5JUYVEUXB45OEJRP4XA2AHQVQCYA, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.779067961 (328h45m45.210148092s) [noise=true , address=77.90.31.13:4637 , piece_id=UFZB6AFGPU7FF7OBKMEUZW5W2OJGDXSCVNW2WLM3ARCHFTOE67EQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.790784388 (328h45m45.221864519s) [noise=true , address=77.90.31.19:4844 , piece_id=ZPR4RXYDVC3ZSS5ZZHSECDNRIS7HA47BAVVGLKZLKDVH5ND4NFWQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.790804657 (328h45m45.221884788s) [seg_pos={0 0}, upload=342045]: Segment reached optimal threshold of 14 pieces.
Aug 22 10:11:50.790918875 (328h45m45.221998996s) [noise=true , address=77.90.31.21:4897 , piece_id=MWUNEFJMU6UNN6Q63ZVYUDC7J4PV7ARHT556LCBTKPJYSGGFEBXA, seg_pos={0 0}, upload=342045]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 22 10:11:50.790976736 (328h45m45.222056857s) [noise=true , address=104.36.82.44:4897 , piece_id=D3DO2M7O64HO7RP4GUB2HCBB32AHSEFZBCC3Q2G7GIOXTJ7IXCDQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 22 10:11:50.791058652 (328h45m45.222138783s) [noise=true , address=77.90.31.12:4621 , piece_id=HKLI7SZVSNIH7PKW7ZVDTENVGMLVAWYT2MOKG7BBJUXE376WJQNQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oSWAY52TJGVyZk4HTfifZBHQv42QsrAsk1Ks9PH6FoEmAZiN3): protocol: expected piece hash; context canceled; EOF
Aug 22 10:11:50.791090354 (328h45m45.222170485s) [noise=true , address=77.90.31.17:4797 , piece_id=BR3FXKWZF4TAOASXPDIWXCSLSF55UQOQZATLTADXSRJTPKIXUCLQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FNxEAEnP3DqdDb16XaBCdmoqdUPEmMtLHDoTuQDBukr2nQWDW): protocol: expected piece hash; context canceled; EOF
Aug 22 10:11:50.791129639 (328h45m45.22220977s) [seg_pos={0 0}, upload=342045]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 10:11:50.791209822 (328h45m45.222289953s) [upload=342045]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 10:11:50.791214330 (328h45m45.222294462s) [upload=342045]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 10:11:51.280790263 (328h45m45.711870394s) [upload=342045]: Done uploading segments...
Aug 22 10:11:51.280806104 (328h45m45.711886235s) [upload=342045]: Upload finished. err: <nil>
Duration: 5.571177572s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.92446036s
FAIL (2025-08-22 10:12:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 10:07:40.474452249 (328h41m34.90553237s) [upload=341968]: Starting upload Aug 22 10:07:40.474498527 (328h41m34.905578648s) [upload=341968]: Done starting upload Aug 22 10:07:40.474599440 (328h41m34.905679571s) [upload=341968]: Uploading segments... Aug 22 10:07:40.474634637 (328h41m34.905714768s) [upload=341968]: Got next segment. Inline: true Aug 22 10:07:40.474639096 (328h41m34.905719227s) [upload=341968]: Waiting for error group managing segments... Aug 22 10:07:40.474670787 (328h41m34.905750908s) [upload=341968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 10:07:40.474674604 (328h41m34.905754725s) [upload=341968]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 10:07:40.474677069 (328h41m34.9057572s) [upload=341968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 10:07:40.692455428 (328h41m35.123535559s) [upload=341968]: Done uploading segments... Aug 22 10:07:40.692473723 (328h41m35.123553854s) [upload=341968]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.924487421s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [....XX....XX....................X......X........X..........X] duration:
6.486492419s
FAIL (2025-08-22 10:11:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after de9e4cb96f38d938b94ef8ddb31ff41ea52c6aa2280f68ef3674453d70c75e9a != before d97b902db9a3dd61d52f1d46e5ffe2f0eb42497dd753e577d88a03a16767778c
======LOGS======
Aug 22 10:11:47.859166359 (328h45m42.29024648s) [upload=342045]: Starting upload
Aug 22 10:11:47.859209371 (328h45m42.290289502s) [upload=342045]: Done starting upload
Aug 22 10:11:47.859374176 (328h45m42.290454297s) [upload=342045]: Uploading segments...
Aug 22 10:11:47.859398483 (328h45m42.290478604s) [upload=342045]: Got next segment. Inline: false
Aug 22 10:11:47.859442487 (328h45m42.290522619s) [upload=342045]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 10:11:47.859446946 (328h45m42.290527077s) [upload=342045]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 10:11:48.728225244 (328h45m43.159305375s) [seg_pos={0 0}, upload=342045]: Begin upload segment...
Aug 22 10:11:48.728270882 (328h45m43.159351013s) [seg_pos={0 0}, upload=342045]: Done begin upload segment.
Aug 22 10:11:48.728293475 (328h45m43.159373606s) [noise=true , address=79.127.219.51:4216 , piece_id=26I63ABHGGV2ZLN4YRFRTBJNEUA6SSV52JCTT7WREM7D6TXM5MRQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.728320517 (328h45m43.159400648s) [noise=true , address=77.90.31.15:4717 , piece_id=V5CF7G7LDPSSAAOFVKKAO57X5JUYVEUXB45OEJRP4XA2AHQVQCYA, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.728650799 (328h45m43.15973093s) [noise=true , address=77.90.31.12:4621 , piece_id=HKLI7SZVSNIH7PKW7ZVDTENVGMLVAWYT2MOKG7BBJUXE376WJQNQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.729366768 (328h45m43.1604469s) [noise=true , address=104.36.82.60:4370 , piece_id=6KADSWY7F5BNZZ3YQEBRBQFHOS3KOCLG4YYBH32RDCVLAYH2LBLQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.729676561 (328h45m43.160756692s) [noise=true , address=79.127.205.235:4669 , piece_id=KFHKTBAVBKBBK3VXPCCEA2BTGPUGQKGBKMIEDVL2VXLWALRTFLFQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.729984310 (328h45m43.161064441s) [noise=true , address=77.90.31.21:4897 , piece_id=MWUNEFJMU6UNN6Q63ZVYUDC7J4PV7ARHT556LCBTKPJYSGGFEBXA, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.730237874 (328h45m43.161317996s) [noise=true , address=45.91.116.8:4074 , piece_id=EX4N5ME6KBRK5UGKRMCCHHWIZC3B6BFBDAYFAXW6BE3WU3UDUQ3Q, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.730443579 (328h45m43.16152371s) [noise=true , address=79.127.201.215:4337 , piece_id=MSACTCEZKLWFWZZMUPGGZLWARHCRYKAQGNJ3SFVHTGRDKBNR3N6Q, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.730649653 (328h45m43.161729784s) [noise=true , address=77.90.31.17:4797 , piece_id=BR3FXKWZF4TAOASXPDIWXCSLSF55UQOQZATLTADXSRJTPKIXUCLQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.730878170 (328h45m43.161958301s) [noise=true , address=79.127.219.48:4094 , piece_id=3DNWAYLVRHISWQKX3NCW454ODB3IH6T6QZQWIGFBUBLL2GLKCAMQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.731070709 (328h45m43.16215084s) [noise=true , address=104.36.82.44:4897 , piece_id=D3DO2M7O64HO7RP4GUB2HCBB32AHSEFZBCC3Q2G7GIOXTJ7IXCDQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.731265822 (328h45m43.162345943s) [noise=true , address=79.127.201.215:4347 , piece_id=FJACS3JBJM474LADFST66IIFLHXVCBE6656ISNHNELPSWS3QN4CA, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.731483178 (328h45m43.162563309s) [noise=true , address=77.90.31.19:4844 , piece_id=ZPR4RXYDVC3ZSS5ZZHSECDNRIS7HA47BAVVGLKZLKDVH5ND4NFWQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.731673171 (328h45m43.162753303s) [noise=true , address=79.127.219.47:4061 , piece_id=HWUNDF7UOXSZ6P2ZRH7QVFHOOW2IMEQFNA5UNAS4HCOTG4YHH2GA, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.731867032 (328h45m43.162947163s) [noise=true , address=77.90.31.16:4767 , piece_id=B3I4TWAU43RXNSM5SR5JC6VCQM5CX3WBLYQW7R2DO4UW6OI2OGSQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.732104036 (328h45m43.163184157s) [noise=true , address=77.90.31.13:4637 , piece_id=UFZB6AFGPU7FF7OBKMEUZW5W2OJGDXSCVNW2WLM3ARCHFTOE67EQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.732298017 (328h45m43.163378148s) [noise=true , address=77.90.31.10:4521 , piece_id=BRUKJD2UV4NNUN2UTN5GTKS5VTYUSNBBF6UYUQTTODSKBPEXUPAA, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:48.732487620 (328h45m43.163567751s) [noise=true , address=77.90.31.11:4579 , piece_id=R4HZMZHS6VVSR2YKD2PTCDDF4MRW35NX62NKEGNKY53ETBJE7WRQ, seg_pos={0 0}, upload=342045]: Uploading piece...
Aug 22 10:11:49.870605774 (328h45m44.301685905s) [upload=342045]: Next returned nil segment
Aug 22 10:11:49.870622286 (328h45m44.301702417s) [upload=342045]: Waiting for error group managing segments...
Aug 22 10:11:50.169601003 (328h45m44.600681134s) [noise=true , address=79.127.205.235:4669 , piece_id=KFHKTBAVBKBBK3VXPCCEA2BTGPUGQKGBKMIEDVL2VXLWALRTFLFQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.630987206 (328h45m45.062067337s) [noise=true , address=79.127.219.48:4094 , piece_id=3DNWAYLVRHISWQKX3NCW454ODB3IH6T6QZQWIGFBUBLL2GLKCAMQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.632762563 (328h45m45.063842704s) [noise=true , address=77.90.31.10:4521 , piece_id=BRUKJD2UV4NNUN2UTN5GTKS5VTYUSNBBF6UYUQTTODSKBPEXUPAA, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.632859269 (328h45m45.06393942s) [noise=true , address=77.90.31.11:4579 , piece_id=R4HZMZHS6VVSR2YKD2PTCDDF4MRW35NX62NKEGNKY53ETBJE7WRQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.680975793 (328h45m45.112055924s) [noise=true , address=79.127.219.47:4061 , piece_id=HWUNDF7UOXSZ6P2ZRH7QVFHOOW2IMEQFNA5UNAS4HCOTG4YHH2GA, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.689902984 (328h45m45.120983115s) [noise=true , address=79.127.201.215:4337 , piece_id=MSACTCEZKLWFWZZMUPGGZLWARHCRYKAQGNJ3SFVHTGRDKBNR3N6Q, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.717942043 (328h45m45.149022164s) [noise=true , address=45.91.116.8:4074 , piece_id=EX4N5ME6KBRK5UGKRMCCHHWIZC3B6BFBDAYFAXW6BE3WU3UDUQ3Q, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.718195058 (328h45m45.149275179s) [noise=true , address=79.127.219.51:4216 , piece_id=26I63ABHGGV2ZLN4YRFRTBJNEUA6SSV52JCTT7WREM7D6TXM5MRQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.739927049 (328h45m45.17100718s) [noise=true , address=77.90.31.16:4767 , piece_id=B3I4TWAU43RXNSM5SR5JC6VCQM5CX3WBLYQW7R2DO4UW6OI2OGSQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.745177816 (328h45m45.176257947s) [noise=true , address=104.36.82.60:4370 , piece_id=6KADSWY7F5BNZZ3YQEBRBQFHOS3KOCLG4YYBH32RDCVLAYH2LBLQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.753707607 (328h45m45.184787748s) [noise=true , address=79.127.201.215:4347 , piece_id=FJACS3JBJM474LADFST66IIFLHXVCBE6656ISNHNELPSWS3QN4CA, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.771635800 (328h45m45.202715931s) [noise=true , address=77.90.31.15:4717 , piece_id=V5CF7G7LDPSSAAOFVKKAO57X5JUYVEUXB45OEJRP4XA2AHQVQCYA, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.779067961 (328h45m45.210148092s) [noise=true , address=77.90.31.13:4637 , piece_id=UFZB6AFGPU7FF7OBKMEUZW5W2OJGDXSCVNW2WLM3ARCHFTOE67EQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.790784388 (328h45m45.221864519s) [noise=true , address=77.90.31.19:4844 , piece_id=ZPR4RXYDVC3ZSS5ZZHSECDNRIS7HA47BAVVGLKZLKDVH5ND4NFWQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: <nil>
Aug 22 10:11:50.790804657 (328h45m45.221884788s) [seg_pos={0 0}, upload=342045]: Segment reached optimal threshold of 14 pieces.
Aug 22 10:11:50.790918875 (328h45m45.221998996s) [noise=true , address=77.90.31.21:4897 , piece_id=MWUNEFJMU6UNN6Q63ZVYUDC7J4PV7ARHT556LCBTKPJYSGGFEBXA, seg_pos={0 0}, upload=342045]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 22 10:11:50.790976736 (328h45m45.222056857s) [noise=true , address=104.36.82.44:4897 , piece_id=D3DO2M7O64HO7RP4GUB2HCBB32AHSEFZBCC3Q2G7GIOXTJ7IXCDQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 22 10:11:50.791058652 (328h45m45.222138783s) [noise=true , address=77.90.31.12:4621 , piece_id=HKLI7SZVSNIH7PKW7ZVDTENVGMLVAWYT2MOKG7BBJUXE376WJQNQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oSWAY52TJGVyZk4HTfifZBHQv42QsrAsk1Ks9PH6FoEmAZiN3): protocol: expected piece hash; context canceled; EOF
Aug 22 10:11:50.791090354 (328h45m45.222170485s) [noise=true , address=77.90.31.17:4797 , piece_id=BR3FXKWZF4TAOASXPDIWXCSLSF55UQOQZATLTADXSRJTPKIXUCLQ, seg_pos={0 0}, upload=342045]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FNxEAEnP3DqdDb16XaBCdmoqdUPEmMtLHDoTuQDBukr2nQWDW): protocol: expected piece hash; context canceled; EOF
Aug 22 10:11:50.791129639 (328h45m45.22220977s) [seg_pos={0 0}, upload=342045]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 10:11:50.791209822 (328h45m45.222289953s) [upload=342045]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 10:11:50.791214330 (328h45m45.222294462s) [upload=342045]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 10:11:51.280790263 (328h45m45.711870394s) [upload=342045]: Done uploading segments...
Aug 22 10:11:51.280806104 (328h45m45.711886235s) [upload=342045]: Upload finished. err: <nil>
Duration: 6.48651983s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
1.874101354s
FAIL (2025-08-22 10:11:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 10:07:40.474452249 (328h41m34.90553237s) [upload=341968]: Starting upload Aug 22 10:07:40.474498527 (328h41m34.905578648s) [upload=341968]: Done starting upload Aug 22 10:07:40.474599440 (328h41m34.905679571s) [upload=341968]: Uploading segments... Aug 22 10:07:40.474634637 (328h41m34.905714768s) [upload=341968]: Got next segment. Inline: true Aug 22 10:07:40.474639096 (328h41m34.905719227s) [upload=341968]: Waiting for error group managing segments... Aug 22 10:07:40.474670787 (328h41m34.905750908s) [upload=341968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 10:07:40.474674604 (328h41m34.905754725s) [upload=341968]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 10:07:40.474677069 (328h41m34.9057572s) [upload=341968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 10:07:40.692455428 (328h41m35.123535559s) [upload=341968]: Done uploading segments... Aug 22 10:07:40.692473723 (328h41m35.123553854s) [upload=341968]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.87412589s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.....XX....XX....................X......X........X..........] duration:
6.165462602s
FAIL (2025-08-22 10:11:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 10:06:12.981507495 (328h40m7.412587626s) [upload=341946]: Starting upload Aug 22 10:06:12.981554294 (328h40m7.412634415s) [upload=341946]: Done starting upload Aug 22 10:06:12.981665647 (328h40m7.412745778s) [upload=341946]: Uploading segments... Aug 22 10:06:12.981724650 (328h40m7.412804781s) [upload=341946]: Got next segment. Inline: false Aug 22 10:06:12.981749076 (328h40m7.412829207s) [upload=341946]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 10:06:12.981753836 (328h40m7.412833967s) [upload=341946]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 10:06:13.216703010 (328h40m7.647783142s) [upload=341946]: Next segment err: metaclient: Too Many Requests Aug 22 10:06:13.216728780 (328h40m7.647808911s) [upload=341946]: Done uploading segments... Aug 22 10:06:13.216742416 (328h40m7.647822547s) [upload=341946]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.165492488s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [......XX....XX....................X......X........X.........] duration:
5.95343003s
FAIL (2025-08-22 10:10:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 10:06:12.981507495 (328h40m7.412587626s) [upload=341946]: Starting upload Aug 22 10:06:12.981554294 (328h40m7.412634415s) [upload=341946]: Done starting upload Aug 22 10:06:12.981665647 (328h40m7.412745778s) [upload=341946]: Uploading segments... Aug 22 10:06:12.981724650 (328h40m7.412804781s) [upload=341946]: Got next segment. Inline: false Aug 22 10:06:12.981749076 (328h40m7.412829207s) [upload=341946]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 10:06:12.981753836 (328h40m7.412833967s) [upload=341946]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 10:06:13.216703010 (328h40m7.647783142s) [upload=341946]: Next segment err: metaclient: Too Many Requests Aug 22 10:06:13.216728780 (328h40m7.647808911s) [upload=341946]: Done uploading segments... Aug 22 10:06:13.216742416 (328h40m7.647822547s) [upload=341946]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.953456762s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.926235005s
FAIL (2025-08-22 10:10:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 10:07:40.474452249 (328h41m34.90553237s) [upload=341968]: Starting upload Aug 22 10:07:40.474498527 (328h41m34.905578648s) [upload=341968]: Done starting upload Aug 22 10:07:40.474599440 (328h41m34.905679571s) [upload=341968]: Uploading segments... Aug 22 10:07:40.474634637 (328h41m34.905714768s) [upload=341968]: Got next segment. Inline: true Aug 22 10:07:40.474639096 (328h41m34.905719227s) [upload=341968]: Waiting for error group managing segments... Aug 22 10:07:40.474670787 (328h41m34.905750908s) [upload=341968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 10:07:40.474674604 (328h41m34.905754725s) [upload=341968]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 10:07:40.474677069 (328h41m34.9057572s) [upload=341968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 10:07:40.692455428 (328h41m35.123535559s) [upload=341968]: Done uploading segments... Aug 22 10:07:40.692473723 (328h41m35.123553854s) [upload=341968]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.926261596s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.......XX....XX....................X......X........X........] duration:
5.633118401s
FAIL (2025-08-22 10:10:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 10:06:12.981507495 (328h40m7.412587626s) [upload=341946]: Starting upload Aug 22 10:06:12.981554294 (328h40m7.412634415s) [upload=341946]: Done starting upload Aug 22 10:06:12.981665647 (328h40m7.412745778s) [upload=341946]: Uploading segments... Aug 22 10:06:12.981724650 (328h40m7.412804781s) [upload=341946]: Got next segment. Inline: false Aug 22 10:06:12.981749076 (328h40m7.412829207s) [upload=341946]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 10:06:12.981753836 (328h40m7.412833967s) [upload=341946]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 10:06:13.216703010 (328h40m7.647783142s) [upload=341946]: Next segment err: metaclient: Too Many Requests Aug 22 10:06:13.216728780 (328h40m7.647808911s) [upload=341946]: Done uploading segments... Aug 22 10:06:13.216742416 (328h40m7.647822547s) [upload=341946]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.633146727s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [X.......XX....XX....................X......X........X.......] duration:
6.397849392s
FAIL (2025-08-22 10:09:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 10:06:12.981507495 (328h40m7.412587626s) [upload=341946]: Starting upload Aug 22 10:06:12.981554294 (328h40m7.412634415s) [upload=341946]: Done starting upload Aug 22 10:06:12.981665647 (328h40m7.412745778s) [upload=341946]: Uploading segments... Aug 22 10:06:12.981724650 (328h40m7.412804781s) [upload=341946]: Got next segment. Inline: false Aug 22 10:06:12.981749076 (328h40m7.412829207s) [upload=341946]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 10:06:12.981753836 (328h40m7.412833967s) [upload=341946]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 10:06:13.216703010 (328h40m7.647783142s) [upload=341946]: Next segment err: metaclient: Too Many Requests Aug 22 10:06:13.216728780 (328h40m7.647808911s) [upload=341946]: Done uploading segments... Aug 22 10:06:13.216742416 (328h40m7.647822547s) [upload=341946]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.397880992s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
3.562532131s
FAIL (2025-08-22 10:09:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 10:07:40.474452249 (328h41m34.90553237s) [upload=341968]: Starting upload Aug 22 10:07:40.474498527 (328h41m34.905578648s) [upload=341968]: Done starting upload Aug 22 10:07:40.474599440 (328h41m34.905679571s) [upload=341968]: Uploading segments... Aug 22 10:07:40.474634637 (328h41m34.905714768s) [upload=341968]: Got next segment. Inline: true Aug 22 10:07:40.474639096 (328h41m34.905719227s) [upload=341968]: Waiting for error group managing segments... Aug 22 10:07:40.474670787 (328h41m34.905750908s) [upload=341968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 10:07:40.474674604 (328h41m34.905754725s) [upload=341968]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 10:07:40.474677069 (328h41m34.9057572s) [upload=341968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 10:07:40.692455428 (328h41m35.123535559s) [upload=341968]: Done uploading segments... Aug 22 10:07:40.692473723 (328h41m35.123553854s) [upload=341968]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.562559221s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [.X.......XX....XX....................X......X........X......] duration:
6.38792474s
FAIL (2025-08-22 10:09:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 10:06:12.981507495 (328h40m7.412587626s) [upload=341946]: Starting upload Aug 22 10:06:12.981554294 (328h40m7.412634415s) [upload=341946]: Done starting upload Aug 22 10:06:12.981665647 (328h40m7.412745778s) [upload=341946]: Uploading segments... Aug 22 10:06:12.981724650 (328h40m7.412804781s) [upload=341946]: Got next segment. Inline: false Aug 22 10:06:12.981749076 (328h40m7.412829207s) [upload=341946]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 10:06:12.981753836 (328h40m7.412833967s) [upload=341946]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 10:06:13.216703010 (328h40m7.647783142s) [upload=341946]: Next segment err: metaclient: Too Many Requests Aug 22 10:06:13.216728780 (328h40m7.647808911s) [upload=341946]: Done uploading segments... Aug 22 10:06:13.216742416 (328h40m7.647822547s) [upload=341946]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.387948536s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [..X.......XX....XX....................X......X........X.....] duration:
5.688231295s
FAIL (2025-08-22 10:08:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 10:06:12.981507495 (328h40m7.412587626s) [upload=341946]: Starting upload Aug 22 10:06:12.981554294 (328h40m7.412634415s) [upload=341946]: Done starting upload Aug 22 10:06:12.981665647 (328h40m7.412745778s) [upload=341946]: Uploading segments... Aug 22 10:06:12.981724650 (328h40m7.412804781s) [upload=341946]: Got next segment. Inline: false Aug 22 10:06:12.981749076 (328h40m7.412829207s) [upload=341946]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 10:06:12.981753836 (328h40m7.412833967s) [upload=341946]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 10:06:13.216703010 (328h40m7.647783142s) [upload=341946]: Next segment err: metaclient: Too Many Requests Aug 22 10:06:13.216728780 (328h40m7.647808911s) [upload=341946]: Done uploading segments... Aug 22 10:06:13.216742416 (328h40m7.647822547s) [upload=341946]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.688260792s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
1.84083845s
FAIL (2025-08-22 10:08:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 10:07:40.474452249 (328h41m34.90553237s) [upload=341968]: Starting upload Aug 22 10:07:40.474498527 (328h41m34.905578648s) [upload=341968]: Done starting upload Aug 22 10:07:40.474599440 (328h41m34.905679571s) [upload=341968]: Uploading segments... Aug 22 10:07:40.474634637 (328h41m34.905714768s) [upload=341968]: Got next segment. Inline: true Aug 22 10:07:40.474639096 (328h41m34.905719227s) [upload=341968]: Waiting for error group managing segments... Aug 22 10:07:40.474670787 (328h41m34.905750908s) [upload=341968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 10:07:40.474674604 (328h41m34.905754725s) [upload=341968]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 10:07:40.474677069 (328h41m34.9057572s) [upload=341968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 10:07:40.692455428 (328h41m35.123535559s) [upload=341968]: Done uploading segments... Aug 22 10:07:40.692473723 (328h41m35.123553854s) [upload=341968]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.840877354s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [...X.......XX....XX....................X......X........X....] duration:
5.753998093s
FAIL (2025-08-22 10:08:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 10:06:12.981507495 (328h40m7.412587626s) [upload=341946]: Starting upload Aug 22 10:06:12.981554294 (328h40m7.412634415s) [upload=341946]: Done starting upload Aug 22 10:06:12.981665647 (328h40m7.412745778s) [upload=341946]: Uploading segments... Aug 22 10:06:12.981724650 (328h40m7.412804781s) [upload=341946]: Got next segment. Inline: false Aug 22 10:06:12.981749076 (328h40m7.412829207s) [upload=341946]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 10:06:12.981753836 (328h40m7.412833967s) [upload=341946]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 10:06:13.216703010 (328h40m7.647783142s) [upload=341946]: Next segment err: metaclient: Too Many Requests Aug 22 10:06:13.216728780 (328h40m7.647808911s) [upload=341946]: Done uploading segments... Aug 22 10:06:13.216742416 (328h40m7.647822547s) [upload=341946]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.754034864s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [....X.......XX....XX....................X......X........X...] duration:
5.673147435s
FAIL (2025-08-22 10:08:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 10:06:12.981507495 (328h40m7.412587626s) [upload=341946]: Starting upload Aug 22 10:06:12.981554294 (328h40m7.412634415s) [upload=341946]: Done starting upload Aug 22 10:06:12.981665647 (328h40m7.412745778s) [upload=341946]: Uploading segments... Aug 22 10:06:12.981724650 (328h40m7.412804781s) [upload=341946]: Got next segment. Inline: false Aug 22 10:06:12.981749076 (328h40m7.412829207s) [upload=341946]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 10:06:12.981753836 (328h40m7.412833967s) [upload=341946]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 10:06:13.216703010 (328h40m7.647783142s) [upload=341946]: Next segment err: metaclient: Too Many Requests Aug 22 10:06:13.216728780 (328h40m7.647808911s) [upload=341946]: Done uploading segments... Aug 22 10:06:13.216742416 (328h40m7.647822547s) [upload=341946]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.673176783s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
865.157767ms
FAIL (2025-08-22 10:07:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 10:07:40.474452249 (328h41m34.90553237s) [upload=341968]: Starting upload Aug 22 10:07:40.474498527 (328h41m34.905578648s) [upload=341968]: Done starting upload Aug 22 10:07:40.474599440 (328h41m34.905679571s) [upload=341968]: Uploading segments... Aug 22 10:07:40.474634637 (328h41m34.905714768s) [upload=341968]: Got next segment. Inline: true Aug 22 10:07:40.474639096 (328h41m34.905719227s) [upload=341968]: Waiting for error group managing segments... Aug 22 10:07:40.474670787 (328h41m34.905750908s) [upload=341968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 10:07:40.474674604 (328h41m34.905754725s) [upload=341968]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 10:07:40.474677069 (328h41m34.9057572s) [upload=341968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 10:07:40.692455428 (328h41m35.123535559s) [upload=341968]: Done uploading segments... Aug 22 10:07:40.692473723 (328h41m35.123553854s) [upload=341968]: Upload finished. err: metaclient: Too Many Requests
Duration: 865.181161ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [.....X.......XX....XX....................X......X........X..] duration:
5.64318268s
FAIL (2025-08-22 10:07:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 10:06:12.981507495 (328h40m7.412587626s) [upload=341946]: Starting upload Aug 22 10:06:12.981554294 (328h40m7.412634415s) [upload=341946]: Done starting upload Aug 22 10:06:12.981665647 (328h40m7.412745778s) [upload=341946]: Uploading segments... Aug 22 10:06:12.981724650 (328h40m7.412804781s) [upload=341946]: Got next segment. Inline: false Aug 22 10:06:12.981749076 (328h40m7.412829207s) [upload=341946]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 10:06:12.981753836 (328h40m7.412833967s) [upload=341946]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 10:06:13.216703010 (328h40m7.647783142s) [upload=341946]: Next segment err: metaclient: Too Many Requests Aug 22 10:06:13.216728780 (328h40m7.647808911s) [upload=341946]: Done uploading segments... Aug 22 10:06:13.216742416 (328h40m7.647822547s) [upload=341946]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.643207929s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [......X.......XX....XX....................X......X........X.] duration:
5.636824552s
FAIL (2025-08-22 10:06:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 10:06:12.981507495 (328h40m7.412587626s) [upload=341946]: Starting upload Aug 22 10:06:12.981554294 (328h40m7.412634415s) [upload=341946]: Done starting upload Aug 22 10:06:12.981665647 (328h40m7.412745778s) [upload=341946]: Uploading segments... Aug 22 10:06:12.981724650 (328h40m7.412804781s) [upload=341946]: Got next segment. Inline: false Aug 22 10:06:12.981749076 (328h40m7.412829207s) [upload=341946]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 10:06:12.981753836 (328h40m7.412833967s) [upload=341946]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 10:06:13.216703010 (328h40m7.647783142s) [upload=341946]: Next segment err: metaclient: Too Many Requests Aug 22 10:06:13.216728780 (328h40m7.647808911s) [upload=341946]: Done uploading segments... Aug 22 10:06:13.216742416 (328h40m7.647822547s) [upload=341946]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.636853357s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [.......X.......XX....XX....................X......X........X] duration:
955.032644ms
FAIL (2025-08-22 10:06:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 10:06:12.981507495 (328h40m7.412587626s) [upload=341946]: Starting upload Aug 22 10:06:12.981554294 (328h40m7.412634415s) [upload=341946]: Done starting upload Aug 22 10:06:12.981665647 (328h40m7.412745778s) [upload=341946]: Uploading segments... Aug 22 10:06:12.981724650 (328h40m7.412804781s) [upload=341946]: Got next segment. Inline: false Aug 22 10:06:12.981749076 (328h40m7.412829207s) [upload=341946]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 10:06:12.981753836 (328h40m7.412833967s) [upload=341946]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 10:06:13.216703010 (328h40m7.647783142s) [upload=341946]: Next segment err: metaclient: Too Many Requests Aug 22 10:06:13.216728780 (328h40m7.647808911s) [upload=341946]: Done uploading segments... Aug 22 10:06:13.216742416 (328h40m7.647822547s) [upload=341946]: Upload finished. err: metaclient: Too Many Requests
Duration: 955.052993ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [........X.......XX....XX....................X......X........] duration:
6.229393283s
FAIL (2025-08-22 10:05:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 09:59:37.782963277 (328h33m32.214043408s) [upload=341832]: Starting upload
Aug 22 09:59:37.783007813 (328h33m32.214087944s) [upload=341832]: Done starting upload
Aug 22 09:59:37.783061806 (328h33m32.214141977s) [upload=341832]: Uploading segments...
Aug 22 09:59:37.783224787 (328h33m32.214304958s) [upload=341832]: Got next segment. Inline: false
Aug 22 09:59:37.783268150 (328h33m32.214348311s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 09:59:37.783275464 (328h33m32.214355615s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 09:59:38.240964951 (328h33m32.672045082s) [seg_pos={0 0}, upload=341832]: Begin upload segment...
Aug 22 09:59:38.241009456 (328h33m32.672089587s) [seg_pos={0 0}, upload=341832]: Done begin upload segment.
Aug 22 09:59:38.241029343 (328h33m32.672109475s) [noise=true , address=77.90.31.17:4796 , piece_id=M3J6EQF2VNHIXBXLA66EHLI6DAWLS6XWGWYU2ZBNQ6JJEUT5LV7Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241402378 (328h33m32.672482509s) [noise=true , address=79.127.220.97:4380 , piece_id=YKEYMZTK2CL4Y6IXGGSC6CF4PLJDKTV2FJKRM73GHA4TF4YCCU3A, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241680179 (328h33m32.67276031s) [noise=true , address=45.91.116.8:4070 , piece_id=C7UA2C3NXCHXYGZHOWAXC3ENRHFZYEETDKXMRZL634S4Z3LDRRLQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241899078 (328h33m32.672979209s) [noise=true , address=104.36.82.20:4466 , piece_id=5VPP4FMSQDZB3TMY3PGRGPTU35SQLMQ65NKLUKPOEWQDGENQQUGQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242047983 (328h33m32.673128114s) [noise=true , address=79.127.201.215:4343 , piece_id=LMBWV3HCHNHVIDYKYCZC4NRWAKIVXNCKIDZO6SXSVSKOV4YIVEFQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242292681 (328h33m32.673372812s) [noise=true , address=104.36.82.5:4861 , piece_id=N2IJP72CKHNZ6TUPQDTIX7S6HZ6WENUMDV2QJHPPQH3NELQGZLVQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242311848 (328h33m32.673391979s) [noise=true , address=156.146.43.225:4462 , piece_id=X6RFMZOADX7R2AV4SWS2Z4RL6LJMFOTHXPDOWHAQTR3DFULR25FA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242645095 (328h33m32.673725226s) [noise=true , address=79.127.201.215:4360 , piece_id=5FYTI3AVMQMLV3RKCJUZSOJSBRERFKFQCSLGDWVFSC6SD2MDLEZQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242989064 (328h33m32.674069195s) [noise=true , address=45.91.116.14:4201 , piece_id=ZATGC3X33Q4YHVYUTQI5WXE6TVIJC45FCVRTRR3EWKQTAIKS4XOA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.243815024 (328h33m32.674895165s) [noise=true , address=104.36.82.60:4338 , piece_id=52WHALM2SWKRPSRZ3LS7O3JLGMNUVLGXKKLVSWJMPCHV626M647Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.244837590 (328h33m32.675917721s) [noise=true , address=104.36.82.60:4341 , piece_id=R2IPTYO4ODUHMTPVRYIBROQOKZPX2LNGORZXDOBDMGW4P63G5BTA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.245890526 (328h33m32.676970667s) [noise=true , address=45.91.116.6:4987 , piece_id=VOPVVMRP7RANM45Q2W3SEJ36DGYH6RMF4GBEMAJWL34YJDWNBWKA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.246848599 (328h33m32.67792873s) [noise=true , address=77.90.31.10:4537 , piece_id=YMLJM4BAADMVD673EFTRVNAISZ7ENB4XGPHYVZ4QHCOUVYDSQKKA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.247190322 (328h33m32.678270463s) [noise=true , address=77.90.31.16:4760 , piece_id=WC6AWJ4WHMOUSRZ5FJ6VKCEXECITC2GSN3D3RALGIWIE5MVTVRCA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.247521285 (328h33m32.678601416s) [noise=true , address=77.90.31.19:4874 , piece_id=IGHDAJUCE3JC2OWUWA66ZBMIXWXCEO5C3MEOSDSQRRALFBYHTVIA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.248336465 (328h33m32.679416596s) [noise=true , address=77.90.31.11:4586 , piece_id=BAOO6BSMYX5TXUPNFRCF2WAY3SO5KJHQYH2K7EXJFNMQN4VMZANQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.248677437 (328h33m32.679757568s) [noise=true , address=79.127.219.48:4100 , piece_id=H4N76KVSPS77HI67GUPIFESBGPIY6EA7R7VUFEFINXIEROVQJR7Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.249002830 (328h33m32.680082971s) [noise=true , address=104.36.82.23:4477 , piece_id=BD6FDZWETY23OOJ25WLYLOXRTGRQQEQHF5ZUJCJMQ57CL6KIT3LA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:39.718404119 (328h33m34.14948425s) [upload=341832]: Next returned nil segment
Aug 22 09:59:39.718420792 (328h33m34.149500923s) [upload=341832]: Waiting for error group managing segments...
Aug 22 09:59:40.096294193 (328h33m34.527374324s) [noise=true , address=79.127.220.97:4380 , piece_id=YKEYMZTK2CL4Y6IXGGSC6CF4PLJDKTV2FJKRM73GHA4TF4YCCU3A, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.131042899 (328h33m34.56212303s) [noise=true , address=45.91.116.8:4070 , piece_id=C7UA2C3NXCHXYGZHOWAXC3ENRHFZYEETDKXMRZL634S4Z3LDRRLQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.144056448 (328h33m34.57513658s) [noise=true , address=45.91.116.14:4201 , piece_id=ZATGC3X33Q4YHVYUTQI5WXE6TVIJC45FCVRTRR3EWKQTAIKS4XOA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.151789104 (328h33m34.582869225s) [noise=true , address=77.90.31.16:4760 , piece_id=WC6AWJ4WHMOUSRZ5FJ6VKCEXECITC2GSN3D3RALGIWIE5MVTVRCA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.155470147 (328h33m34.586550278s) [noise=true , address=77.90.31.10:4537 , piece_id=YMLJM4BAADMVD673EFTRVNAISZ7ENB4XGPHYVZ4QHCOUVYDSQKKA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.169676989 (328h33m34.600757111s) [noise=true , address=104.36.82.5:4861 , piece_id=N2IJP72CKHNZ6TUPQDTIX7S6HZ6WENUMDV2QJHPPQH3NELQGZLVQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.180703618 (328h33m34.611783749s) [noise=true , address=77.90.31.19:4874 , piece_id=IGHDAJUCE3JC2OWUWA66ZBMIXWXCEO5C3MEOSDSQRRALFBYHTVIA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.186268576 (328h33m34.617348757s) [noise=true , address=104.36.82.20:4466 , piece_id=5VPP4FMSQDZB3TMY3PGRGPTU35SQLMQ65NKLUKPOEWQDGENQQUGQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.187789345 (328h33m34.618869476s) [noise=true , address=79.127.219.48:4100 , piece_id=H4N76KVSPS77HI67GUPIFESBGPIY6EA7R7VUFEFINXIEROVQJR7Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.206730106 (328h33m34.637810227s) [noise=true , address=45.91.116.6:4987 , piece_id=VOPVVMRP7RANM45Q2W3SEJ36DGYH6RMF4GBEMAJWL34YJDWNBWKA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.209965165 (328h33m34.641045286s) [noise=true , address=156.146.43.225:4462 , piece_id=X6RFMZOADX7R2AV4SWS2Z4RL6LJMFOTHXPDOWHAQTR3DFULR25FA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.241178888 (328h33m34.672259019s) [noise=true , address=79.127.201.215:4343 , piece_id=LMBWV3HCHNHVIDYKYCZC4NRWAKIVXNCKIDZO6SXSVSKOV4YIVEFQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.272542788 (328h33m34.703622919s) [noise=true , address=104.36.82.60:4338 , piece_id=52WHALM2SWKRPSRZ3LS7O3JLGMNUVLGXKKLVSWJMPCHV626M647Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.290310062 (328h33m34.721390194s) [noise=true , address=77.90.31.17:4796 , piece_id=M3J6EQF2VNHIXBXLA66EHLI6DAWLS6XWGWYU2ZBNQ6JJEUT5LV7Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.290335702 (328h33m34.721415833s) [seg_pos={0 0}, upload=341832]: Segment reached optimal threshold of 14 pieces.
Aug 22 09:59:40.290449419 (328h33m34.72152955s) [noise=true , address=104.36.82.23:4477 , piece_id=BD6FDZWETY23OOJ25WLYLOXRTGRQQEQHF5ZUJCJMQ57CL6KIT3LA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290525565 (328h33m34.721605696s) [noise=true , address=104.36.82.60:4341 , piece_id=R2IPTYO4ODUHMTPVRYIBROQOKZPX2LNGORZXDOBDMGW4P63G5BTA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okrDyM4TfzYN3p8zUjTqbw2661rKQQqZdP1ptAKzzTQ82C7cN): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290567735 (328h33m34.721647866s) [noise=true , address=79.127.201.215:4360 , piece_id=5FYTI3AVMQMLV3RKCJUZSOJSBRERFKFQCSLGDWVFSC6SD2MDLEZQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290607662 (328h33m34.721687803s) [noise=true , address=77.90.31.11:4586 , piece_id=BAOO6BSMYX5TXUPNFRCF2WAY3SO5KJHQYH2K7EXJFNMQN4VMZANQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cp4U45mdzouvz4Gq1YPQ1EzuHttggJnXNepr1ai218HqkxeF2): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290631077 (328h33m34.721711198s) [seg_pos={0 0}, upload=341832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 09:59:40.290714627 (328h33m34.721794758s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 09:59:40.290718835 (328h33m34.721798966s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 09:59:40.620798512 (328h33m35.051878633s) [upload=341832]: Done uploading segments...
Aug 22 09:59:40.620819331 (328h33m35.051899452s) [upload=341832]: Upload finished. err: <nil>
Duration: 6.229489245s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.........X.......XX....XX....................X......X.......] duration:
5.617021172s
FAIL (2025-08-22 10:04:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 09:59:37.782963277 (328h33m32.214043408s) [upload=341832]: Starting upload
Aug 22 09:59:37.783007813 (328h33m32.214087944s) [upload=341832]: Done starting upload
Aug 22 09:59:37.783061806 (328h33m32.214141977s) [upload=341832]: Uploading segments...
Aug 22 09:59:37.783224787 (328h33m32.214304958s) [upload=341832]: Got next segment. Inline: false
Aug 22 09:59:37.783268150 (328h33m32.214348311s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 09:59:37.783275464 (328h33m32.214355615s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 09:59:38.240964951 (328h33m32.672045082s) [seg_pos={0 0}, upload=341832]: Begin upload segment...
Aug 22 09:59:38.241009456 (328h33m32.672089587s) [seg_pos={0 0}, upload=341832]: Done begin upload segment.
Aug 22 09:59:38.241029343 (328h33m32.672109475s) [noise=true , address=77.90.31.17:4796 , piece_id=M3J6EQF2VNHIXBXLA66EHLI6DAWLS6XWGWYU2ZBNQ6JJEUT5LV7Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241402378 (328h33m32.672482509s) [noise=true , address=79.127.220.97:4380 , piece_id=YKEYMZTK2CL4Y6IXGGSC6CF4PLJDKTV2FJKRM73GHA4TF4YCCU3A, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241680179 (328h33m32.67276031s) [noise=true , address=45.91.116.8:4070 , piece_id=C7UA2C3NXCHXYGZHOWAXC3ENRHFZYEETDKXMRZL634S4Z3LDRRLQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241899078 (328h33m32.672979209s) [noise=true , address=104.36.82.20:4466 , piece_id=5VPP4FMSQDZB3TMY3PGRGPTU35SQLMQ65NKLUKPOEWQDGENQQUGQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242047983 (328h33m32.673128114s) [noise=true , address=79.127.201.215:4343 , piece_id=LMBWV3HCHNHVIDYKYCZC4NRWAKIVXNCKIDZO6SXSVSKOV4YIVEFQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242292681 (328h33m32.673372812s) [noise=true , address=104.36.82.5:4861 , piece_id=N2IJP72CKHNZ6TUPQDTIX7S6HZ6WENUMDV2QJHPPQH3NELQGZLVQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242311848 (328h33m32.673391979s) [noise=true , address=156.146.43.225:4462 , piece_id=X6RFMZOADX7R2AV4SWS2Z4RL6LJMFOTHXPDOWHAQTR3DFULR25FA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242645095 (328h33m32.673725226s) [noise=true , address=79.127.201.215:4360 , piece_id=5FYTI3AVMQMLV3RKCJUZSOJSBRERFKFQCSLGDWVFSC6SD2MDLEZQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242989064 (328h33m32.674069195s) [noise=true , address=45.91.116.14:4201 , piece_id=ZATGC3X33Q4YHVYUTQI5WXE6TVIJC45FCVRTRR3EWKQTAIKS4XOA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.243815024 (328h33m32.674895165s) [noise=true , address=104.36.82.60:4338 , piece_id=52WHALM2SWKRPSRZ3LS7O3JLGMNUVLGXKKLVSWJMPCHV626M647Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.244837590 (328h33m32.675917721s) [noise=true , address=104.36.82.60:4341 , piece_id=R2IPTYO4ODUHMTPVRYIBROQOKZPX2LNGORZXDOBDMGW4P63G5BTA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.245890526 (328h33m32.676970667s) [noise=true , address=45.91.116.6:4987 , piece_id=VOPVVMRP7RANM45Q2W3SEJ36DGYH6RMF4GBEMAJWL34YJDWNBWKA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.246848599 (328h33m32.67792873s) [noise=true , address=77.90.31.10:4537 , piece_id=YMLJM4BAADMVD673EFTRVNAISZ7ENB4XGPHYVZ4QHCOUVYDSQKKA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.247190322 (328h33m32.678270463s) [noise=true , address=77.90.31.16:4760 , piece_id=WC6AWJ4WHMOUSRZ5FJ6VKCEXECITC2GSN3D3RALGIWIE5MVTVRCA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.247521285 (328h33m32.678601416s) [noise=true , address=77.90.31.19:4874 , piece_id=IGHDAJUCE3JC2OWUWA66ZBMIXWXCEO5C3MEOSDSQRRALFBYHTVIA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.248336465 (328h33m32.679416596s) [noise=true , address=77.90.31.11:4586 , piece_id=BAOO6BSMYX5TXUPNFRCF2WAY3SO5KJHQYH2K7EXJFNMQN4VMZANQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.248677437 (328h33m32.679757568s) [noise=true , address=79.127.219.48:4100 , piece_id=H4N76KVSPS77HI67GUPIFESBGPIY6EA7R7VUFEFINXIEROVQJR7Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.249002830 (328h33m32.680082971s) [noise=true , address=104.36.82.23:4477 , piece_id=BD6FDZWETY23OOJ25WLYLOXRTGRQQEQHF5ZUJCJMQ57CL6KIT3LA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:39.718404119 (328h33m34.14948425s) [upload=341832]: Next returned nil segment
Aug 22 09:59:39.718420792 (328h33m34.149500923s) [upload=341832]: Waiting for error group managing segments...
Aug 22 09:59:40.096294193 (328h33m34.527374324s) [noise=true , address=79.127.220.97:4380 , piece_id=YKEYMZTK2CL4Y6IXGGSC6CF4PLJDKTV2FJKRM73GHA4TF4YCCU3A, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.131042899 (328h33m34.56212303s) [noise=true , address=45.91.116.8:4070 , piece_id=C7UA2C3NXCHXYGZHOWAXC3ENRHFZYEETDKXMRZL634S4Z3LDRRLQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.144056448 (328h33m34.57513658s) [noise=true , address=45.91.116.14:4201 , piece_id=ZATGC3X33Q4YHVYUTQI5WXE6TVIJC45FCVRTRR3EWKQTAIKS4XOA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.151789104 (328h33m34.582869225s) [noise=true , address=77.90.31.16:4760 , piece_id=WC6AWJ4WHMOUSRZ5FJ6VKCEXECITC2GSN3D3RALGIWIE5MVTVRCA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.155470147 (328h33m34.586550278s) [noise=true , address=77.90.31.10:4537 , piece_id=YMLJM4BAADMVD673EFTRVNAISZ7ENB4XGPHYVZ4QHCOUVYDSQKKA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.169676989 (328h33m34.600757111s) [noise=true , address=104.36.82.5:4861 , piece_id=N2IJP72CKHNZ6TUPQDTIX7S6HZ6WENUMDV2QJHPPQH3NELQGZLVQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.180703618 (328h33m34.611783749s) [noise=true , address=77.90.31.19:4874 , piece_id=IGHDAJUCE3JC2OWUWA66ZBMIXWXCEO5C3MEOSDSQRRALFBYHTVIA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.186268576 (328h33m34.617348757s) [noise=true , address=104.36.82.20:4466 , piece_id=5VPP4FMSQDZB3TMY3PGRGPTU35SQLMQ65NKLUKPOEWQDGENQQUGQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.187789345 (328h33m34.618869476s) [noise=true , address=79.127.219.48:4100 , piece_id=H4N76KVSPS77HI67GUPIFESBGPIY6EA7R7VUFEFINXIEROVQJR7Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.206730106 (328h33m34.637810227s) [noise=true , address=45.91.116.6:4987 , piece_id=VOPVVMRP7RANM45Q2W3SEJ36DGYH6RMF4GBEMAJWL34YJDWNBWKA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.209965165 (328h33m34.641045286s) [noise=true , address=156.146.43.225:4462 , piece_id=X6RFMZOADX7R2AV4SWS2Z4RL6LJMFOTHXPDOWHAQTR3DFULR25FA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.241178888 (328h33m34.672259019s) [noise=true , address=79.127.201.215:4343 , piece_id=LMBWV3HCHNHVIDYKYCZC4NRWAKIVXNCKIDZO6SXSVSKOV4YIVEFQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.272542788 (328h33m34.703622919s) [noise=true , address=104.36.82.60:4338 , piece_id=52WHALM2SWKRPSRZ3LS7O3JLGMNUVLGXKKLVSWJMPCHV626M647Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.290310062 (328h33m34.721390194s) [noise=true , address=77.90.31.17:4796 , piece_id=M3J6EQF2VNHIXBXLA66EHLI6DAWLS6XWGWYU2ZBNQ6JJEUT5LV7Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.290335702 (328h33m34.721415833s) [seg_pos={0 0}, upload=341832]: Segment reached optimal threshold of 14 pieces.
Aug 22 09:59:40.290449419 (328h33m34.72152955s) [noise=true , address=104.36.82.23:4477 , piece_id=BD6FDZWETY23OOJ25WLYLOXRTGRQQEQHF5ZUJCJMQ57CL6KIT3LA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290525565 (328h33m34.721605696s) [noise=true , address=104.36.82.60:4341 , piece_id=R2IPTYO4ODUHMTPVRYIBROQOKZPX2LNGORZXDOBDMGW4P63G5BTA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okrDyM4TfzYN3p8zUjTqbw2661rKQQqZdP1ptAKzzTQ82C7cN): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290567735 (328h33m34.721647866s) [noise=true , address=79.127.201.215:4360 , piece_id=5FYTI3AVMQMLV3RKCJUZSOJSBRERFKFQCSLGDWVFSC6SD2MDLEZQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290607662 (328h33m34.721687803s) [noise=true , address=77.90.31.11:4586 , piece_id=BAOO6BSMYX5TXUPNFRCF2WAY3SO5KJHQYH2K7EXJFNMQN4VMZANQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cp4U45mdzouvz4Gq1YPQ1EzuHttggJnXNepr1ai218HqkxeF2): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290631077 (328h33m34.721711198s) [seg_pos={0 0}, upload=341832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 09:59:40.290714627 (328h33m34.721794758s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 09:59:40.290718835 (328h33m34.721798966s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 09:59:40.620798512 (328h33m35.051878633s) [upload=341832]: Done uploading segments...
Aug 22 09:59:40.620819331 (328h33m35.051899452s) [upload=341832]: Upload finished. err: <nil>
Duration: 5.617048866s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [X.........X.......XX....XX....................X......X......] duration:
6.047600328s
FAIL (2025-08-22 10:04:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 09:59:37.782963277 (328h33m32.214043408s) [upload=341832]: Starting upload
Aug 22 09:59:37.783007813 (328h33m32.214087944s) [upload=341832]: Done starting upload
Aug 22 09:59:37.783061806 (328h33m32.214141977s) [upload=341832]: Uploading segments...
Aug 22 09:59:37.783224787 (328h33m32.214304958s) [upload=341832]: Got next segment. Inline: false
Aug 22 09:59:37.783268150 (328h33m32.214348311s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 09:59:37.783275464 (328h33m32.214355615s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 09:59:38.240964951 (328h33m32.672045082s) [seg_pos={0 0}, upload=341832]: Begin upload segment...
Aug 22 09:59:38.241009456 (328h33m32.672089587s) [seg_pos={0 0}, upload=341832]: Done begin upload segment.
Aug 22 09:59:38.241029343 (328h33m32.672109475s) [noise=true , address=77.90.31.17:4796 , piece_id=M3J6EQF2VNHIXBXLA66EHLI6DAWLS6XWGWYU2ZBNQ6JJEUT5LV7Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241402378 (328h33m32.672482509s) [noise=true , address=79.127.220.97:4380 , piece_id=YKEYMZTK2CL4Y6IXGGSC6CF4PLJDKTV2FJKRM73GHA4TF4YCCU3A, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241680179 (328h33m32.67276031s) [noise=true , address=45.91.116.8:4070 , piece_id=C7UA2C3NXCHXYGZHOWAXC3ENRHFZYEETDKXMRZL634S4Z3LDRRLQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241899078 (328h33m32.672979209s) [noise=true , address=104.36.82.20:4466 , piece_id=5VPP4FMSQDZB3TMY3PGRGPTU35SQLMQ65NKLUKPOEWQDGENQQUGQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242047983 (328h33m32.673128114s) [noise=true , address=79.127.201.215:4343 , piece_id=LMBWV3HCHNHVIDYKYCZC4NRWAKIVXNCKIDZO6SXSVSKOV4YIVEFQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242292681 (328h33m32.673372812s) [noise=true , address=104.36.82.5:4861 , piece_id=N2IJP72CKHNZ6TUPQDTIX7S6HZ6WENUMDV2QJHPPQH3NELQGZLVQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242311848 (328h33m32.673391979s) [noise=true , address=156.146.43.225:4462 , piece_id=X6RFMZOADX7R2AV4SWS2Z4RL6LJMFOTHXPDOWHAQTR3DFULR25FA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242645095 (328h33m32.673725226s) [noise=true , address=79.127.201.215:4360 , piece_id=5FYTI3AVMQMLV3RKCJUZSOJSBRERFKFQCSLGDWVFSC6SD2MDLEZQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242989064 (328h33m32.674069195s) [noise=true , address=45.91.116.14:4201 , piece_id=ZATGC3X33Q4YHVYUTQI5WXE6TVIJC45FCVRTRR3EWKQTAIKS4XOA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.243815024 (328h33m32.674895165s) [noise=true , address=104.36.82.60:4338 , piece_id=52WHALM2SWKRPSRZ3LS7O3JLGMNUVLGXKKLVSWJMPCHV626M647Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.244837590 (328h33m32.675917721s) [noise=true , address=104.36.82.60:4341 , piece_id=R2IPTYO4ODUHMTPVRYIBROQOKZPX2LNGORZXDOBDMGW4P63G5BTA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.245890526 (328h33m32.676970667s) [noise=true , address=45.91.116.6:4987 , piece_id=VOPVVMRP7RANM45Q2W3SEJ36DGYH6RMF4GBEMAJWL34YJDWNBWKA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.246848599 (328h33m32.67792873s) [noise=true , address=77.90.31.10:4537 , piece_id=YMLJM4BAADMVD673EFTRVNAISZ7ENB4XGPHYVZ4QHCOUVYDSQKKA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.247190322 (328h33m32.678270463s) [noise=true , address=77.90.31.16:4760 , piece_id=WC6AWJ4WHMOUSRZ5FJ6VKCEXECITC2GSN3D3RALGIWIE5MVTVRCA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.247521285 (328h33m32.678601416s) [noise=true , address=77.90.31.19:4874 , piece_id=IGHDAJUCE3JC2OWUWA66ZBMIXWXCEO5C3MEOSDSQRRALFBYHTVIA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.248336465 (328h33m32.679416596s) [noise=true , address=77.90.31.11:4586 , piece_id=BAOO6BSMYX5TXUPNFRCF2WAY3SO5KJHQYH2K7EXJFNMQN4VMZANQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.248677437 (328h33m32.679757568s) [noise=true , address=79.127.219.48:4100 , piece_id=H4N76KVSPS77HI67GUPIFESBGPIY6EA7R7VUFEFINXIEROVQJR7Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.249002830 (328h33m32.680082971s) [noise=true , address=104.36.82.23:4477 , piece_id=BD6FDZWETY23OOJ25WLYLOXRTGRQQEQHF5ZUJCJMQ57CL6KIT3LA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:39.718404119 (328h33m34.14948425s) [upload=341832]: Next returned nil segment
Aug 22 09:59:39.718420792 (328h33m34.149500923s) [upload=341832]: Waiting for error group managing segments...
Aug 22 09:59:40.096294193 (328h33m34.527374324s) [noise=true , address=79.127.220.97:4380 , piece_id=YKEYMZTK2CL4Y6IXGGSC6CF4PLJDKTV2FJKRM73GHA4TF4YCCU3A, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.131042899 (328h33m34.56212303s) [noise=true , address=45.91.116.8:4070 , piece_id=C7UA2C3NXCHXYGZHOWAXC3ENRHFZYEETDKXMRZL634S4Z3LDRRLQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.144056448 (328h33m34.57513658s) [noise=true , address=45.91.116.14:4201 , piece_id=ZATGC3X33Q4YHVYUTQI5WXE6TVIJC45FCVRTRR3EWKQTAIKS4XOA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.151789104 (328h33m34.582869225s) [noise=true , address=77.90.31.16:4760 , piece_id=WC6AWJ4WHMOUSRZ5FJ6VKCEXECITC2GSN3D3RALGIWIE5MVTVRCA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.155470147 (328h33m34.586550278s) [noise=true , address=77.90.31.10:4537 , piece_id=YMLJM4BAADMVD673EFTRVNAISZ7ENB4XGPHYVZ4QHCOUVYDSQKKA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.169676989 (328h33m34.600757111s) [noise=true , address=104.36.82.5:4861 , piece_id=N2IJP72CKHNZ6TUPQDTIX7S6HZ6WENUMDV2QJHPPQH3NELQGZLVQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.180703618 (328h33m34.611783749s) [noise=true , address=77.90.31.19:4874 , piece_id=IGHDAJUCE3JC2OWUWA66ZBMIXWXCEO5C3MEOSDSQRRALFBYHTVIA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.186268576 (328h33m34.617348757s) [noise=true , address=104.36.82.20:4466 , piece_id=5VPP4FMSQDZB3TMY3PGRGPTU35SQLMQ65NKLUKPOEWQDGENQQUGQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.187789345 (328h33m34.618869476s) [noise=true , address=79.127.219.48:4100 , piece_id=H4N76KVSPS77HI67GUPIFESBGPIY6EA7R7VUFEFINXIEROVQJR7Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.206730106 (328h33m34.637810227s) [noise=true , address=45.91.116.6:4987 , piece_id=VOPVVMRP7RANM45Q2W3SEJ36DGYH6RMF4GBEMAJWL34YJDWNBWKA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.209965165 (328h33m34.641045286s) [noise=true , address=156.146.43.225:4462 , piece_id=X6RFMZOADX7R2AV4SWS2Z4RL6LJMFOTHXPDOWHAQTR3DFULR25FA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.241178888 (328h33m34.672259019s) [noise=true , address=79.127.201.215:4343 , piece_id=LMBWV3HCHNHVIDYKYCZC4NRWAKIVXNCKIDZO6SXSVSKOV4YIVEFQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.272542788 (328h33m34.703622919s) [noise=true , address=104.36.82.60:4338 , piece_id=52WHALM2SWKRPSRZ3LS7O3JLGMNUVLGXKKLVSWJMPCHV626M647Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.290310062 (328h33m34.721390194s) [noise=true , address=77.90.31.17:4796 , piece_id=M3J6EQF2VNHIXBXLA66EHLI6DAWLS6XWGWYU2ZBNQ6JJEUT5LV7Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.290335702 (328h33m34.721415833s) [seg_pos={0 0}, upload=341832]: Segment reached optimal threshold of 14 pieces.
Aug 22 09:59:40.290449419 (328h33m34.72152955s) [noise=true , address=104.36.82.23:4477 , piece_id=BD6FDZWETY23OOJ25WLYLOXRTGRQQEQHF5ZUJCJMQ57CL6KIT3LA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290525565 (328h33m34.721605696s) [noise=true , address=104.36.82.60:4341 , piece_id=R2IPTYO4ODUHMTPVRYIBROQOKZPX2LNGORZXDOBDMGW4P63G5BTA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okrDyM4TfzYN3p8zUjTqbw2661rKQQqZdP1ptAKzzTQ82C7cN): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290567735 (328h33m34.721647866s) [noise=true , address=79.127.201.215:4360 , piece_id=5FYTI3AVMQMLV3RKCJUZSOJSBRERFKFQCSLGDWVFSC6SD2MDLEZQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290607662 (328h33m34.721687803s) [noise=true , address=77.90.31.11:4586 , piece_id=BAOO6BSMYX5TXUPNFRCF2WAY3SO5KJHQYH2K7EXJFNMQN4VMZANQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cp4U45mdzouvz4Gq1YPQ1EzuHttggJnXNepr1ai218HqkxeF2): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290631077 (328h33m34.721711198s) [seg_pos={0 0}, upload=341832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 09:59:40.290714627 (328h33m34.721794758s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 09:59:40.290718835 (328h33m34.721798966s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 09:59:40.620798512 (328h33m35.051878633s) [upload=341832]: Done uploading segments...
Aug 22 09:59:40.620819331 (328h33m35.051899452s) [upload=341832]: Upload finished. err: <nil>
Duration: 6.047641207s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [.X.........X.......XX....XX....................X......X.....] duration:
5.885987757s
FAIL (2025-08-22 10:03:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 09:59:37.782963277 (328h33m32.214043408s) [upload=341832]: Starting upload
Aug 22 09:59:37.783007813 (328h33m32.214087944s) [upload=341832]: Done starting upload
Aug 22 09:59:37.783061806 (328h33m32.214141977s) [upload=341832]: Uploading segments...
Aug 22 09:59:37.783224787 (328h33m32.214304958s) [upload=341832]: Got next segment. Inline: false
Aug 22 09:59:37.783268150 (328h33m32.214348311s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 09:59:37.783275464 (328h33m32.214355615s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 09:59:38.240964951 (328h33m32.672045082s) [seg_pos={0 0}, upload=341832]: Begin upload segment...
Aug 22 09:59:38.241009456 (328h33m32.672089587s) [seg_pos={0 0}, upload=341832]: Done begin upload segment.
Aug 22 09:59:38.241029343 (328h33m32.672109475s) [noise=true , address=77.90.31.17:4796 , piece_id=M3J6EQF2VNHIXBXLA66EHLI6DAWLS6XWGWYU2ZBNQ6JJEUT5LV7Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241402378 (328h33m32.672482509s) [noise=true , address=79.127.220.97:4380 , piece_id=YKEYMZTK2CL4Y6IXGGSC6CF4PLJDKTV2FJKRM73GHA4TF4YCCU3A, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241680179 (328h33m32.67276031s) [noise=true , address=45.91.116.8:4070 , piece_id=C7UA2C3NXCHXYGZHOWAXC3ENRHFZYEETDKXMRZL634S4Z3LDRRLQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241899078 (328h33m32.672979209s) [noise=true , address=104.36.82.20:4466 , piece_id=5VPP4FMSQDZB3TMY3PGRGPTU35SQLMQ65NKLUKPOEWQDGENQQUGQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242047983 (328h33m32.673128114s) [noise=true , address=79.127.201.215:4343 , piece_id=LMBWV3HCHNHVIDYKYCZC4NRWAKIVXNCKIDZO6SXSVSKOV4YIVEFQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242292681 (328h33m32.673372812s) [noise=true , address=104.36.82.5:4861 , piece_id=N2IJP72CKHNZ6TUPQDTIX7S6HZ6WENUMDV2QJHPPQH3NELQGZLVQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242311848 (328h33m32.673391979s) [noise=true , address=156.146.43.225:4462 , piece_id=X6RFMZOADX7R2AV4SWS2Z4RL6LJMFOTHXPDOWHAQTR3DFULR25FA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242645095 (328h33m32.673725226s) [noise=true , address=79.127.201.215:4360 , piece_id=5FYTI3AVMQMLV3RKCJUZSOJSBRERFKFQCSLGDWVFSC6SD2MDLEZQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242989064 (328h33m32.674069195s) [noise=true , address=45.91.116.14:4201 , piece_id=ZATGC3X33Q4YHVYUTQI5WXE6TVIJC45FCVRTRR3EWKQTAIKS4XOA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.243815024 (328h33m32.674895165s) [noise=true , address=104.36.82.60:4338 , piece_id=52WHALM2SWKRPSRZ3LS7O3JLGMNUVLGXKKLVSWJMPCHV626M647Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.244837590 (328h33m32.675917721s) [noise=true , address=104.36.82.60:4341 , piece_id=R2IPTYO4ODUHMTPVRYIBROQOKZPX2LNGORZXDOBDMGW4P63G5BTA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.245890526 (328h33m32.676970667s) [noise=true , address=45.91.116.6:4987 , piece_id=VOPVVMRP7RANM45Q2W3SEJ36DGYH6RMF4GBEMAJWL34YJDWNBWKA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.246848599 (328h33m32.67792873s) [noise=true , address=77.90.31.10:4537 , piece_id=YMLJM4BAADMVD673EFTRVNAISZ7ENB4XGPHYVZ4QHCOUVYDSQKKA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.247190322 (328h33m32.678270463s) [noise=true , address=77.90.31.16:4760 , piece_id=WC6AWJ4WHMOUSRZ5FJ6VKCEXECITC2GSN3D3RALGIWIE5MVTVRCA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.247521285 (328h33m32.678601416s) [noise=true , address=77.90.31.19:4874 , piece_id=IGHDAJUCE3JC2OWUWA66ZBMIXWXCEO5C3MEOSDSQRRALFBYHTVIA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.248336465 (328h33m32.679416596s) [noise=true , address=77.90.31.11:4586 , piece_id=BAOO6BSMYX5TXUPNFRCF2WAY3SO5KJHQYH2K7EXJFNMQN4VMZANQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.248677437 (328h33m32.679757568s) [noise=true , address=79.127.219.48:4100 , piece_id=H4N76KVSPS77HI67GUPIFESBGPIY6EA7R7VUFEFINXIEROVQJR7Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.249002830 (328h33m32.680082971s) [noise=true , address=104.36.82.23:4477 , piece_id=BD6FDZWETY23OOJ25WLYLOXRTGRQQEQHF5ZUJCJMQ57CL6KIT3LA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:39.718404119 (328h33m34.14948425s) [upload=341832]: Next returned nil segment
Aug 22 09:59:39.718420792 (328h33m34.149500923s) [upload=341832]: Waiting for error group managing segments...
Aug 22 09:59:40.096294193 (328h33m34.527374324s) [noise=true , address=79.127.220.97:4380 , piece_id=YKEYMZTK2CL4Y6IXGGSC6CF4PLJDKTV2FJKRM73GHA4TF4YCCU3A, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.131042899 (328h33m34.56212303s) [noise=true , address=45.91.116.8:4070 , piece_id=C7UA2C3NXCHXYGZHOWAXC3ENRHFZYEETDKXMRZL634S4Z3LDRRLQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.144056448 (328h33m34.57513658s) [noise=true , address=45.91.116.14:4201 , piece_id=ZATGC3X33Q4YHVYUTQI5WXE6TVIJC45FCVRTRR3EWKQTAIKS4XOA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.151789104 (328h33m34.582869225s) [noise=true , address=77.90.31.16:4760 , piece_id=WC6AWJ4WHMOUSRZ5FJ6VKCEXECITC2GSN3D3RALGIWIE5MVTVRCA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.155470147 (328h33m34.586550278s) [noise=true , address=77.90.31.10:4537 , piece_id=YMLJM4BAADMVD673EFTRVNAISZ7ENB4XGPHYVZ4QHCOUVYDSQKKA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.169676989 (328h33m34.600757111s) [noise=true , address=104.36.82.5:4861 , piece_id=N2IJP72CKHNZ6TUPQDTIX7S6HZ6WENUMDV2QJHPPQH3NELQGZLVQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.180703618 (328h33m34.611783749s) [noise=true , address=77.90.31.19:4874 , piece_id=IGHDAJUCE3JC2OWUWA66ZBMIXWXCEO5C3MEOSDSQRRALFBYHTVIA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.186268576 (328h33m34.617348757s) [noise=true , address=104.36.82.20:4466 , piece_id=5VPP4FMSQDZB3TMY3PGRGPTU35SQLMQ65NKLUKPOEWQDGENQQUGQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.187789345 (328h33m34.618869476s) [noise=true , address=79.127.219.48:4100 , piece_id=H4N76KVSPS77HI67GUPIFESBGPIY6EA7R7VUFEFINXIEROVQJR7Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.206730106 (328h33m34.637810227s) [noise=true , address=45.91.116.6:4987 , piece_id=VOPVVMRP7RANM45Q2W3SEJ36DGYH6RMF4GBEMAJWL34YJDWNBWKA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.209965165 (328h33m34.641045286s) [noise=true , address=156.146.43.225:4462 , piece_id=X6RFMZOADX7R2AV4SWS2Z4RL6LJMFOTHXPDOWHAQTR3DFULR25FA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.241178888 (328h33m34.672259019s) [noise=true , address=79.127.201.215:4343 , piece_id=LMBWV3HCHNHVIDYKYCZC4NRWAKIVXNCKIDZO6SXSVSKOV4YIVEFQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.272542788 (328h33m34.703622919s) [noise=true , address=104.36.82.60:4338 , piece_id=52WHALM2SWKRPSRZ3LS7O3JLGMNUVLGXKKLVSWJMPCHV626M647Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.290310062 (328h33m34.721390194s) [noise=true , address=77.90.31.17:4796 , piece_id=M3J6EQF2VNHIXBXLA66EHLI6DAWLS6XWGWYU2ZBNQ6JJEUT5LV7Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.290335702 (328h33m34.721415833s) [seg_pos={0 0}, upload=341832]: Segment reached optimal threshold of 14 pieces.
Aug 22 09:59:40.290449419 (328h33m34.72152955s) [noise=true , address=104.36.82.23:4477 , piece_id=BD6FDZWETY23OOJ25WLYLOXRTGRQQEQHF5ZUJCJMQ57CL6KIT3LA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290525565 (328h33m34.721605696s) [noise=true , address=104.36.82.60:4341 , piece_id=R2IPTYO4ODUHMTPVRYIBROQOKZPX2LNGORZXDOBDMGW4P63G5BTA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okrDyM4TfzYN3p8zUjTqbw2661rKQQqZdP1ptAKzzTQ82C7cN): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290567735 (328h33m34.721647866s) [noise=true , address=79.127.201.215:4360 , piece_id=5FYTI3AVMQMLV3RKCJUZSOJSBRERFKFQCSLGDWVFSC6SD2MDLEZQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290607662 (328h33m34.721687803s) [noise=true , address=77.90.31.11:4586 , piece_id=BAOO6BSMYX5TXUPNFRCF2WAY3SO5KJHQYH2K7EXJFNMQN4VMZANQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cp4U45mdzouvz4Gq1YPQ1EzuHttggJnXNepr1ai218HqkxeF2): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290631077 (328h33m34.721711198s) [seg_pos={0 0}, upload=341832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 09:59:40.290714627 (328h33m34.721794758s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 09:59:40.290718835 (328h33m34.721798966s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 09:59:40.620798512 (328h33m35.051878633s) [upload=341832]: Done uploading segments...
Aug 22 09:59:40.620819331 (328h33m35.051899452s) [upload=341832]: Upload finished. err: <nil>
Duration: 5.886012502s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [..X.........X.......XX....XX....................X......X....] duration:
5.803109132s
FAIL (2025-08-22 10:02:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 09:59:37.782963277 (328h33m32.214043408s) [upload=341832]: Starting upload
Aug 22 09:59:37.783007813 (328h33m32.214087944s) [upload=341832]: Done starting upload
Aug 22 09:59:37.783061806 (328h33m32.214141977s) [upload=341832]: Uploading segments...
Aug 22 09:59:37.783224787 (328h33m32.214304958s) [upload=341832]: Got next segment. Inline: false
Aug 22 09:59:37.783268150 (328h33m32.214348311s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 09:59:37.783275464 (328h33m32.214355615s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 09:59:38.240964951 (328h33m32.672045082s) [seg_pos={0 0}, upload=341832]: Begin upload segment...
Aug 22 09:59:38.241009456 (328h33m32.672089587s) [seg_pos={0 0}, upload=341832]: Done begin upload segment.
Aug 22 09:59:38.241029343 (328h33m32.672109475s) [noise=true , address=77.90.31.17:4796 , piece_id=M3J6EQF2VNHIXBXLA66EHLI6DAWLS6XWGWYU2ZBNQ6JJEUT5LV7Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241402378 (328h33m32.672482509s) [noise=true , address=79.127.220.97:4380 , piece_id=YKEYMZTK2CL4Y6IXGGSC6CF4PLJDKTV2FJKRM73GHA4TF4YCCU3A, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241680179 (328h33m32.67276031s) [noise=true , address=45.91.116.8:4070 , piece_id=C7UA2C3NXCHXYGZHOWAXC3ENRHFZYEETDKXMRZL634S4Z3LDRRLQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241899078 (328h33m32.672979209s) [noise=true , address=104.36.82.20:4466 , piece_id=5VPP4FMSQDZB3TMY3PGRGPTU35SQLMQ65NKLUKPOEWQDGENQQUGQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242047983 (328h33m32.673128114s) [noise=true , address=79.127.201.215:4343 , piece_id=LMBWV3HCHNHVIDYKYCZC4NRWAKIVXNCKIDZO6SXSVSKOV4YIVEFQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242292681 (328h33m32.673372812s) [noise=true , address=104.36.82.5:4861 , piece_id=N2IJP72CKHNZ6TUPQDTIX7S6HZ6WENUMDV2QJHPPQH3NELQGZLVQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242311848 (328h33m32.673391979s) [noise=true , address=156.146.43.225:4462 , piece_id=X6RFMZOADX7R2AV4SWS2Z4RL6LJMFOTHXPDOWHAQTR3DFULR25FA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242645095 (328h33m32.673725226s) [noise=true , address=79.127.201.215:4360 , piece_id=5FYTI3AVMQMLV3RKCJUZSOJSBRERFKFQCSLGDWVFSC6SD2MDLEZQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242989064 (328h33m32.674069195s) [noise=true , address=45.91.116.14:4201 , piece_id=ZATGC3X33Q4YHVYUTQI5WXE6TVIJC45FCVRTRR3EWKQTAIKS4XOA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.243815024 (328h33m32.674895165s) [noise=true , address=104.36.82.60:4338 , piece_id=52WHALM2SWKRPSRZ3LS7O3JLGMNUVLGXKKLVSWJMPCHV626M647Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.244837590 (328h33m32.675917721s) [noise=true , address=104.36.82.60:4341 , piece_id=R2IPTYO4ODUHMTPVRYIBROQOKZPX2LNGORZXDOBDMGW4P63G5BTA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.245890526 (328h33m32.676970667s) [noise=true , address=45.91.116.6:4987 , piece_id=VOPVVMRP7RANM45Q2W3SEJ36DGYH6RMF4GBEMAJWL34YJDWNBWKA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.246848599 (328h33m32.67792873s) [noise=true , address=77.90.31.10:4537 , piece_id=YMLJM4BAADMVD673EFTRVNAISZ7ENB4XGPHYVZ4QHCOUVYDSQKKA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.247190322 (328h33m32.678270463s) [noise=true , address=77.90.31.16:4760 , piece_id=WC6AWJ4WHMOUSRZ5FJ6VKCEXECITC2GSN3D3RALGIWIE5MVTVRCA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.247521285 (328h33m32.678601416s) [noise=true , address=77.90.31.19:4874 , piece_id=IGHDAJUCE3JC2OWUWA66ZBMIXWXCEO5C3MEOSDSQRRALFBYHTVIA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.248336465 (328h33m32.679416596s) [noise=true , address=77.90.31.11:4586 , piece_id=BAOO6BSMYX5TXUPNFRCF2WAY3SO5KJHQYH2K7EXJFNMQN4VMZANQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.248677437 (328h33m32.679757568s) [noise=true , address=79.127.219.48:4100 , piece_id=H4N76KVSPS77HI67GUPIFESBGPIY6EA7R7VUFEFINXIEROVQJR7Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.249002830 (328h33m32.680082971s) [noise=true , address=104.36.82.23:4477 , piece_id=BD6FDZWETY23OOJ25WLYLOXRTGRQQEQHF5ZUJCJMQ57CL6KIT3LA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:39.718404119 (328h33m34.14948425s) [upload=341832]: Next returned nil segment
Aug 22 09:59:39.718420792 (328h33m34.149500923s) [upload=341832]: Waiting for error group managing segments...
Aug 22 09:59:40.096294193 (328h33m34.527374324s) [noise=true , address=79.127.220.97:4380 , piece_id=YKEYMZTK2CL4Y6IXGGSC6CF4PLJDKTV2FJKRM73GHA4TF4YCCU3A, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.131042899 (328h33m34.56212303s) [noise=true , address=45.91.116.8:4070 , piece_id=C7UA2C3NXCHXYGZHOWAXC3ENRHFZYEETDKXMRZL634S4Z3LDRRLQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.144056448 (328h33m34.57513658s) [noise=true , address=45.91.116.14:4201 , piece_id=ZATGC3X33Q4YHVYUTQI5WXE6TVIJC45FCVRTRR3EWKQTAIKS4XOA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.151789104 (328h33m34.582869225s) [noise=true , address=77.90.31.16:4760 , piece_id=WC6AWJ4WHMOUSRZ5FJ6VKCEXECITC2GSN3D3RALGIWIE5MVTVRCA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.155470147 (328h33m34.586550278s) [noise=true , address=77.90.31.10:4537 , piece_id=YMLJM4BAADMVD673EFTRVNAISZ7ENB4XGPHYVZ4QHCOUVYDSQKKA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.169676989 (328h33m34.600757111s) [noise=true , address=104.36.82.5:4861 , piece_id=N2IJP72CKHNZ6TUPQDTIX7S6HZ6WENUMDV2QJHPPQH3NELQGZLVQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.180703618 (328h33m34.611783749s) [noise=true , address=77.90.31.19:4874 , piece_id=IGHDAJUCE3JC2OWUWA66ZBMIXWXCEO5C3MEOSDSQRRALFBYHTVIA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.186268576 (328h33m34.617348757s) [noise=true , address=104.36.82.20:4466 , piece_id=5VPP4FMSQDZB3TMY3PGRGPTU35SQLMQ65NKLUKPOEWQDGENQQUGQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.187789345 (328h33m34.618869476s) [noise=true , address=79.127.219.48:4100 , piece_id=H4N76KVSPS77HI67GUPIFESBGPIY6EA7R7VUFEFINXIEROVQJR7Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.206730106 (328h33m34.637810227s) [noise=true , address=45.91.116.6:4987 , piece_id=VOPVVMRP7RANM45Q2W3SEJ36DGYH6RMF4GBEMAJWL34YJDWNBWKA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.209965165 (328h33m34.641045286s) [noise=true , address=156.146.43.225:4462 , piece_id=X6RFMZOADX7R2AV4SWS2Z4RL6LJMFOTHXPDOWHAQTR3DFULR25FA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.241178888 (328h33m34.672259019s) [noise=true , address=79.127.201.215:4343 , piece_id=LMBWV3HCHNHVIDYKYCZC4NRWAKIVXNCKIDZO6SXSVSKOV4YIVEFQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.272542788 (328h33m34.703622919s) [noise=true , address=104.36.82.60:4338 , piece_id=52WHALM2SWKRPSRZ3LS7O3JLGMNUVLGXKKLVSWJMPCHV626M647Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.290310062 (328h33m34.721390194s) [noise=true , address=77.90.31.17:4796 , piece_id=M3J6EQF2VNHIXBXLA66EHLI6DAWLS6XWGWYU2ZBNQ6JJEUT5LV7Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.290335702 (328h33m34.721415833s) [seg_pos={0 0}, upload=341832]: Segment reached optimal threshold of 14 pieces.
Aug 22 09:59:40.290449419 (328h33m34.72152955s) [noise=true , address=104.36.82.23:4477 , piece_id=BD6FDZWETY23OOJ25WLYLOXRTGRQQEQHF5ZUJCJMQ57CL6KIT3LA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290525565 (328h33m34.721605696s) [noise=true , address=104.36.82.60:4341 , piece_id=R2IPTYO4ODUHMTPVRYIBROQOKZPX2LNGORZXDOBDMGW4P63G5BTA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okrDyM4TfzYN3p8zUjTqbw2661rKQQqZdP1ptAKzzTQ82C7cN): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290567735 (328h33m34.721647866s) [noise=true , address=79.127.201.215:4360 , piece_id=5FYTI3AVMQMLV3RKCJUZSOJSBRERFKFQCSLGDWVFSC6SD2MDLEZQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290607662 (328h33m34.721687803s) [noise=true , address=77.90.31.11:4586 , piece_id=BAOO6BSMYX5TXUPNFRCF2WAY3SO5KJHQYH2K7EXJFNMQN4VMZANQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cp4U45mdzouvz4Gq1YPQ1EzuHttggJnXNepr1ai218HqkxeF2): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290631077 (328h33m34.721711198s) [seg_pos={0 0}, upload=341832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 09:59:40.290714627 (328h33m34.721794758s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 09:59:40.290718835 (328h33m34.721798966s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 09:59:40.620798512 (328h33m35.051878633s) [upload=341832]: Done uploading segments...
Aug 22 09:59:40.620819331 (328h33m35.051899452s) [upload=341832]: Upload finished. err: <nil>
Duration: 5.803133008s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [...X.........X.......XX....XX....................X......X...] duration:
5.696269732s
FAIL (2025-08-22 10:02:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 09:59:37.782963277 (328h33m32.214043408s) [upload=341832]: Starting upload
Aug 22 09:59:37.783007813 (328h33m32.214087944s) [upload=341832]: Done starting upload
Aug 22 09:59:37.783061806 (328h33m32.214141977s) [upload=341832]: Uploading segments...
Aug 22 09:59:37.783224787 (328h33m32.214304958s) [upload=341832]: Got next segment. Inline: false
Aug 22 09:59:37.783268150 (328h33m32.214348311s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 09:59:37.783275464 (328h33m32.214355615s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 09:59:38.240964951 (328h33m32.672045082s) [seg_pos={0 0}, upload=341832]: Begin upload segment...
Aug 22 09:59:38.241009456 (328h33m32.672089587s) [seg_pos={0 0}, upload=341832]: Done begin upload segment.
Aug 22 09:59:38.241029343 (328h33m32.672109475s) [noise=true , address=77.90.31.17:4796 , piece_id=M3J6EQF2VNHIXBXLA66EHLI6DAWLS6XWGWYU2ZBNQ6JJEUT5LV7Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241402378 (328h33m32.672482509s) [noise=true , address=79.127.220.97:4380 , piece_id=YKEYMZTK2CL4Y6IXGGSC6CF4PLJDKTV2FJKRM73GHA4TF4YCCU3A, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241680179 (328h33m32.67276031s) [noise=true , address=45.91.116.8:4070 , piece_id=C7UA2C3NXCHXYGZHOWAXC3ENRHFZYEETDKXMRZL634S4Z3LDRRLQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241899078 (328h33m32.672979209s) [noise=true , address=104.36.82.20:4466 , piece_id=5VPP4FMSQDZB3TMY3PGRGPTU35SQLMQ65NKLUKPOEWQDGENQQUGQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242047983 (328h33m32.673128114s) [noise=true , address=79.127.201.215:4343 , piece_id=LMBWV3HCHNHVIDYKYCZC4NRWAKIVXNCKIDZO6SXSVSKOV4YIVEFQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242292681 (328h33m32.673372812s) [noise=true , address=104.36.82.5:4861 , piece_id=N2IJP72CKHNZ6TUPQDTIX7S6HZ6WENUMDV2QJHPPQH3NELQGZLVQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242311848 (328h33m32.673391979s) [noise=true , address=156.146.43.225:4462 , piece_id=X6RFMZOADX7R2AV4SWS2Z4RL6LJMFOTHXPDOWHAQTR3DFULR25FA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242645095 (328h33m32.673725226s) [noise=true , address=79.127.201.215:4360 , piece_id=5FYTI3AVMQMLV3RKCJUZSOJSBRERFKFQCSLGDWVFSC6SD2MDLEZQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242989064 (328h33m32.674069195s) [noise=true , address=45.91.116.14:4201 , piece_id=ZATGC3X33Q4YHVYUTQI5WXE6TVIJC45FCVRTRR3EWKQTAIKS4XOA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.243815024 (328h33m32.674895165s) [noise=true , address=104.36.82.60:4338 , piece_id=52WHALM2SWKRPSRZ3LS7O3JLGMNUVLGXKKLVSWJMPCHV626M647Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.244837590 (328h33m32.675917721s) [noise=true , address=104.36.82.60:4341 , piece_id=R2IPTYO4ODUHMTPVRYIBROQOKZPX2LNGORZXDOBDMGW4P63G5BTA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.245890526 (328h33m32.676970667s) [noise=true , address=45.91.116.6:4987 , piece_id=VOPVVMRP7RANM45Q2W3SEJ36DGYH6RMF4GBEMAJWL34YJDWNBWKA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.246848599 (328h33m32.67792873s) [noise=true , address=77.90.31.10:4537 , piece_id=YMLJM4BAADMVD673EFTRVNAISZ7ENB4XGPHYVZ4QHCOUVYDSQKKA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.247190322 (328h33m32.678270463s) [noise=true , address=77.90.31.16:4760 , piece_id=WC6AWJ4WHMOUSRZ5FJ6VKCEXECITC2GSN3D3RALGIWIE5MVTVRCA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.247521285 (328h33m32.678601416s) [noise=true , address=77.90.31.19:4874 , piece_id=IGHDAJUCE3JC2OWUWA66ZBMIXWXCEO5C3MEOSDSQRRALFBYHTVIA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.248336465 (328h33m32.679416596s) [noise=true , address=77.90.31.11:4586 , piece_id=BAOO6BSMYX5TXUPNFRCF2WAY3SO5KJHQYH2K7EXJFNMQN4VMZANQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.248677437 (328h33m32.679757568s) [noise=true , address=79.127.219.48:4100 , piece_id=H4N76KVSPS77HI67GUPIFESBGPIY6EA7R7VUFEFINXIEROVQJR7Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.249002830 (328h33m32.680082971s) [noise=true , address=104.36.82.23:4477 , piece_id=BD6FDZWETY23OOJ25WLYLOXRTGRQQEQHF5ZUJCJMQ57CL6KIT3LA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:39.718404119 (328h33m34.14948425s) [upload=341832]: Next returned nil segment
Aug 22 09:59:39.718420792 (328h33m34.149500923s) [upload=341832]: Waiting for error group managing segments...
Aug 22 09:59:40.096294193 (328h33m34.527374324s) [noise=true , address=79.127.220.97:4380 , piece_id=YKEYMZTK2CL4Y6IXGGSC6CF4PLJDKTV2FJKRM73GHA4TF4YCCU3A, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.131042899 (328h33m34.56212303s) [noise=true , address=45.91.116.8:4070 , piece_id=C7UA2C3NXCHXYGZHOWAXC3ENRHFZYEETDKXMRZL634S4Z3LDRRLQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.144056448 (328h33m34.57513658s) [noise=true , address=45.91.116.14:4201 , piece_id=ZATGC3X33Q4YHVYUTQI5WXE6TVIJC45FCVRTRR3EWKQTAIKS4XOA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.151789104 (328h33m34.582869225s) [noise=true , address=77.90.31.16:4760 , piece_id=WC6AWJ4WHMOUSRZ5FJ6VKCEXECITC2GSN3D3RALGIWIE5MVTVRCA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.155470147 (328h33m34.586550278s) [noise=true , address=77.90.31.10:4537 , piece_id=YMLJM4BAADMVD673EFTRVNAISZ7ENB4XGPHYVZ4QHCOUVYDSQKKA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.169676989 (328h33m34.600757111s) [noise=true , address=104.36.82.5:4861 , piece_id=N2IJP72CKHNZ6TUPQDTIX7S6HZ6WENUMDV2QJHPPQH3NELQGZLVQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.180703618 (328h33m34.611783749s) [noise=true , address=77.90.31.19:4874 , piece_id=IGHDAJUCE3JC2OWUWA66ZBMIXWXCEO5C3MEOSDSQRRALFBYHTVIA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.186268576 (328h33m34.617348757s) [noise=true , address=104.36.82.20:4466 , piece_id=5VPP4FMSQDZB3TMY3PGRGPTU35SQLMQ65NKLUKPOEWQDGENQQUGQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.187789345 (328h33m34.618869476s) [noise=true , address=79.127.219.48:4100 , piece_id=H4N76KVSPS77HI67GUPIFESBGPIY6EA7R7VUFEFINXIEROVQJR7Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.206730106 (328h33m34.637810227s) [noise=true , address=45.91.116.6:4987 , piece_id=VOPVVMRP7RANM45Q2W3SEJ36DGYH6RMF4GBEMAJWL34YJDWNBWKA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.209965165 (328h33m34.641045286s) [noise=true , address=156.146.43.225:4462 , piece_id=X6RFMZOADX7R2AV4SWS2Z4RL6LJMFOTHXPDOWHAQTR3DFULR25FA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.241178888 (328h33m34.672259019s) [noise=true , address=79.127.201.215:4343 , piece_id=LMBWV3HCHNHVIDYKYCZC4NRWAKIVXNCKIDZO6SXSVSKOV4YIVEFQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.272542788 (328h33m34.703622919s) [noise=true , address=104.36.82.60:4338 , piece_id=52WHALM2SWKRPSRZ3LS7O3JLGMNUVLGXKKLVSWJMPCHV626M647Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.290310062 (328h33m34.721390194s) [noise=true , address=77.90.31.17:4796 , piece_id=M3J6EQF2VNHIXBXLA66EHLI6DAWLS6XWGWYU2ZBNQ6JJEUT5LV7Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.290335702 (328h33m34.721415833s) [seg_pos={0 0}, upload=341832]: Segment reached optimal threshold of 14 pieces.
Aug 22 09:59:40.290449419 (328h33m34.72152955s) [noise=true , address=104.36.82.23:4477 , piece_id=BD6FDZWETY23OOJ25WLYLOXRTGRQQEQHF5ZUJCJMQ57CL6KIT3LA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290525565 (328h33m34.721605696s) [noise=true , address=104.36.82.60:4341 , piece_id=R2IPTYO4ODUHMTPVRYIBROQOKZPX2LNGORZXDOBDMGW4P63G5BTA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okrDyM4TfzYN3p8zUjTqbw2661rKQQqZdP1ptAKzzTQ82C7cN): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290567735 (328h33m34.721647866s) [noise=true , address=79.127.201.215:4360 , piece_id=5FYTI3AVMQMLV3RKCJUZSOJSBRERFKFQCSLGDWVFSC6SD2MDLEZQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290607662 (328h33m34.721687803s) [noise=true , address=77.90.31.11:4586 , piece_id=BAOO6BSMYX5TXUPNFRCF2WAY3SO5KJHQYH2K7EXJFNMQN4VMZANQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cp4U45mdzouvz4Gq1YPQ1EzuHttggJnXNepr1ai218HqkxeF2): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290631077 (328h33m34.721711198s) [seg_pos={0 0}, upload=341832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 09:59:40.290714627 (328h33m34.721794758s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 09:59:40.290718835 (328h33m34.721798966s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 09:59:40.620798512 (328h33m35.051878633s) [upload=341832]: Done uploading segments...
Aug 22 09:59:40.620819331 (328h33m35.051899452s) [upload=341832]: Upload finished. err: <nil>
Duration: 5.696294738s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
1.833407227s
FAIL (2025-08-22 10:01:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 09:14:17.953419544 (327h48m12.384499675s) [upload=341042]: Starting upload Aug 22 09:14:17.953469550 (327h48m12.384549741s) [upload=341042]: Done starting upload Aug 22 09:14:17.953547469 (327h48m12.3846276s) [upload=341042]: Uploading segments... Aug 22 09:14:17.953592926 (327h48m12.384673057s) [upload=341042]: Got next segment. Inline: true Aug 22 09:14:17.953604819 (327h48m12.384685s) [upload=341042]: Waiting for error group managing segments... Aug 22 09:14:17.953667248 (327h48m12.384747429s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 09:14:17.953675263 (327h48m12.384755444s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 09:14:17.953681525 (327h48m12.384761686s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 09:14:18.172663380 (327h48m12.603743511s) [upload=341042]: Done uploading segments... Aug 22 09:14:18.172682727 (327h48m12.603762848s) [upload=341042]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.833465108s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [....X.........X.......XX....XX....................X......X..] duration:
5.865684303s
FAIL (2025-08-22 10:01:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 09:59:37.782963277 (328h33m32.214043408s) [upload=341832]: Starting upload
Aug 22 09:59:37.783007813 (328h33m32.214087944s) [upload=341832]: Done starting upload
Aug 22 09:59:37.783061806 (328h33m32.214141977s) [upload=341832]: Uploading segments...
Aug 22 09:59:37.783224787 (328h33m32.214304958s) [upload=341832]: Got next segment. Inline: false
Aug 22 09:59:37.783268150 (328h33m32.214348311s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 09:59:37.783275464 (328h33m32.214355615s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 09:59:38.240964951 (328h33m32.672045082s) [seg_pos={0 0}, upload=341832]: Begin upload segment...
Aug 22 09:59:38.241009456 (328h33m32.672089587s) [seg_pos={0 0}, upload=341832]: Done begin upload segment.
Aug 22 09:59:38.241029343 (328h33m32.672109475s) [noise=true , address=77.90.31.17:4796 , piece_id=M3J6EQF2VNHIXBXLA66EHLI6DAWLS6XWGWYU2ZBNQ6JJEUT5LV7Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241402378 (328h33m32.672482509s) [noise=true , address=79.127.220.97:4380 , piece_id=YKEYMZTK2CL4Y6IXGGSC6CF4PLJDKTV2FJKRM73GHA4TF4YCCU3A, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241680179 (328h33m32.67276031s) [noise=true , address=45.91.116.8:4070 , piece_id=C7UA2C3NXCHXYGZHOWAXC3ENRHFZYEETDKXMRZL634S4Z3LDRRLQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241899078 (328h33m32.672979209s) [noise=true , address=104.36.82.20:4466 , piece_id=5VPP4FMSQDZB3TMY3PGRGPTU35SQLMQ65NKLUKPOEWQDGENQQUGQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242047983 (328h33m32.673128114s) [noise=true , address=79.127.201.215:4343 , piece_id=LMBWV3HCHNHVIDYKYCZC4NRWAKIVXNCKIDZO6SXSVSKOV4YIVEFQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242292681 (328h33m32.673372812s) [noise=true , address=104.36.82.5:4861 , piece_id=N2IJP72CKHNZ6TUPQDTIX7S6HZ6WENUMDV2QJHPPQH3NELQGZLVQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242311848 (328h33m32.673391979s) [noise=true , address=156.146.43.225:4462 , piece_id=X6RFMZOADX7R2AV4SWS2Z4RL6LJMFOTHXPDOWHAQTR3DFULR25FA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242645095 (328h33m32.673725226s) [noise=true , address=79.127.201.215:4360 , piece_id=5FYTI3AVMQMLV3RKCJUZSOJSBRERFKFQCSLGDWVFSC6SD2MDLEZQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242989064 (328h33m32.674069195s) [noise=true , address=45.91.116.14:4201 , piece_id=ZATGC3X33Q4YHVYUTQI5WXE6TVIJC45FCVRTRR3EWKQTAIKS4XOA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.243815024 (328h33m32.674895165s) [noise=true , address=104.36.82.60:4338 , piece_id=52WHALM2SWKRPSRZ3LS7O3JLGMNUVLGXKKLVSWJMPCHV626M647Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.244837590 (328h33m32.675917721s) [noise=true , address=104.36.82.60:4341 , piece_id=R2IPTYO4ODUHMTPVRYIBROQOKZPX2LNGORZXDOBDMGW4P63G5BTA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.245890526 (328h33m32.676970667s) [noise=true , address=45.91.116.6:4987 , piece_id=VOPVVMRP7RANM45Q2W3SEJ36DGYH6RMF4GBEMAJWL34YJDWNBWKA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.246848599 (328h33m32.67792873s) [noise=true , address=77.90.31.10:4537 , piece_id=YMLJM4BAADMVD673EFTRVNAISZ7ENB4XGPHYVZ4QHCOUVYDSQKKA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.247190322 (328h33m32.678270463s) [noise=true , address=77.90.31.16:4760 , piece_id=WC6AWJ4WHMOUSRZ5FJ6VKCEXECITC2GSN3D3RALGIWIE5MVTVRCA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.247521285 (328h33m32.678601416s) [noise=true , address=77.90.31.19:4874 , piece_id=IGHDAJUCE3JC2OWUWA66ZBMIXWXCEO5C3MEOSDSQRRALFBYHTVIA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.248336465 (328h33m32.679416596s) [noise=true , address=77.90.31.11:4586 , piece_id=BAOO6BSMYX5TXUPNFRCF2WAY3SO5KJHQYH2K7EXJFNMQN4VMZANQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.248677437 (328h33m32.679757568s) [noise=true , address=79.127.219.48:4100 , piece_id=H4N76KVSPS77HI67GUPIFESBGPIY6EA7R7VUFEFINXIEROVQJR7Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.249002830 (328h33m32.680082971s) [noise=true , address=104.36.82.23:4477 , piece_id=BD6FDZWETY23OOJ25WLYLOXRTGRQQEQHF5ZUJCJMQ57CL6KIT3LA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:39.718404119 (328h33m34.14948425s) [upload=341832]: Next returned nil segment
Aug 22 09:59:39.718420792 (328h33m34.149500923s) [upload=341832]: Waiting for error group managing segments...
Aug 22 09:59:40.096294193 (328h33m34.527374324s) [noise=true , address=79.127.220.97:4380 , piece_id=YKEYMZTK2CL4Y6IXGGSC6CF4PLJDKTV2FJKRM73GHA4TF4YCCU3A, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.131042899 (328h33m34.56212303s) [noise=true , address=45.91.116.8:4070 , piece_id=C7UA2C3NXCHXYGZHOWAXC3ENRHFZYEETDKXMRZL634S4Z3LDRRLQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.144056448 (328h33m34.57513658s) [noise=true , address=45.91.116.14:4201 , piece_id=ZATGC3X33Q4YHVYUTQI5WXE6TVIJC45FCVRTRR3EWKQTAIKS4XOA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.151789104 (328h33m34.582869225s) [noise=true , address=77.90.31.16:4760 , piece_id=WC6AWJ4WHMOUSRZ5FJ6VKCEXECITC2GSN3D3RALGIWIE5MVTVRCA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.155470147 (328h33m34.586550278s) [noise=true , address=77.90.31.10:4537 , piece_id=YMLJM4BAADMVD673EFTRVNAISZ7ENB4XGPHYVZ4QHCOUVYDSQKKA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.169676989 (328h33m34.600757111s) [noise=true , address=104.36.82.5:4861 , piece_id=N2IJP72CKHNZ6TUPQDTIX7S6HZ6WENUMDV2QJHPPQH3NELQGZLVQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.180703618 (328h33m34.611783749s) [noise=true , address=77.90.31.19:4874 , piece_id=IGHDAJUCE3JC2OWUWA66ZBMIXWXCEO5C3MEOSDSQRRALFBYHTVIA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.186268576 (328h33m34.617348757s) [noise=true , address=104.36.82.20:4466 , piece_id=5VPP4FMSQDZB3TMY3PGRGPTU35SQLMQ65NKLUKPOEWQDGENQQUGQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.187789345 (328h33m34.618869476s) [noise=true , address=79.127.219.48:4100 , piece_id=H4N76KVSPS77HI67GUPIFESBGPIY6EA7R7VUFEFINXIEROVQJR7Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.206730106 (328h33m34.637810227s) [noise=true , address=45.91.116.6:4987 , piece_id=VOPVVMRP7RANM45Q2W3SEJ36DGYH6RMF4GBEMAJWL34YJDWNBWKA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.209965165 (328h33m34.641045286s) [noise=true , address=156.146.43.225:4462 , piece_id=X6RFMZOADX7R2AV4SWS2Z4RL6LJMFOTHXPDOWHAQTR3DFULR25FA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.241178888 (328h33m34.672259019s) [noise=true , address=79.127.201.215:4343 , piece_id=LMBWV3HCHNHVIDYKYCZC4NRWAKIVXNCKIDZO6SXSVSKOV4YIVEFQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.272542788 (328h33m34.703622919s) [noise=true , address=104.36.82.60:4338 , piece_id=52WHALM2SWKRPSRZ3LS7O3JLGMNUVLGXKKLVSWJMPCHV626M647Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.290310062 (328h33m34.721390194s) [noise=true , address=77.90.31.17:4796 , piece_id=M3J6EQF2VNHIXBXLA66EHLI6DAWLS6XWGWYU2ZBNQ6JJEUT5LV7Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.290335702 (328h33m34.721415833s) [seg_pos={0 0}, upload=341832]: Segment reached optimal threshold of 14 pieces.
Aug 22 09:59:40.290449419 (328h33m34.72152955s) [noise=true , address=104.36.82.23:4477 , piece_id=BD6FDZWETY23OOJ25WLYLOXRTGRQQEQHF5ZUJCJMQ57CL6KIT3LA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290525565 (328h33m34.721605696s) [noise=true , address=104.36.82.60:4341 , piece_id=R2IPTYO4ODUHMTPVRYIBROQOKZPX2LNGORZXDOBDMGW4P63G5BTA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okrDyM4TfzYN3p8zUjTqbw2661rKQQqZdP1ptAKzzTQ82C7cN): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290567735 (328h33m34.721647866s) [noise=true , address=79.127.201.215:4360 , piece_id=5FYTI3AVMQMLV3RKCJUZSOJSBRERFKFQCSLGDWVFSC6SD2MDLEZQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290607662 (328h33m34.721687803s) [noise=true , address=77.90.31.11:4586 , piece_id=BAOO6BSMYX5TXUPNFRCF2WAY3SO5KJHQYH2K7EXJFNMQN4VMZANQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cp4U45mdzouvz4Gq1YPQ1EzuHttggJnXNepr1ai218HqkxeF2): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290631077 (328h33m34.721711198s) [seg_pos={0 0}, upload=341832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 09:59:40.290714627 (328h33m34.721794758s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 09:59:40.290718835 (328h33m34.721798966s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 09:59:40.620798512 (328h33m35.051878633s) [upload=341832]: Done uploading segments...
Aug 22 09:59:40.620819331 (328h33m35.051899452s) [upload=341832]: Upload finished. err: <nil>
Duration: 5.865710703s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
1.912987834s
FAIL (2025-08-22 10:00:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 09:14:17.953419544 (327h48m12.384499675s) [upload=341042]: Starting upload Aug 22 09:14:17.953469550 (327h48m12.384549741s) [upload=341042]: Done starting upload Aug 22 09:14:17.953547469 (327h48m12.3846276s) [upload=341042]: Uploading segments... Aug 22 09:14:17.953592926 (327h48m12.384673057s) [upload=341042]: Got next segment. Inline: true Aug 22 09:14:17.953604819 (327h48m12.384685s) [upload=341042]: Waiting for error group managing segments... Aug 22 09:14:17.953667248 (327h48m12.384747429s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 09:14:17.953675263 (327h48m12.384755444s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 09:14:17.953681525 (327h48m12.384761686s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 09:14:18.172663380 (327h48m12.603743511s) [upload=341042]: Done uploading segments... Aug 22 09:14:18.172682727 (327h48m12.603762848s) [upload=341042]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.913019925s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [.....X.........X.......XX....XX....................X......X.] duration:
5.589131308s
FAIL (2025-08-22 10:00:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 09:59:37.782963277 (328h33m32.214043408s) [upload=341832]: Starting upload
Aug 22 09:59:37.783007813 (328h33m32.214087944s) [upload=341832]: Done starting upload
Aug 22 09:59:37.783061806 (328h33m32.214141977s) [upload=341832]: Uploading segments...
Aug 22 09:59:37.783224787 (328h33m32.214304958s) [upload=341832]: Got next segment. Inline: false
Aug 22 09:59:37.783268150 (328h33m32.214348311s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 09:59:37.783275464 (328h33m32.214355615s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 09:59:38.240964951 (328h33m32.672045082s) [seg_pos={0 0}, upload=341832]: Begin upload segment...
Aug 22 09:59:38.241009456 (328h33m32.672089587s) [seg_pos={0 0}, upload=341832]: Done begin upload segment.
Aug 22 09:59:38.241029343 (328h33m32.672109475s) [noise=true , address=77.90.31.17:4796 , piece_id=M3J6EQF2VNHIXBXLA66EHLI6DAWLS6XWGWYU2ZBNQ6JJEUT5LV7Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241402378 (328h33m32.672482509s) [noise=true , address=79.127.220.97:4380 , piece_id=YKEYMZTK2CL4Y6IXGGSC6CF4PLJDKTV2FJKRM73GHA4TF4YCCU3A, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241680179 (328h33m32.67276031s) [noise=true , address=45.91.116.8:4070 , piece_id=C7UA2C3NXCHXYGZHOWAXC3ENRHFZYEETDKXMRZL634S4Z3LDRRLQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241899078 (328h33m32.672979209s) [noise=true , address=104.36.82.20:4466 , piece_id=5VPP4FMSQDZB3TMY3PGRGPTU35SQLMQ65NKLUKPOEWQDGENQQUGQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242047983 (328h33m32.673128114s) [noise=true , address=79.127.201.215:4343 , piece_id=LMBWV3HCHNHVIDYKYCZC4NRWAKIVXNCKIDZO6SXSVSKOV4YIVEFQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242292681 (328h33m32.673372812s) [noise=true , address=104.36.82.5:4861 , piece_id=N2IJP72CKHNZ6TUPQDTIX7S6HZ6WENUMDV2QJHPPQH3NELQGZLVQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242311848 (328h33m32.673391979s) [noise=true , address=156.146.43.225:4462 , piece_id=X6RFMZOADX7R2AV4SWS2Z4RL6LJMFOTHXPDOWHAQTR3DFULR25FA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242645095 (328h33m32.673725226s) [noise=true , address=79.127.201.215:4360 , piece_id=5FYTI3AVMQMLV3RKCJUZSOJSBRERFKFQCSLGDWVFSC6SD2MDLEZQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242989064 (328h33m32.674069195s) [noise=true , address=45.91.116.14:4201 , piece_id=ZATGC3X33Q4YHVYUTQI5WXE6TVIJC45FCVRTRR3EWKQTAIKS4XOA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.243815024 (328h33m32.674895165s) [noise=true , address=104.36.82.60:4338 , piece_id=52WHALM2SWKRPSRZ3LS7O3JLGMNUVLGXKKLVSWJMPCHV626M647Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.244837590 (328h33m32.675917721s) [noise=true , address=104.36.82.60:4341 , piece_id=R2IPTYO4ODUHMTPVRYIBROQOKZPX2LNGORZXDOBDMGW4P63G5BTA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.245890526 (328h33m32.676970667s) [noise=true , address=45.91.116.6:4987 , piece_id=VOPVVMRP7RANM45Q2W3SEJ36DGYH6RMF4GBEMAJWL34YJDWNBWKA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.246848599 (328h33m32.67792873s) [noise=true , address=77.90.31.10:4537 , piece_id=YMLJM4BAADMVD673EFTRVNAISZ7ENB4XGPHYVZ4QHCOUVYDSQKKA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.247190322 (328h33m32.678270463s) [noise=true , address=77.90.31.16:4760 , piece_id=WC6AWJ4WHMOUSRZ5FJ6VKCEXECITC2GSN3D3RALGIWIE5MVTVRCA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.247521285 (328h33m32.678601416s) [noise=true , address=77.90.31.19:4874 , piece_id=IGHDAJUCE3JC2OWUWA66ZBMIXWXCEO5C3MEOSDSQRRALFBYHTVIA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.248336465 (328h33m32.679416596s) [noise=true , address=77.90.31.11:4586 , piece_id=BAOO6BSMYX5TXUPNFRCF2WAY3SO5KJHQYH2K7EXJFNMQN4VMZANQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.248677437 (328h33m32.679757568s) [noise=true , address=79.127.219.48:4100 , piece_id=H4N76KVSPS77HI67GUPIFESBGPIY6EA7R7VUFEFINXIEROVQJR7Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.249002830 (328h33m32.680082971s) [noise=true , address=104.36.82.23:4477 , piece_id=BD6FDZWETY23OOJ25WLYLOXRTGRQQEQHF5ZUJCJMQ57CL6KIT3LA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:39.718404119 (328h33m34.14948425s) [upload=341832]: Next returned nil segment
Aug 22 09:59:39.718420792 (328h33m34.149500923s) [upload=341832]: Waiting for error group managing segments...
Aug 22 09:59:40.096294193 (328h33m34.527374324s) [noise=true , address=79.127.220.97:4380 , piece_id=YKEYMZTK2CL4Y6IXGGSC6CF4PLJDKTV2FJKRM73GHA4TF4YCCU3A, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.131042899 (328h33m34.56212303s) [noise=true , address=45.91.116.8:4070 , piece_id=C7UA2C3NXCHXYGZHOWAXC3ENRHFZYEETDKXMRZL634S4Z3LDRRLQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.144056448 (328h33m34.57513658s) [noise=true , address=45.91.116.14:4201 , piece_id=ZATGC3X33Q4YHVYUTQI5WXE6TVIJC45FCVRTRR3EWKQTAIKS4XOA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.151789104 (328h33m34.582869225s) [noise=true , address=77.90.31.16:4760 , piece_id=WC6AWJ4WHMOUSRZ5FJ6VKCEXECITC2GSN3D3RALGIWIE5MVTVRCA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.155470147 (328h33m34.586550278s) [noise=true , address=77.90.31.10:4537 , piece_id=YMLJM4BAADMVD673EFTRVNAISZ7ENB4XGPHYVZ4QHCOUVYDSQKKA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.169676989 (328h33m34.600757111s) [noise=true , address=104.36.82.5:4861 , piece_id=N2IJP72CKHNZ6TUPQDTIX7S6HZ6WENUMDV2QJHPPQH3NELQGZLVQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.180703618 (328h33m34.611783749s) [noise=true , address=77.90.31.19:4874 , piece_id=IGHDAJUCE3JC2OWUWA66ZBMIXWXCEO5C3MEOSDSQRRALFBYHTVIA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.186268576 (328h33m34.617348757s) [noise=true , address=104.36.82.20:4466 , piece_id=5VPP4FMSQDZB3TMY3PGRGPTU35SQLMQ65NKLUKPOEWQDGENQQUGQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.187789345 (328h33m34.618869476s) [noise=true , address=79.127.219.48:4100 , piece_id=H4N76KVSPS77HI67GUPIFESBGPIY6EA7R7VUFEFINXIEROVQJR7Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.206730106 (328h33m34.637810227s) [noise=true , address=45.91.116.6:4987 , piece_id=VOPVVMRP7RANM45Q2W3SEJ36DGYH6RMF4GBEMAJWL34YJDWNBWKA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.209965165 (328h33m34.641045286s) [noise=true , address=156.146.43.225:4462 , piece_id=X6RFMZOADX7R2AV4SWS2Z4RL6LJMFOTHXPDOWHAQTR3DFULR25FA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.241178888 (328h33m34.672259019s) [noise=true , address=79.127.201.215:4343 , piece_id=LMBWV3HCHNHVIDYKYCZC4NRWAKIVXNCKIDZO6SXSVSKOV4YIVEFQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.272542788 (328h33m34.703622919s) [noise=true , address=104.36.82.60:4338 , piece_id=52WHALM2SWKRPSRZ3LS7O3JLGMNUVLGXKKLVSWJMPCHV626M647Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.290310062 (328h33m34.721390194s) [noise=true , address=77.90.31.17:4796 , piece_id=M3J6EQF2VNHIXBXLA66EHLI6DAWLS6XWGWYU2ZBNQ6JJEUT5LV7Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.290335702 (328h33m34.721415833s) [seg_pos={0 0}, upload=341832]: Segment reached optimal threshold of 14 pieces.
Aug 22 09:59:40.290449419 (328h33m34.72152955s) [noise=true , address=104.36.82.23:4477 , piece_id=BD6FDZWETY23OOJ25WLYLOXRTGRQQEQHF5ZUJCJMQ57CL6KIT3LA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290525565 (328h33m34.721605696s) [noise=true , address=104.36.82.60:4341 , piece_id=R2IPTYO4ODUHMTPVRYIBROQOKZPX2LNGORZXDOBDMGW4P63G5BTA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okrDyM4TfzYN3p8zUjTqbw2661rKQQqZdP1ptAKzzTQ82C7cN): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290567735 (328h33m34.721647866s) [noise=true , address=79.127.201.215:4360 , piece_id=5FYTI3AVMQMLV3RKCJUZSOJSBRERFKFQCSLGDWVFSC6SD2MDLEZQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290607662 (328h33m34.721687803s) [noise=true , address=77.90.31.11:4586 , piece_id=BAOO6BSMYX5TXUPNFRCF2WAY3SO5KJHQYH2K7EXJFNMQN4VMZANQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cp4U45mdzouvz4Gq1YPQ1EzuHttggJnXNepr1ai218HqkxeF2): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290631077 (328h33m34.721711198s) [seg_pos={0 0}, upload=341832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 09:59:40.290714627 (328h33m34.721794758s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 09:59:40.290718835 (328h33m34.721798966s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 09:59:40.620798512 (328h33m35.051878633s) [upload=341832]: Done uploading segments...
Aug 22 09:59:40.620819331 (328h33m35.051899452s) [upload=341832]: Upload finished. err: <nil>
Duration: 5.589169031s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.XX.........................................................] duration:
1.981032517s
FAIL (2025-08-22 09:59:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 09:14:17.953419544 (327h48m12.384499675s) [upload=341042]: Starting upload Aug 22 09:14:17.953469550 (327h48m12.384549741s) [upload=341042]: Done starting upload Aug 22 09:14:17.953547469 (327h48m12.3846276s) [upload=341042]: Uploading segments... Aug 22 09:14:17.953592926 (327h48m12.384673057s) [upload=341042]: Got next segment. Inline: true Aug 22 09:14:17.953604819 (327h48m12.384685s) [upload=341042]: Waiting for error group managing segments... Aug 22 09:14:17.953667248 (327h48m12.384747429s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 09:14:17.953675263 (327h48m12.384755444s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 09:14:17.953681525 (327h48m12.384761686s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 09:14:18.172663380 (327h48m12.603743511s) [upload=341042]: Done uploading segments... Aug 22 09:14:18.172682727 (327h48m12.603762848s) [upload=341042]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.981057656s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [......X.........X.......XX....XX....................X......X] duration:
4.003180189s
FAIL (2025-08-22 09:59:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 09:59:37.782963277 (328h33m32.214043408s) [upload=341832]: Starting upload
Aug 22 09:59:37.783007813 (328h33m32.214087944s) [upload=341832]: Done starting upload
Aug 22 09:59:37.783061806 (328h33m32.214141977s) [upload=341832]: Uploading segments...
Aug 22 09:59:37.783224787 (328h33m32.214304958s) [upload=341832]: Got next segment. Inline: false
Aug 22 09:59:37.783268150 (328h33m32.214348311s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 09:59:37.783275464 (328h33m32.214355615s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 09:59:38.240964951 (328h33m32.672045082s) [seg_pos={0 0}, upload=341832]: Begin upload segment...
Aug 22 09:59:38.241009456 (328h33m32.672089587s) [seg_pos={0 0}, upload=341832]: Done begin upload segment.
Aug 22 09:59:38.241029343 (328h33m32.672109475s) [noise=true , address=77.90.31.17:4796 , piece_id=M3J6EQF2VNHIXBXLA66EHLI6DAWLS6XWGWYU2ZBNQ6JJEUT5LV7Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241402378 (328h33m32.672482509s) [noise=true , address=79.127.220.97:4380 , piece_id=YKEYMZTK2CL4Y6IXGGSC6CF4PLJDKTV2FJKRM73GHA4TF4YCCU3A, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241680179 (328h33m32.67276031s) [noise=true , address=45.91.116.8:4070 , piece_id=C7UA2C3NXCHXYGZHOWAXC3ENRHFZYEETDKXMRZL634S4Z3LDRRLQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.241899078 (328h33m32.672979209s) [noise=true , address=104.36.82.20:4466 , piece_id=5VPP4FMSQDZB3TMY3PGRGPTU35SQLMQ65NKLUKPOEWQDGENQQUGQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242047983 (328h33m32.673128114s) [noise=true , address=79.127.201.215:4343 , piece_id=LMBWV3HCHNHVIDYKYCZC4NRWAKIVXNCKIDZO6SXSVSKOV4YIVEFQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242292681 (328h33m32.673372812s) [noise=true , address=104.36.82.5:4861 , piece_id=N2IJP72CKHNZ6TUPQDTIX7S6HZ6WENUMDV2QJHPPQH3NELQGZLVQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242311848 (328h33m32.673391979s) [noise=true , address=156.146.43.225:4462 , piece_id=X6RFMZOADX7R2AV4SWS2Z4RL6LJMFOTHXPDOWHAQTR3DFULR25FA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242645095 (328h33m32.673725226s) [noise=true , address=79.127.201.215:4360 , piece_id=5FYTI3AVMQMLV3RKCJUZSOJSBRERFKFQCSLGDWVFSC6SD2MDLEZQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.242989064 (328h33m32.674069195s) [noise=true , address=45.91.116.14:4201 , piece_id=ZATGC3X33Q4YHVYUTQI5WXE6TVIJC45FCVRTRR3EWKQTAIKS4XOA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.243815024 (328h33m32.674895165s) [noise=true , address=104.36.82.60:4338 , piece_id=52WHALM2SWKRPSRZ3LS7O3JLGMNUVLGXKKLVSWJMPCHV626M647Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.244837590 (328h33m32.675917721s) [noise=true , address=104.36.82.60:4341 , piece_id=R2IPTYO4ODUHMTPVRYIBROQOKZPX2LNGORZXDOBDMGW4P63G5BTA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.245890526 (328h33m32.676970667s) [noise=true , address=45.91.116.6:4987 , piece_id=VOPVVMRP7RANM45Q2W3SEJ36DGYH6RMF4GBEMAJWL34YJDWNBWKA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.246848599 (328h33m32.67792873s) [noise=true , address=77.90.31.10:4537 , piece_id=YMLJM4BAADMVD673EFTRVNAISZ7ENB4XGPHYVZ4QHCOUVYDSQKKA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.247190322 (328h33m32.678270463s) [noise=true , address=77.90.31.16:4760 , piece_id=WC6AWJ4WHMOUSRZ5FJ6VKCEXECITC2GSN3D3RALGIWIE5MVTVRCA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.247521285 (328h33m32.678601416s) [noise=true , address=77.90.31.19:4874 , piece_id=IGHDAJUCE3JC2OWUWA66ZBMIXWXCEO5C3MEOSDSQRRALFBYHTVIA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.248336465 (328h33m32.679416596s) [noise=true , address=77.90.31.11:4586 , piece_id=BAOO6BSMYX5TXUPNFRCF2WAY3SO5KJHQYH2K7EXJFNMQN4VMZANQ, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.248677437 (328h33m32.679757568s) [noise=true , address=79.127.219.48:4100 , piece_id=H4N76KVSPS77HI67GUPIFESBGPIY6EA7R7VUFEFINXIEROVQJR7Q, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:38.249002830 (328h33m32.680082971s) [noise=true , address=104.36.82.23:4477 , piece_id=BD6FDZWETY23OOJ25WLYLOXRTGRQQEQHF5ZUJCJMQ57CL6KIT3LA, seg_pos={0 0}, upload=341832]: Uploading piece...
Aug 22 09:59:39.718404119 (328h33m34.14948425s) [upload=341832]: Next returned nil segment
Aug 22 09:59:39.718420792 (328h33m34.149500923s) [upload=341832]: Waiting for error group managing segments...
Aug 22 09:59:40.096294193 (328h33m34.527374324s) [noise=true , address=79.127.220.97:4380 , piece_id=YKEYMZTK2CL4Y6IXGGSC6CF4PLJDKTV2FJKRM73GHA4TF4YCCU3A, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.131042899 (328h33m34.56212303s) [noise=true , address=45.91.116.8:4070 , piece_id=C7UA2C3NXCHXYGZHOWAXC3ENRHFZYEETDKXMRZL634S4Z3LDRRLQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.144056448 (328h33m34.57513658s) [noise=true , address=45.91.116.14:4201 , piece_id=ZATGC3X33Q4YHVYUTQI5WXE6TVIJC45FCVRTRR3EWKQTAIKS4XOA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.151789104 (328h33m34.582869225s) [noise=true , address=77.90.31.16:4760 , piece_id=WC6AWJ4WHMOUSRZ5FJ6VKCEXECITC2GSN3D3RALGIWIE5MVTVRCA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.155470147 (328h33m34.586550278s) [noise=true , address=77.90.31.10:4537 , piece_id=YMLJM4BAADMVD673EFTRVNAISZ7ENB4XGPHYVZ4QHCOUVYDSQKKA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.169676989 (328h33m34.600757111s) [noise=true , address=104.36.82.5:4861 , piece_id=N2IJP72CKHNZ6TUPQDTIX7S6HZ6WENUMDV2QJHPPQH3NELQGZLVQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.180703618 (328h33m34.611783749s) [noise=true , address=77.90.31.19:4874 , piece_id=IGHDAJUCE3JC2OWUWA66ZBMIXWXCEO5C3MEOSDSQRRALFBYHTVIA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.186268576 (328h33m34.617348757s) [noise=true , address=104.36.82.20:4466 , piece_id=5VPP4FMSQDZB3TMY3PGRGPTU35SQLMQ65NKLUKPOEWQDGENQQUGQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.187789345 (328h33m34.618869476s) [noise=true , address=79.127.219.48:4100 , piece_id=H4N76KVSPS77HI67GUPIFESBGPIY6EA7R7VUFEFINXIEROVQJR7Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.206730106 (328h33m34.637810227s) [noise=true , address=45.91.116.6:4987 , piece_id=VOPVVMRP7RANM45Q2W3SEJ36DGYH6RMF4GBEMAJWL34YJDWNBWKA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.209965165 (328h33m34.641045286s) [noise=true , address=156.146.43.225:4462 , piece_id=X6RFMZOADX7R2AV4SWS2Z4RL6LJMFOTHXPDOWHAQTR3DFULR25FA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.241178888 (328h33m34.672259019s) [noise=true , address=79.127.201.215:4343 , piece_id=LMBWV3HCHNHVIDYKYCZC4NRWAKIVXNCKIDZO6SXSVSKOV4YIVEFQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.272542788 (328h33m34.703622919s) [noise=true , address=104.36.82.60:4338 , piece_id=52WHALM2SWKRPSRZ3LS7O3JLGMNUVLGXKKLVSWJMPCHV626M647Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.290310062 (328h33m34.721390194s) [noise=true , address=77.90.31.17:4796 , piece_id=M3J6EQF2VNHIXBXLA66EHLI6DAWLS6XWGWYU2ZBNQ6JJEUT5LV7Q, seg_pos={0 0}, upload=341832]: Done uploading piece. err: <nil>
Aug 22 09:59:40.290335702 (328h33m34.721415833s) [seg_pos={0 0}, upload=341832]: Segment reached optimal threshold of 14 pieces.
Aug 22 09:59:40.290449419 (328h33m34.72152955s) [noise=true , address=104.36.82.23:4477 , piece_id=BD6FDZWETY23OOJ25WLYLOXRTGRQQEQHF5ZUJCJMQ57CL6KIT3LA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290525565 (328h33m34.721605696s) [noise=true , address=104.36.82.60:4341 , piece_id=R2IPTYO4ODUHMTPVRYIBROQOKZPX2LNGORZXDOBDMGW4P63G5BTA, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okrDyM4TfzYN3p8zUjTqbw2661rKQQqZdP1ptAKzzTQ82C7cN): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290567735 (328h33m34.721647866s) [noise=true , address=79.127.201.215:4360 , piece_id=5FYTI3AVMQMLV3RKCJUZSOJSBRERFKFQCSLGDWVFSC6SD2MDLEZQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290607662 (328h33m34.721687803s) [noise=true , address=77.90.31.11:4586 , piece_id=BAOO6BSMYX5TXUPNFRCF2WAY3SO5KJHQYH2K7EXJFNMQN4VMZANQ, seg_pos={0 0}, upload=341832]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cp4U45mdzouvz4Gq1YPQ1EzuHttggJnXNepr1ai218HqkxeF2): protocol: expected piece hash; context canceled; EOF
Aug 22 09:59:40.290631077 (328h33m34.721711198s) [seg_pos={0 0}, upload=341832]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 09:59:40.290714627 (328h33m34.721794758s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 09:59:40.290718835 (328h33m34.721798966s) [upload=341832]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 09:59:40.620798512 (328h33m35.051878633s) [upload=341832]: Done uploading segments...
Aug 22 09:59:40.620819331 (328h33m35.051899452s) [upload=341832]: Upload finished. err: <nil>
Duration: 4.003215757s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.......X.........X.......XX....XX....................X......] duration:
5.914525013s
FAIL (2025-08-22 09:58:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 847589912590ca78359fcb1602d5a39c0c337e01c5ccbde72debf5b20baae03e != before 82a1fe65e07d59753c7c43f13f07946896e91335fe46ee860af09c1a6fb90a6c
======LOGS======
Aug 22 09:54:56.911505118 (328h28m51.342585249s) [upload=341747]: Starting upload
Aug 22 09:54:56.911554011 (328h28m51.342634142s) [upload=341747]: Done starting upload
Aug 22 09:54:56.911671677 (328h28m51.342751808s) [upload=341747]: Uploading segments...
Aug 22 09:54:56.911818718 (328h28m51.342898849s) [upload=341747]: Got next segment. Inline: false
Aug 22 09:54:56.911858754 (328h28m51.342938885s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 09:54:56.911863875 (328h28m51.342944006s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 09:54:57.359755375 (328h28m51.790835506s) [seg_pos={0 0}, upload=341747]: Begin upload segment...
Aug 22 09:54:57.359795892 (328h28m51.790876023s) [seg_pos={0 0}, upload=341747]: Done begin upload segment.
Aug 22 09:54:57.359814508 (328h28m51.790894639s) [noise=true , address=79.127.219.51:4215 , piece_id=ILMNVNEHSUM2UHG4GV3E2JRC6FUCGDNIQHSIMPX4VCNXBETTPFGA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.360211587 (328h28m51.791291719s) [noise=true , address=104.36.82.20:4456 , piece_id=KNAZ7ZCBIWQHBXIJPKQSTFUJE3TYI3U476D5YOMTNKOAFUHBJK2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.360473349 (328h28m51.79155348s) [noise=true , address=77.90.31.12:4595 , piece_id=SALDOXOWWNE6J2QM6L6HZCOMB6SV6MBM6KUXIRKNDDXF2INWVJZA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.360738086 (328h28m51.791818217s) [noise=true , address=79.127.205.233:4629 , piece_id=EJDBZ6ORQJOLSI7IXBGRMWRNUMKSXPHDTTKY5ZDPRJVFTWJV6P2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.361079008 (328h28m51.792159169s) [noise=true , address=104.36.82.10:4089 , piece_id=L2B4SOCDFKAJG4IFKPROEOY46DYTB6XW3Q5ZRTUHLNDJ5TF72LGA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.361469715 (328h28m51.792549846s) [noise=true , address=104.36.82.5:4859 , piece_id=JU27MEOIYGVW26TTB55GHTJAOY5HHHQTZYFPOHC2EEX5UESXJTLQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.361827670 (328h28m51.792907801s) [noise=true , address=45.91.116.11:4141 , piece_id=XS7HMYWARKQPHVWJQFFRNXSDZANE2HEPUGZ2IG2AZVYY6NV7BPJQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.362147011 (328h28m51.793227142s) [noise=true , address=77.90.31.19:4868 , piece_id=4OI4TZR2J4S4G5HDL2AU46KB324CYLECR2VUX2BOJAOETKLKGD2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.363452789 (328h28m51.79453292s) [noise=true , address=77.90.31.11:4585 , piece_id=CPDMLWXJAGX5CC5AXTRBAMIWTV4KTVXJ5PMRBHLKMEG7UPSNWRXQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.363678431 (328h28m51.794758563s) [noise=true , address=77.90.31.16:4766 , piece_id=2VYF3FZKYPTAJZSUY6XS4KAMUJ6KARTKI5EKFD66D5CWSIMNMJWQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.363890837 (328h28m51.794970968s) [noise=true , address=79.127.219.47:4061 , piece_id=PIOMHBN5YRLCBGPOHE54ETRGJNCZQW5SACWNDXRWO5PFBDUUQCAA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364158820 (328h28m51.795238951s) [noise=true , address=45.91.116.9:4289 , piece_id=5YIG5V7I5CFFHE34CJ4FPE2J7ULTM6CCZ3UMQ356OSYWGNGJKRSQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364384913 (328h28m51.795465044s) [noise=true , address=104.36.82.9:4034 , piece_id=5RFSFAPS6VA7N64FK2MBF2QKXPKRC4M4O65CBT6MDFGXDHDXL3XQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364598892 (328h28m51.795679033s) [noise=true , address=77.90.31.18:4829 , piece_id=2JQR4SJKQ5TSLI3I2MYOBVVBSXP6D575AL3G6ILOZBFXJY2Y4KRQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364807522 (328h28m51.795887653s) [noise=true , address=104.36.82.9:4015 , piece_id=7RAOMT3G5TKWJTPCLWC2NJ52M7ZX5RRIVC5LZQMRPU77XLCUZNRQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.365010119 (328h28m51.79609024s) [noise=true , address=77.90.31.10:4526 , piece_id=PSR7U3K4EP3KN5R2F3DGWTERLVG2Y7G7OEVCWBLCYPISMQCMAUSQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.365354328 (328h28m51.796434459s) [noise=true , address=79.127.201.215:4360 , piece_id=CRVCMZLSFTJS5EGCSRGVS2573QHIR3R2HNRNV5U2XMAWOLT4UW2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.365692665 (328h28m51.796772796s) [noise=true , address=156.146.43.225:4462 , piece_id=ERS5G5N2F2DOEGDTZ57L33RRXH5U747K7UWKH23IKLWRSTW3UEZQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:58.471074170 (328h28m52.902154291s) [upload=341747]: Next returned nil segment
Aug 22 09:54:58.471087335 (328h28m52.902167466s) [upload=341747]: Waiting for error group managing segments...
Aug 22 09:54:58.754503277 (328h28m53.185583408s) [noise=true , address=79.127.205.233:4629 , piece_id=EJDBZ6ORQJOLSI7IXBGRMWRNUMKSXPHDTTKY5ZDPRJVFTWJV6P2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.238695222 (328h28m53.669775353s) [noise=true , address=79.127.219.47:4061 , piece_id=PIOMHBN5YRLCBGPOHE54ETRGJNCZQW5SACWNDXRWO5PFBDUUQCAA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.260480245 (328h28m53.691560376s) [noise=true , address=45.91.116.9:4289 , piece_id=5YIG5V7I5CFFHE34CJ4FPE2J7ULTM6CCZ3UMQ356OSYWGNGJKRSQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.265556919 (328h28m53.69663705s) [noise=true , address=77.90.31.11:4585 , piece_id=CPDMLWXJAGX5CC5AXTRBAMIWTV4KTVXJ5PMRBHLKMEG7UPSNWRXQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.274213371 (328h28m53.705293502s) [noise=true , address=79.127.219.51:4215 , piece_id=ILMNVNEHSUM2UHG4GV3E2JRC6FUCGDNIQHSIMPX4VCNXBETTPFGA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.282223667 (328h28m53.713303828s) [noise=true , address=104.36.82.10:4089 , piece_id=L2B4SOCDFKAJG4IFKPROEOY46DYTB6XW3Q5ZRTUHLNDJ5TF72LGA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.331417983 (328h28m53.762498104s) [noise=true , address=104.36.82.9:4034 , piece_id=5RFSFAPS6VA7N64FK2MBF2QKXPKRC4M4O65CBT6MDFGXDHDXL3XQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.338786451 (328h28m53.769866572s) [noise=true , address=156.146.43.225:4462 , piece_id=ERS5G5N2F2DOEGDTZ57L33RRXH5U747K7UWKH23IKLWRSTW3UEZQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.350935406 (328h28m53.782015537s) [noise=true , address=79.127.201.215:4360 , piece_id=CRVCMZLSFTJS5EGCSRGVS2573QHIR3R2HNRNV5U2XMAWOLT4UW2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.363548069 (328h28m53.7946282s) [noise=true , address=104.36.82.5:4859 , piece_id=JU27MEOIYGVW26TTB55GHTJAOY5HHHQTZYFPOHC2EEX5UESXJTLQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.365276126 (328h28m53.796356257s) [noise=true , address=77.90.31.10:4526 , piece_id=PSR7U3K4EP3KN5R2F3DGWTERLVG2Y7G7OEVCWBLCYPISMQCMAUSQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.386267599 (328h28m53.81734773s) [noise=true , address=77.90.31.19:4868 , piece_id=4OI4TZR2J4S4G5HDL2AU46KB324CYLECR2VUX2BOJAOETKLKGD2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.390848094 (328h28m53.821928225s) [noise=true , address=104.36.82.20:4456 , piece_id=KNAZ7ZCBIWQHBXIJPKQSTFUJE3TYI3U476D5YOMTNKOAFUHBJK2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.394281172 (328h28m53.825361303s) [noise=true , address=77.90.31.12:4595 , piece_id=SALDOXOWWNE6J2QM6L6HZCOMB6SV6MBM6KUXIRKNDDXF2INWVJZA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.394307763 (328h28m53.825387894s) [seg_pos={0 0}, upload=341747]: Segment reached optimal threshold of 14 pieces.
Aug 22 09:54:59.394454273 (328h28m53.825534394s) [noise=true , address=45.91.116.11:4141 , piece_id=XS7HMYWARKQPHVWJQFFRNXSDZANE2HEPUGZ2IG2AZVYY6NV7BPJQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394467608 (328h28m53.825547739s) [noise=true , address=104.36.82.9:4015 , piece_id=7RAOMT3G5TKWJTPCLWC2NJ52M7ZX5RRIVC5LZQMRPU77XLCUZNRQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KXaAs7ZW21xGPAZRVUxGMBgH78eejQ2kxEm5CQR5ZdQvzZd6o): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394536000 (328h28m53.825616131s) [noise=true , address=77.90.31.16:4766 , piece_id=2VYF3FZKYPTAJZSUY6XS4KAMUJ6KARTKI5EKFD66D5CWSIMNMJWQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1V8iMvJLcTddWZihWQBQLLCyMTwbD2h7ruDUjMEtHD7EHtNVEK): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394556228 (328h28m53.82563635s) [noise=true , address=77.90.31.18:4829 , piece_id=2JQR4SJKQ5TSLI3I2MYOBVVBSXP6D575AL3G6ILOZBFXJY2Y4KRQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1548pzNGffaMonic7dMK5VtZhLHtae3iffd9wjfjyTCp4XJ7Lo): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394576687 (328h28m53.825656818s) [seg_pos={0 0}, upload=341747]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 09:54:59.394650749 (328h28m53.82573088s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 09:54:59.394654796 (328h28m53.825734928s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 09:54:59.684122445 (328h28m54.115202566s) [upload=341747]: Done uploading segments...
Aug 22 09:54:59.684141743 (328h28m54.115221864s) [upload=341747]: Upload finished. err: <nil>
Duration: 5.914557215s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..XX........................................................] duration:
1.947769431s
FAIL (2025-08-22 09:58:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 09:14:17.953419544 (327h48m12.384499675s) [upload=341042]: Starting upload Aug 22 09:14:17.953469550 (327h48m12.384549741s) [upload=341042]: Done starting upload Aug 22 09:14:17.953547469 (327h48m12.3846276s) [upload=341042]: Uploading segments... Aug 22 09:14:17.953592926 (327h48m12.384673057s) [upload=341042]: Got next segment. Inline: true Aug 22 09:14:17.953604819 (327h48m12.384685s) [upload=341042]: Waiting for error group managing segments... Aug 22 09:14:17.953667248 (327h48m12.384747429s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 09:14:17.953675263 (327h48m12.384755444s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 09:14:17.953681525 (327h48m12.384761686s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 09:14:18.172663380 (327h48m12.603743511s) [upload=341042]: Done uploading segments... Aug 22 09:14:18.172682727 (327h48m12.603762848s) [upload=341042]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.947794028s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...XX.......................................................] duration:
1.896727291s
FAIL (2025-08-22 09:57:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 09:14:17.953419544 (327h48m12.384499675s) [upload=341042]: Starting upload Aug 22 09:14:17.953469550 (327h48m12.384549741s) [upload=341042]: Done starting upload Aug 22 09:14:17.953547469 (327h48m12.3846276s) [upload=341042]: Uploading segments... Aug 22 09:14:17.953592926 (327h48m12.384673057s) [upload=341042]: Got next segment. Inline: true Aug 22 09:14:17.953604819 (327h48m12.384685s) [upload=341042]: Waiting for error group managing segments... Aug 22 09:14:17.953667248 (327h48m12.384747429s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 09:14:17.953675263 (327h48m12.384755444s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 09:14:17.953681525 (327h48m12.384761686s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 09:14:18.172663380 (327h48m12.603743511s) [upload=341042]: Done uploading segments... Aug 22 09:14:18.172682727 (327h48m12.603762848s) [upload=341042]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.896756846s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [........X.........X.......XX....XX....................X.....] duration:
5.740683209s
FAIL (2025-08-22 09:57:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 847589912590ca78359fcb1602d5a39c0c337e01c5ccbde72debf5b20baae03e != before 82a1fe65e07d59753c7c43f13f07946896e91335fe46ee860af09c1a6fb90a6c
======LOGS======
Aug 22 09:54:56.911505118 (328h28m51.342585249s) [upload=341747]: Starting upload
Aug 22 09:54:56.911554011 (328h28m51.342634142s) [upload=341747]: Done starting upload
Aug 22 09:54:56.911671677 (328h28m51.342751808s) [upload=341747]: Uploading segments...
Aug 22 09:54:56.911818718 (328h28m51.342898849s) [upload=341747]: Got next segment. Inline: false
Aug 22 09:54:56.911858754 (328h28m51.342938885s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 09:54:56.911863875 (328h28m51.342944006s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 09:54:57.359755375 (328h28m51.790835506s) [seg_pos={0 0}, upload=341747]: Begin upload segment...
Aug 22 09:54:57.359795892 (328h28m51.790876023s) [seg_pos={0 0}, upload=341747]: Done begin upload segment.
Aug 22 09:54:57.359814508 (328h28m51.790894639s) [noise=true , address=79.127.219.51:4215 , piece_id=ILMNVNEHSUM2UHG4GV3E2JRC6FUCGDNIQHSIMPX4VCNXBETTPFGA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.360211587 (328h28m51.791291719s) [noise=true , address=104.36.82.20:4456 , piece_id=KNAZ7ZCBIWQHBXIJPKQSTFUJE3TYI3U476D5YOMTNKOAFUHBJK2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.360473349 (328h28m51.79155348s) [noise=true , address=77.90.31.12:4595 , piece_id=SALDOXOWWNE6J2QM6L6HZCOMB6SV6MBM6KUXIRKNDDXF2INWVJZA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.360738086 (328h28m51.791818217s) [noise=true , address=79.127.205.233:4629 , piece_id=EJDBZ6ORQJOLSI7IXBGRMWRNUMKSXPHDTTKY5ZDPRJVFTWJV6P2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.361079008 (328h28m51.792159169s) [noise=true , address=104.36.82.10:4089 , piece_id=L2B4SOCDFKAJG4IFKPROEOY46DYTB6XW3Q5ZRTUHLNDJ5TF72LGA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.361469715 (328h28m51.792549846s) [noise=true , address=104.36.82.5:4859 , piece_id=JU27MEOIYGVW26TTB55GHTJAOY5HHHQTZYFPOHC2EEX5UESXJTLQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.361827670 (328h28m51.792907801s) [noise=true , address=45.91.116.11:4141 , piece_id=XS7HMYWARKQPHVWJQFFRNXSDZANE2HEPUGZ2IG2AZVYY6NV7BPJQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.362147011 (328h28m51.793227142s) [noise=true , address=77.90.31.19:4868 , piece_id=4OI4TZR2J4S4G5HDL2AU46KB324CYLECR2VUX2BOJAOETKLKGD2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.363452789 (328h28m51.79453292s) [noise=true , address=77.90.31.11:4585 , piece_id=CPDMLWXJAGX5CC5AXTRBAMIWTV4KTVXJ5PMRBHLKMEG7UPSNWRXQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.363678431 (328h28m51.794758563s) [noise=true , address=77.90.31.16:4766 , piece_id=2VYF3FZKYPTAJZSUY6XS4KAMUJ6KARTKI5EKFD66D5CWSIMNMJWQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.363890837 (328h28m51.794970968s) [noise=true , address=79.127.219.47:4061 , piece_id=PIOMHBN5YRLCBGPOHE54ETRGJNCZQW5SACWNDXRWO5PFBDUUQCAA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364158820 (328h28m51.795238951s) [noise=true , address=45.91.116.9:4289 , piece_id=5YIG5V7I5CFFHE34CJ4FPE2J7ULTM6CCZ3UMQ356OSYWGNGJKRSQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364384913 (328h28m51.795465044s) [noise=true , address=104.36.82.9:4034 , piece_id=5RFSFAPS6VA7N64FK2MBF2QKXPKRC4M4O65CBT6MDFGXDHDXL3XQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364598892 (328h28m51.795679033s) [noise=true , address=77.90.31.18:4829 , piece_id=2JQR4SJKQ5TSLI3I2MYOBVVBSXP6D575AL3G6ILOZBFXJY2Y4KRQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364807522 (328h28m51.795887653s) [noise=true , address=104.36.82.9:4015 , piece_id=7RAOMT3G5TKWJTPCLWC2NJ52M7ZX5RRIVC5LZQMRPU77XLCUZNRQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.365010119 (328h28m51.79609024s) [noise=true , address=77.90.31.10:4526 , piece_id=PSR7U3K4EP3KN5R2F3DGWTERLVG2Y7G7OEVCWBLCYPISMQCMAUSQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.365354328 (328h28m51.796434459s) [noise=true , address=79.127.201.215:4360 , piece_id=CRVCMZLSFTJS5EGCSRGVS2573QHIR3R2HNRNV5U2XMAWOLT4UW2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.365692665 (328h28m51.796772796s) [noise=true , address=156.146.43.225:4462 , piece_id=ERS5G5N2F2DOEGDTZ57L33RRXH5U747K7UWKH23IKLWRSTW3UEZQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:58.471074170 (328h28m52.902154291s) [upload=341747]: Next returned nil segment
Aug 22 09:54:58.471087335 (328h28m52.902167466s) [upload=341747]: Waiting for error group managing segments...
Aug 22 09:54:58.754503277 (328h28m53.185583408s) [noise=true , address=79.127.205.233:4629 , piece_id=EJDBZ6ORQJOLSI7IXBGRMWRNUMKSXPHDTTKY5ZDPRJVFTWJV6P2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.238695222 (328h28m53.669775353s) [noise=true , address=79.127.219.47:4061 , piece_id=PIOMHBN5YRLCBGPOHE54ETRGJNCZQW5SACWNDXRWO5PFBDUUQCAA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.260480245 (328h28m53.691560376s) [noise=true , address=45.91.116.9:4289 , piece_id=5YIG5V7I5CFFHE34CJ4FPE2J7ULTM6CCZ3UMQ356OSYWGNGJKRSQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.265556919 (328h28m53.69663705s) [noise=true , address=77.90.31.11:4585 , piece_id=CPDMLWXJAGX5CC5AXTRBAMIWTV4KTVXJ5PMRBHLKMEG7UPSNWRXQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.274213371 (328h28m53.705293502s) [noise=true , address=79.127.219.51:4215 , piece_id=ILMNVNEHSUM2UHG4GV3E2JRC6FUCGDNIQHSIMPX4VCNXBETTPFGA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.282223667 (328h28m53.713303828s) [noise=true , address=104.36.82.10:4089 , piece_id=L2B4SOCDFKAJG4IFKPROEOY46DYTB6XW3Q5ZRTUHLNDJ5TF72LGA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.331417983 (328h28m53.762498104s) [noise=true , address=104.36.82.9:4034 , piece_id=5RFSFAPS6VA7N64FK2MBF2QKXPKRC4M4O65CBT6MDFGXDHDXL3XQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.338786451 (328h28m53.769866572s) [noise=true , address=156.146.43.225:4462 , piece_id=ERS5G5N2F2DOEGDTZ57L33RRXH5U747K7UWKH23IKLWRSTW3UEZQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.350935406 (328h28m53.782015537s) [noise=true , address=79.127.201.215:4360 , piece_id=CRVCMZLSFTJS5EGCSRGVS2573QHIR3R2HNRNV5U2XMAWOLT4UW2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.363548069 (328h28m53.7946282s) [noise=true , address=104.36.82.5:4859 , piece_id=JU27MEOIYGVW26TTB55GHTJAOY5HHHQTZYFPOHC2EEX5UESXJTLQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.365276126 (328h28m53.796356257s) [noise=true , address=77.90.31.10:4526 , piece_id=PSR7U3K4EP3KN5R2F3DGWTERLVG2Y7G7OEVCWBLCYPISMQCMAUSQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.386267599 (328h28m53.81734773s) [noise=true , address=77.90.31.19:4868 , piece_id=4OI4TZR2J4S4G5HDL2AU46KB324CYLECR2VUX2BOJAOETKLKGD2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.390848094 (328h28m53.821928225s) [noise=true , address=104.36.82.20:4456 , piece_id=KNAZ7ZCBIWQHBXIJPKQSTFUJE3TYI3U476D5YOMTNKOAFUHBJK2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.394281172 (328h28m53.825361303s) [noise=true , address=77.90.31.12:4595 , piece_id=SALDOXOWWNE6J2QM6L6HZCOMB6SV6MBM6KUXIRKNDDXF2INWVJZA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.394307763 (328h28m53.825387894s) [seg_pos={0 0}, upload=341747]: Segment reached optimal threshold of 14 pieces.
Aug 22 09:54:59.394454273 (328h28m53.825534394s) [noise=true , address=45.91.116.11:4141 , piece_id=XS7HMYWARKQPHVWJQFFRNXSDZANE2HEPUGZ2IG2AZVYY6NV7BPJQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394467608 (328h28m53.825547739s) [noise=true , address=104.36.82.9:4015 , piece_id=7RAOMT3G5TKWJTPCLWC2NJ52M7ZX5RRIVC5LZQMRPU77XLCUZNRQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KXaAs7ZW21xGPAZRVUxGMBgH78eejQ2kxEm5CQR5ZdQvzZd6o): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394536000 (328h28m53.825616131s) [noise=true , address=77.90.31.16:4766 , piece_id=2VYF3FZKYPTAJZSUY6XS4KAMUJ6KARTKI5EKFD66D5CWSIMNMJWQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1V8iMvJLcTddWZihWQBQLLCyMTwbD2h7ruDUjMEtHD7EHtNVEK): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394556228 (328h28m53.82563635s) [noise=true , address=77.90.31.18:4829 , piece_id=2JQR4SJKQ5TSLI3I2MYOBVVBSXP6D575AL3G6ILOZBFXJY2Y4KRQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1548pzNGffaMonic7dMK5VtZhLHtae3iffd9wjfjyTCp4XJ7Lo): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394576687 (328h28m53.825656818s) [seg_pos={0 0}, upload=341747]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 09:54:59.394650749 (328h28m53.82573088s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 09:54:59.394654796 (328h28m53.825734928s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 09:54:59.684122445 (328h28m54.115202566s) [upload=341747]: Done uploading segments...
Aug 22 09:54:59.684141743 (328h28m54.115221864s) [upload=341747]: Upload finished. err: <nil>
Duration: 5.740708406s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.........X.........X.......XX....XX....................X....] duration:
5.742266918s
FAIL (2025-08-22 09:57:28 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 847589912590ca78359fcb1602d5a39c0c337e01c5ccbde72debf5b20baae03e != before 82a1fe65e07d59753c7c43f13f07946896e91335fe46ee860af09c1a6fb90a6c
======LOGS======
Aug 22 09:54:56.911505118 (328h28m51.342585249s) [upload=341747]: Starting upload
Aug 22 09:54:56.911554011 (328h28m51.342634142s) [upload=341747]: Done starting upload
Aug 22 09:54:56.911671677 (328h28m51.342751808s) [upload=341747]: Uploading segments...
Aug 22 09:54:56.911818718 (328h28m51.342898849s) [upload=341747]: Got next segment. Inline: false
Aug 22 09:54:56.911858754 (328h28m51.342938885s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 09:54:56.911863875 (328h28m51.342944006s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 09:54:57.359755375 (328h28m51.790835506s) [seg_pos={0 0}, upload=341747]: Begin upload segment...
Aug 22 09:54:57.359795892 (328h28m51.790876023s) [seg_pos={0 0}, upload=341747]: Done begin upload segment.
Aug 22 09:54:57.359814508 (328h28m51.790894639s) [noise=true , address=79.127.219.51:4215 , piece_id=ILMNVNEHSUM2UHG4GV3E2JRC6FUCGDNIQHSIMPX4VCNXBETTPFGA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.360211587 (328h28m51.791291719s) [noise=true , address=104.36.82.20:4456 , piece_id=KNAZ7ZCBIWQHBXIJPKQSTFUJE3TYI3U476D5YOMTNKOAFUHBJK2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.360473349 (328h28m51.79155348s) [noise=true , address=77.90.31.12:4595 , piece_id=SALDOXOWWNE6J2QM6L6HZCOMB6SV6MBM6KUXIRKNDDXF2INWVJZA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.360738086 (328h28m51.791818217s) [noise=true , address=79.127.205.233:4629 , piece_id=EJDBZ6ORQJOLSI7IXBGRMWRNUMKSXPHDTTKY5ZDPRJVFTWJV6P2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.361079008 (328h28m51.792159169s) [noise=true , address=104.36.82.10:4089 , piece_id=L2B4SOCDFKAJG4IFKPROEOY46DYTB6XW3Q5ZRTUHLNDJ5TF72LGA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.361469715 (328h28m51.792549846s) [noise=true , address=104.36.82.5:4859 , piece_id=JU27MEOIYGVW26TTB55GHTJAOY5HHHQTZYFPOHC2EEX5UESXJTLQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.361827670 (328h28m51.792907801s) [noise=true , address=45.91.116.11:4141 , piece_id=XS7HMYWARKQPHVWJQFFRNXSDZANE2HEPUGZ2IG2AZVYY6NV7BPJQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.362147011 (328h28m51.793227142s) [noise=true , address=77.90.31.19:4868 , piece_id=4OI4TZR2J4S4G5HDL2AU46KB324CYLECR2VUX2BOJAOETKLKGD2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.363452789 (328h28m51.79453292s) [noise=true , address=77.90.31.11:4585 , piece_id=CPDMLWXJAGX5CC5AXTRBAMIWTV4KTVXJ5PMRBHLKMEG7UPSNWRXQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.363678431 (328h28m51.794758563s) [noise=true , address=77.90.31.16:4766 , piece_id=2VYF3FZKYPTAJZSUY6XS4KAMUJ6KARTKI5EKFD66D5CWSIMNMJWQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.363890837 (328h28m51.794970968s) [noise=true , address=79.127.219.47:4061 , piece_id=PIOMHBN5YRLCBGPOHE54ETRGJNCZQW5SACWNDXRWO5PFBDUUQCAA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364158820 (328h28m51.795238951s) [noise=true , address=45.91.116.9:4289 , piece_id=5YIG5V7I5CFFHE34CJ4FPE2J7ULTM6CCZ3UMQ356OSYWGNGJKRSQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364384913 (328h28m51.795465044s) [noise=true , address=104.36.82.9:4034 , piece_id=5RFSFAPS6VA7N64FK2MBF2QKXPKRC4M4O65CBT6MDFGXDHDXL3XQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364598892 (328h28m51.795679033s) [noise=true , address=77.90.31.18:4829 , piece_id=2JQR4SJKQ5TSLI3I2MYOBVVBSXP6D575AL3G6ILOZBFXJY2Y4KRQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364807522 (328h28m51.795887653s) [noise=true , address=104.36.82.9:4015 , piece_id=7RAOMT3G5TKWJTPCLWC2NJ52M7ZX5RRIVC5LZQMRPU77XLCUZNRQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.365010119 (328h28m51.79609024s) [noise=true , address=77.90.31.10:4526 , piece_id=PSR7U3K4EP3KN5R2F3DGWTERLVG2Y7G7OEVCWBLCYPISMQCMAUSQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.365354328 (328h28m51.796434459s) [noise=true , address=79.127.201.215:4360 , piece_id=CRVCMZLSFTJS5EGCSRGVS2573QHIR3R2HNRNV5U2XMAWOLT4UW2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.365692665 (328h28m51.796772796s) [noise=true , address=156.146.43.225:4462 , piece_id=ERS5G5N2F2DOEGDTZ57L33RRXH5U747K7UWKH23IKLWRSTW3UEZQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:58.471074170 (328h28m52.902154291s) [upload=341747]: Next returned nil segment
Aug 22 09:54:58.471087335 (328h28m52.902167466s) [upload=341747]: Waiting for error group managing segments...
Aug 22 09:54:58.754503277 (328h28m53.185583408s) [noise=true , address=79.127.205.233:4629 , piece_id=EJDBZ6ORQJOLSI7IXBGRMWRNUMKSXPHDTTKY5ZDPRJVFTWJV6P2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.238695222 (328h28m53.669775353s) [noise=true , address=79.127.219.47:4061 , piece_id=PIOMHBN5YRLCBGPOHE54ETRGJNCZQW5SACWNDXRWO5PFBDUUQCAA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.260480245 (328h28m53.691560376s) [noise=true , address=45.91.116.9:4289 , piece_id=5YIG5V7I5CFFHE34CJ4FPE2J7ULTM6CCZ3UMQ356OSYWGNGJKRSQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.265556919 (328h28m53.69663705s) [noise=true , address=77.90.31.11:4585 , piece_id=CPDMLWXJAGX5CC5AXTRBAMIWTV4KTVXJ5PMRBHLKMEG7UPSNWRXQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.274213371 (328h28m53.705293502s) [noise=true , address=79.127.219.51:4215 , piece_id=ILMNVNEHSUM2UHG4GV3E2JRC6FUCGDNIQHSIMPX4VCNXBETTPFGA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.282223667 (328h28m53.713303828s) [noise=true , address=104.36.82.10:4089 , piece_id=L2B4SOCDFKAJG4IFKPROEOY46DYTB6XW3Q5ZRTUHLNDJ5TF72LGA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.331417983 (328h28m53.762498104s) [noise=true , address=104.36.82.9:4034 , piece_id=5RFSFAPS6VA7N64FK2MBF2QKXPKRC4M4O65CBT6MDFGXDHDXL3XQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.338786451 (328h28m53.769866572s) [noise=true , address=156.146.43.225:4462 , piece_id=ERS5G5N2F2DOEGDTZ57L33RRXH5U747K7UWKH23IKLWRSTW3UEZQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.350935406 (328h28m53.782015537s) [noise=true , address=79.127.201.215:4360 , piece_id=CRVCMZLSFTJS5EGCSRGVS2573QHIR3R2HNRNV5U2XMAWOLT4UW2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.363548069 (328h28m53.7946282s) [noise=true , address=104.36.82.5:4859 , piece_id=JU27MEOIYGVW26TTB55GHTJAOY5HHHQTZYFPOHC2EEX5UESXJTLQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.365276126 (328h28m53.796356257s) [noise=true , address=77.90.31.10:4526 , piece_id=PSR7U3K4EP3KN5R2F3DGWTERLVG2Y7G7OEVCWBLCYPISMQCMAUSQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.386267599 (328h28m53.81734773s) [noise=true , address=77.90.31.19:4868 , piece_id=4OI4TZR2J4S4G5HDL2AU46KB324CYLECR2VUX2BOJAOETKLKGD2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.390848094 (328h28m53.821928225s) [noise=true , address=104.36.82.20:4456 , piece_id=KNAZ7ZCBIWQHBXIJPKQSTFUJE3TYI3U476D5YOMTNKOAFUHBJK2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.394281172 (328h28m53.825361303s) [noise=true , address=77.90.31.12:4595 , piece_id=SALDOXOWWNE6J2QM6L6HZCOMB6SV6MBM6KUXIRKNDDXF2INWVJZA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.394307763 (328h28m53.825387894s) [seg_pos={0 0}, upload=341747]: Segment reached optimal threshold of 14 pieces.
Aug 22 09:54:59.394454273 (328h28m53.825534394s) [noise=true , address=45.91.116.11:4141 , piece_id=XS7HMYWARKQPHVWJQFFRNXSDZANE2HEPUGZ2IG2AZVYY6NV7BPJQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394467608 (328h28m53.825547739s) [noise=true , address=104.36.82.9:4015 , piece_id=7RAOMT3G5TKWJTPCLWC2NJ52M7ZX5RRIVC5LZQMRPU77XLCUZNRQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KXaAs7ZW21xGPAZRVUxGMBgH78eejQ2kxEm5CQR5ZdQvzZd6o): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394536000 (328h28m53.825616131s) [noise=true , address=77.90.31.16:4766 , piece_id=2VYF3FZKYPTAJZSUY6XS4KAMUJ6KARTKI5EKFD66D5CWSIMNMJWQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1V8iMvJLcTddWZihWQBQLLCyMTwbD2h7ruDUjMEtHD7EHtNVEK): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394556228 (328h28m53.82563635s) [noise=true , address=77.90.31.18:4829 , piece_id=2JQR4SJKQ5TSLI3I2MYOBVVBSXP6D575AL3G6ILOZBFXJY2Y4KRQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1548pzNGffaMonic7dMK5VtZhLHtae3iffd9wjfjyTCp4XJ7Lo): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394576687 (328h28m53.825656818s) [seg_pos={0 0}, upload=341747]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 09:54:59.394650749 (328h28m53.82573088s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 09:54:59.394654796 (328h28m53.825734928s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 09:54:59.684122445 (328h28m54.115202566s) [upload=341747]: Done uploading segments...
Aug 22 09:54:59.684141743 (328h28m54.115221864s) [upload=341747]: Upload finished. err: <nil>
Duration: 5.74228793s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [..........X.........X.......XX....XX....................X...] duration:
5.587859032s
FAIL (2025-08-22 09:56:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 847589912590ca78359fcb1602d5a39c0c337e01c5ccbde72debf5b20baae03e != before 82a1fe65e07d59753c7c43f13f07946896e91335fe46ee860af09c1a6fb90a6c
======LOGS======
Aug 22 09:54:56.911505118 (328h28m51.342585249s) [upload=341747]: Starting upload
Aug 22 09:54:56.911554011 (328h28m51.342634142s) [upload=341747]: Done starting upload
Aug 22 09:54:56.911671677 (328h28m51.342751808s) [upload=341747]: Uploading segments...
Aug 22 09:54:56.911818718 (328h28m51.342898849s) [upload=341747]: Got next segment. Inline: false
Aug 22 09:54:56.911858754 (328h28m51.342938885s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 09:54:56.911863875 (328h28m51.342944006s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 09:54:57.359755375 (328h28m51.790835506s) [seg_pos={0 0}, upload=341747]: Begin upload segment...
Aug 22 09:54:57.359795892 (328h28m51.790876023s) [seg_pos={0 0}, upload=341747]: Done begin upload segment.
Aug 22 09:54:57.359814508 (328h28m51.790894639s) [noise=true , address=79.127.219.51:4215 , piece_id=ILMNVNEHSUM2UHG4GV3E2JRC6FUCGDNIQHSIMPX4VCNXBETTPFGA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.360211587 (328h28m51.791291719s) [noise=true , address=104.36.82.20:4456 , piece_id=KNAZ7ZCBIWQHBXIJPKQSTFUJE3TYI3U476D5YOMTNKOAFUHBJK2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.360473349 (328h28m51.79155348s) [noise=true , address=77.90.31.12:4595 , piece_id=SALDOXOWWNE6J2QM6L6HZCOMB6SV6MBM6KUXIRKNDDXF2INWVJZA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.360738086 (328h28m51.791818217s) [noise=true , address=79.127.205.233:4629 , piece_id=EJDBZ6ORQJOLSI7IXBGRMWRNUMKSXPHDTTKY5ZDPRJVFTWJV6P2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.361079008 (328h28m51.792159169s) [noise=true , address=104.36.82.10:4089 , piece_id=L2B4SOCDFKAJG4IFKPROEOY46DYTB6XW3Q5ZRTUHLNDJ5TF72LGA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.361469715 (328h28m51.792549846s) [noise=true , address=104.36.82.5:4859 , piece_id=JU27MEOIYGVW26TTB55GHTJAOY5HHHQTZYFPOHC2EEX5UESXJTLQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.361827670 (328h28m51.792907801s) [noise=true , address=45.91.116.11:4141 , piece_id=XS7HMYWARKQPHVWJQFFRNXSDZANE2HEPUGZ2IG2AZVYY6NV7BPJQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.362147011 (328h28m51.793227142s) [noise=true , address=77.90.31.19:4868 , piece_id=4OI4TZR2J4S4G5HDL2AU46KB324CYLECR2VUX2BOJAOETKLKGD2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.363452789 (328h28m51.79453292s) [noise=true , address=77.90.31.11:4585 , piece_id=CPDMLWXJAGX5CC5AXTRBAMIWTV4KTVXJ5PMRBHLKMEG7UPSNWRXQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.363678431 (328h28m51.794758563s) [noise=true , address=77.90.31.16:4766 , piece_id=2VYF3FZKYPTAJZSUY6XS4KAMUJ6KARTKI5EKFD66D5CWSIMNMJWQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.363890837 (328h28m51.794970968s) [noise=true , address=79.127.219.47:4061 , piece_id=PIOMHBN5YRLCBGPOHE54ETRGJNCZQW5SACWNDXRWO5PFBDUUQCAA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364158820 (328h28m51.795238951s) [noise=true , address=45.91.116.9:4289 , piece_id=5YIG5V7I5CFFHE34CJ4FPE2J7ULTM6CCZ3UMQ356OSYWGNGJKRSQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364384913 (328h28m51.795465044s) [noise=true , address=104.36.82.9:4034 , piece_id=5RFSFAPS6VA7N64FK2MBF2QKXPKRC4M4O65CBT6MDFGXDHDXL3XQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364598892 (328h28m51.795679033s) [noise=true , address=77.90.31.18:4829 , piece_id=2JQR4SJKQ5TSLI3I2MYOBVVBSXP6D575AL3G6ILOZBFXJY2Y4KRQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364807522 (328h28m51.795887653s) [noise=true , address=104.36.82.9:4015 , piece_id=7RAOMT3G5TKWJTPCLWC2NJ52M7ZX5RRIVC5LZQMRPU77XLCUZNRQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.365010119 (328h28m51.79609024s) [noise=true , address=77.90.31.10:4526 , piece_id=PSR7U3K4EP3KN5R2F3DGWTERLVG2Y7G7OEVCWBLCYPISMQCMAUSQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.365354328 (328h28m51.796434459s) [noise=true , address=79.127.201.215:4360 , piece_id=CRVCMZLSFTJS5EGCSRGVS2573QHIR3R2HNRNV5U2XMAWOLT4UW2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.365692665 (328h28m51.796772796s) [noise=true , address=156.146.43.225:4462 , piece_id=ERS5G5N2F2DOEGDTZ57L33RRXH5U747K7UWKH23IKLWRSTW3UEZQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:58.471074170 (328h28m52.902154291s) [upload=341747]: Next returned nil segment
Aug 22 09:54:58.471087335 (328h28m52.902167466s) [upload=341747]: Waiting for error group managing segments...
Aug 22 09:54:58.754503277 (328h28m53.185583408s) [noise=true , address=79.127.205.233:4629 , piece_id=EJDBZ6ORQJOLSI7IXBGRMWRNUMKSXPHDTTKY5ZDPRJVFTWJV6P2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.238695222 (328h28m53.669775353s) [noise=true , address=79.127.219.47:4061 , piece_id=PIOMHBN5YRLCBGPOHE54ETRGJNCZQW5SACWNDXRWO5PFBDUUQCAA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.260480245 (328h28m53.691560376s) [noise=true , address=45.91.116.9:4289 , piece_id=5YIG5V7I5CFFHE34CJ4FPE2J7ULTM6CCZ3UMQ356OSYWGNGJKRSQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.265556919 (328h28m53.69663705s) [noise=true , address=77.90.31.11:4585 , piece_id=CPDMLWXJAGX5CC5AXTRBAMIWTV4KTVXJ5PMRBHLKMEG7UPSNWRXQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.274213371 (328h28m53.705293502s) [noise=true , address=79.127.219.51:4215 , piece_id=ILMNVNEHSUM2UHG4GV3E2JRC6FUCGDNIQHSIMPX4VCNXBETTPFGA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.282223667 (328h28m53.713303828s) [noise=true , address=104.36.82.10:4089 , piece_id=L2B4SOCDFKAJG4IFKPROEOY46DYTB6XW3Q5ZRTUHLNDJ5TF72LGA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.331417983 (328h28m53.762498104s) [noise=true , address=104.36.82.9:4034 , piece_id=5RFSFAPS6VA7N64FK2MBF2QKXPKRC4M4O65CBT6MDFGXDHDXL3XQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.338786451 (328h28m53.769866572s) [noise=true , address=156.146.43.225:4462 , piece_id=ERS5G5N2F2DOEGDTZ57L33RRXH5U747K7UWKH23IKLWRSTW3UEZQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.350935406 (328h28m53.782015537s) [noise=true , address=79.127.201.215:4360 , piece_id=CRVCMZLSFTJS5EGCSRGVS2573QHIR3R2HNRNV5U2XMAWOLT4UW2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.363548069 (328h28m53.7946282s) [noise=true , address=104.36.82.5:4859 , piece_id=JU27MEOIYGVW26TTB55GHTJAOY5HHHQTZYFPOHC2EEX5UESXJTLQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.365276126 (328h28m53.796356257s) [noise=true , address=77.90.31.10:4526 , piece_id=PSR7U3K4EP3KN5R2F3DGWTERLVG2Y7G7OEVCWBLCYPISMQCMAUSQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.386267599 (328h28m53.81734773s) [noise=true , address=77.90.31.19:4868 , piece_id=4OI4TZR2J4S4G5HDL2AU46KB324CYLECR2VUX2BOJAOETKLKGD2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.390848094 (328h28m53.821928225s) [noise=true , address=104.36.82.20:4456 , piece_id=KNAZ7ZCBIWQHBXIJPKQSTFUJE3TYI3U476D5YOMTNKOAFUHBJK2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.394281172 (328h28m53.825361303s) [noise=true , address=77.90.31.12:4595 , piece_id=SALDOXOWWNE6J2QM6L6HZCOMB6SV6MBM6KUXIRKNDDXF2INWVJZA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.394307763 (328h28m53.825387894s) [seg_pos={0 0}, upload=341747]: Segment reached optimal threshold of 14 pieces.
Aug 22 09:54:59.394454273 (328h28m53.825534394s) [noise=true , address=45.91.116.11:4141 , piece_id=XS7HMYWARKQPHVWJQFFRNXSDZANE2HEPUGZ2IG2AZVYY6NV7BPJQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394467608 (328h28m53.825547739s) [noise=true , address=104.36.82.9:4015 , piece_id=7RAOMT3G5TKWJTPCLWC2NJ52M7ZX5RRIVC5LZQMRPU77XLCUZNRQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KXaAs7ZW21xGPAZRVUxGMBgH78eejQ2kxEm5CQR5ZdQvzZd6o): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394536000 (328h28m53.825616131s) [noise=true , address=77.90.31.16:4766 , piece_id=2VYF3FZKYPTAJZSUY6XS4KAMUJ6KARTKI5EKFD66D5CWSIMNMJWQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1V8iMvJLcTddWZihWQBQLLCyMTwbD2h7ruDUjMEtHD7EHtNVEK): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394556228 (328h28m53.82563635s) [noise=true , address=77.90.31.18:4829 , piece_id=2JQR4SJKQ5TSLI3I2MYOBVVBSXP6D575AL3G6ILOZBFXJY2Y4KRQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1548pzNGffaMonic7dMK5VtZhLHtae3iffd9wjfjyTCp4XJ7Lo): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394576687 (328h28m53.825656818s) [seg_pos={0 0}, upload=341747]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 09:54:59.394650749 (328h28m53.82573088s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 09:54:59.394654796 (328h28m53.825734928s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 09:54:59.684122445 (328h28m54.115202566s) [upload=341747]: Done uploading segments...
Aug 22 09:54:59.684141743 (328h28m54.115221864s) [upload=341747]: Upload finished. err: <nil>
Duration: 5.587885062s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....XX......................................................] duration:
1.828076157s
FAIL (2025-08-22 09:56:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 09:14:17.953419544 (327h48m12.384499675s) [upload=341042]: Starting upload Aug 22 09:14:17.953469550 (327h48m12.384549741s) [upload=341042]: Done starting upload Aug 22 09:14:17.953547469 (327h48m12.3846276s) [upload=341042]: Uploading segments... Aug 22 09:14:17.953592926 (327h48m12.384673057s) [upload=341042]: Got next segment. Inline: true Aug 22 09:14:17.953604819 (327h48m12.384685s) [upload=341042]: Waiting for error group managing segments... Aug 22 09:14:17.953667248 (327h48m12.384747429s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 09:14:17.953675263 (327h48m12.384755444s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 09:14:17.953681525 (327h48m12.384761686s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 09:14:18.172663380 (327h48m12.603743511s) [upload=341042]: Done uploading segments... Aug 22 09:14:18.172682727 (327h48m12.603762848s) [upload=341042]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.828099644s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [...........X.........X.......XX....XX....................X..] duration:
5.766268755s
FAIL (2025-08-22 09:56:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 847589912590ca78359fcb1602d5a39c0c337e01c5ccbde72debf5b20baae03e != before 82a1fe65e07d59753c7c43f13f07946896e91335fe46ee860af09c1a6fb90a6c
======LOGS======
Aug 22 09:54:56.911505118 (328h28m51.342585249s) [upload=341747]: Starting upload
Aug 22 09:54:56.911554011 (328h28m51.342634142s) [upload=341747]: Done starting upload
Aug 22 09:54:56.911671677 (328h28m51.342751808s) [upload=341747]: Uploading segments...
Aug 22 09:54:56.911818718 (328h28m51.342898849s) [upload=341747]: Got next segment. Inline: false
Aug 22 09:54:56.911858754 (328h28m51.342938885s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 09:54:56.911863875 (328h28m51.342944006s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 09:54:57.359755375 (328h28m51.790835506s) [seg_pos={0 0}, upload=341747]: Begin upload segment...
Aug 22 09:54:57.359795892 (328h28m51.790876023s) [seg_pos={0 0}, upload=341747]: Done begin upload segment.
Aug 22 09:54:57.359814508 (328h28m51.790894639s) [noise=true , address=79.127.219.51:4215 , piece_id=ILMNVNEHSUM2UHG4GV3E2JRC6FUCGDNIQHSIMPX4VCNXBETTPFGA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.360211587 (328h28m51.791291719s) [noise=true , address=104.36.82.20:4456 , piece_id=KNAZ7ZCBIWQHBXIJPKQSTFUJE3TYI3U476D5YOMTNKOAFUHBJK2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.360473349 (328h28m51.79155348s) [noise=true , address=77.90.31.12:4595 , piece_id=SALDOXOWWNE6J2QM6L6HZCOMB6SV6MBM6KUXIRKNDDXF2INWVJZA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.360738086 (328h28m51.791818217s) [noise=true , address=79.127.205.233:4629 , piece_id=EJDBZ6ORQJOLSI7IXBGRMWRNUMKSXPHDTTKY5ZDPRJVFTWJV6P2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.361079008 (328h28m51.792159169s) [noise=true , address=104.36.82.10:4089 , piece_id=L2B4SOCDFKAJG4IFKPROEOY46DYTB6XW3Q5ZRTUHLNDJ5TF72LGA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.361469715 (328h28m51.792549846s) [noise=true , address=104.36.82.5:4859 , piece_id=JU27MEOIYGVW26TTB55GHTJAOY5HHHQTZYFPOHC2EEX5UESXJTLQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.361827670 (328h28m51.792907801s) [noise=true , address=45.91.116.11:4141 , piece_id=XS7HMYWARKQPHVWJQFFRNXSDZANE2HEPUGZ2IG2AZVYY6NV7BPJQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.362147011 (328h28m51.793227142s) [noise=true , address=77.90.31.19:4868 , piece_id=4OI4TZR2J4S4G5HDL2AU46KB324CYLECR2VUX2BOJAOETKLKGD2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.363452789 (328h28m51.79453292s) [noise=true , address=77.90.31.11:4585 , piece_id=CPDMLWXJAGX5CC5AXTRBAMIWTV4KTVXJ5PMRBHLKMEG7UPSNWRXQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.363678431 (328h28m51.794758563s) [noise=true , address=77.90.31.16:4766 , piece_id=2VYF3FZKYPTAJZSUY6XS4KAMUJ6KARTKI5EKFD66D5CWSIMNMJWQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.363890837 (328h28m51.794970968s) [noise=true , address=79.127.219.47:4061 , piece_id=PIOMHBN5YRLCBGPOHE54ETRGJNCZQW5SACWNDXRWO5PFBDUUQCAA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364158820 (328h28m51.795238951s) [noise=true , address=45.91.116.9:4289 , piece_id=5YIG5V7I5CFFHE34CJ4FPE2J7ULTM6CCZ3UMQ356OSYWGNGJKRSQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364384913 (328h28m51.795465044s) [noise=true , address=104.36.82.9:4034 , piece_id=5RFSFAPS6VA7N64FK2MBF2QKXPKRC4M4O65CBT6MDFGXDHDXL3XQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364598892 (328h28m51.795679033s) [noise=true , address=77.90.31.18:4829 , piece_id=2JQR4SJKQ5TSLI3I2MYOBVVBSXP6D575AL3G6ILOZBFXJY2Y4KRQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364807522 (328h28m51.795887653s) [noise=true , address=104.36.82.9:4015 , piece_id=7RAOMT3G5TKWJTPCLWC2NJ52M7ZX5RRIVC5LZQMRPU77XLCUZNRQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.365010119 (328h28m51.79609024s) [noise=true , address=77.90.31.10:4526 , piece_id=PSR7U3K4EP3KN5R2F3DGWTERLVG2Y7G7OEVCWBLCYPISMQCMAUSQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.365354328 (328h28m51.796434459s) [noise=true , address=79.127.201.215:4360 , piece_id=CRVCMZLSFTJS5EGCSRGVS2573QHIR3R2HNRNV5U2XMAWOLT4UW2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.365692665 (328h28m51.796772796s) [noise=true , address=156.146.43.225:4462 , piece_id=ERS5G5N2F2DOEGDTZ57L33RRXH5U747K7UWKH23IKLWRSTW3UEZQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:58.471074170 (328h28m52.902154291s) [upload=341747]: Next returned nil segment
Aug 22 09:54:58.471087335 (328h28m52.902167466s) [upload=341747]: Waiting for error group managing segments...
Aug 22 09:54:58.754503277 (328h28m53.185583408s) [noise=true , address=79.127.205.233:4629 , piece_id=EJDBZ6ORQJOLSI7IXBGRMWRNUMKSXPHDTTKY5ZDPRJVFTWJV6P2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.238695222 (328h28m53.669775353s) [noise=true , address=79.127.219.47:4061 , piece_id=PIOMHBN5YRLCBGPOHE54ETRGJNCZQW5SACWNDXRWO5PFBDUUQCAA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.260480245 (328h28m53.691560376s) [noise=true , address=45.91.116.9:4289 , piece_id=5YIG5V7I5CFFHE34CJ4FPE2J7ULTM6CCZ3UMQ356OSYWGNGJKRSQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.265556919 (328h28m53.69663705s) [noise=true , address=77.90.31.11:4585 , piece_id=CPDMLWXJAGX5CC5AXTRBAMIWTV4KTVXJ5PMRBHLKMEG7UPSNWRXQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.274213371 (328h28m53.705293502s) [noise=true , address=79.127.219.51:4215 , piece_id=ILMNVNEHSUM2UHG4GV3E2JRC6FUCGDNIQHSIMPX4VCNXBETTPFGA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.282223667 (328h28m53.713303828s) [noise=true , address=104.36.82.10:4089 , piece_id=L2B4SOCDFKAJG4IFKPROEOY46DYTB6XW3Q5ZRTUHLNDJ5TF72LGA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.331417983 (328h28m53.762498104s) [noise=true , address=104.36.82.9:4034 , piece_id=5RFSFAPS6VA7N64FK2MBF2QKXPKRC4M4O65CBT6MDFGXDHDXL3XQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.338786451 (328h28m53.769866572s) [noise=true , address=156.146.43.225:4462 , piece_id=ERS5G5N2F2DOEGDTZ57L33RRXH5U747K7UWKH23IKLWRSTW3UEZQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.350935406 (328h28m53.782015537s) [noise=true , address=79.127.201.215:4360 , piece_id=CRVCMZLSFTJS5EGCSRGVS2573QHIR3R2HNRNV5U2XMAWOLT4UW2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.363548069 (328h28m53.7946282s) [noise=true , address=104.36.82.5:4859 , piece_id=JU27MEOIYGVW26TTB55GHTJAOY5HHHQTZYFPOHC2EEX5UESXJTLQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.365276126 (328h28m53.796356257s) [noise=true , address=77.90.31.10:4526 , piece_id=PSR7U3K4EP3KN5R2F3DGWTERLVG2Y7G7OEVCWBLCYPISMQCMAUSQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.386267599 (328h28m53.81734773s) [noise=true , address=77.90.31.19:4868 , piece_id=4OI4TZR2J4S4G5HDL2AU46KB324CYLECR2VUX2BOJAOETKLKGD2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.390848094 (328h28m53.821928225s) [noise=true , address=104.36.82.20:4456 , piece_id=KNAZ7ZCBIWQHBXIJPKQSTFUJE3TYI3U476D5YOMTNKOAFUHBJK2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.394281172 (328h28m53.825361303s) [noise=true , address=77.90.31.12:4595 , piece_id=SALDOXOWWNE6J2QM6L6HZCOMB6SV6MBM6KUXIRKNDDXF2INWVJZA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.394307763 (328h28m53.825387894s) [seg_pos={0 0}, upload=341747]: Segment reached optimal threshold of 14 pieces.
Aug 22 09:54:59.394454273 (328h28m53.825534394s) [noise=true , address=45.91.116.11:4141 , piece_id=XS7HMYWARKQPHVWJQFFRNXSDZANE2HEPUGZ2IG2AZVYY6NV7BPJQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394467608 (328h28m53.825547739s) [noise=true , address=104.36.82.9:4015 , piece_id=7RAOMT3G5TKWJTPCLWC2NJ52M7ZX5RRIVC5LZQMRPU77XLCUZNRQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KXaAs7ZW21xGPAZRVUxGMBgH78eejQ2kxEm5CQR5ZdQvzZd6o): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394536000 (328h28m53.825616131s) [noise=true , address=77.90.31.16:4766 , piece_id=2VYF3FZKYPTAJZSUY6XS4KAMUJ6KARTKI5EKFD66D5CWSIMNMJWQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1V8iMvJLcTddWZihWQBQLLCyMTwbD2h7ruDUjMEtHD7EHtNVEK): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394556228 (328h28m53.82563635s) [noise=true , address=77.90.31.18:4829 , piece_id=2JQR4SJKQ5TSLI3I2MYOBVVBSXP6D575AL3G6ILOZBFXJY2Y4KRQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1548pzNGffaMonic7dMK5VtZhLHtae3iffd9wjfjyTCp4XJ7Lo): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394576687 (328h28m53.825656818s) [seg_pos={0 0}, upload=341747]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 09:54:59.394650749 (328h28m53.82573088s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 09:54:59.394654796 (328h28m53.825734928s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 09:54:59.684122445 (328h28m54.115202566s) [upload=341747]: Done uploading segments...
Aug 22 09:54:59.684141743 (328h28m54.115221864s) [upload=341747]: Upload finished. err: <nil>
Duration: 5.766299614s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration:
1.841312956s
FAIL (2025-08-22 09:56:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 09:14:17.953419544 (327h48m12.384499675s) [upload=341042]: Starting upload Aug 22 09:14:17.953469550 (327h48m12.384549741s) [upload=341042]: Done starting upload Aug 22 09:14:17.953547469 (327h48m12.3846276s) [upload=341042]: Uploading segments... Aug 22 09:14:17.953592926 (327h48m12.384673057s) [upload=341042]: Got next segment. Inline: true Aug 22 09:14:17.953604819 (327h48m12.384685s) [upload=341042]: Waiting for error group managing segments... Aug 22 09:14:17.953667248 (327h48m12.384747429s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 09:14:17.953675263 (327h48m12.384755444s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 09:14:17.953681525 (327h48m12.384761686s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 09:14:18.172663380 (327h48m12.603743511s) [upload=341042]: Done uploading segments... Aug 22 09:14:18.172682727 (327h48m12.603762848s) [upload=341042]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.841342622s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [............X.........X.......XX....XX....................X.] duration:
5.637973621s
FAIL (2025-08-22 09:56:07 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 847589912590ca78359fcb1602d5a39c0c337e01c5ccbde72debf5b20baae03e != before 82a1fe65e07d59753c7c43f13f07946896e91335fe46ee860af09c1a6fb90a6c
======LOGS======
Aug 22 09:54:56.911505118 (328h28m51.342585249s) [upload=341747]: Starting upload
Aug 22 09:54:56.911554011 (328h28m51.342634142s) [upload=341747]: Done starting upload
Aug 22 09:54:56.911671677 (328h28m51.342751808s) [upload=341747]: Uploading segments...
Aug 22 09:54:56.911818718 (328h28m51.342898849s) [upload=341747]: Got next segment. Inline: false
Aug 22 09:54:56.911858754 (328h28m51.342938885s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 09:54:56.911863875 (328h28m51.342944006s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 09:54:57.359755375 (328h28m51.790835506s) [seg_pos={0 0}, upload=341747]: Begin upload segment...
Aug 22 09:54:57.359795892 (328h28m51.790876023s) [seg_pos={0 0}, upload=341747]: Done begin upload segment.
Aug 22 09:54:57.359814508 (328h28m51.790894639s) [noise=true , address=79.127.219.51:4215 , piece_id=ILMNVNEHSUM2UHG4GV3E2JRC6FUCGDNIQHSIMPX4VCNXBETTPFGA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.360211587 (328h28m51.791291719s) [noise=true , address=104.36.82.20:4456 , piece_id=KNAZ7ZCBIWQHBXIJPKQSTFUJE3TYI3U476D5YOMTNKOAFUHBJK2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.360473349 (328h28m51.79155348s) [noise=true , address=77.90.31.12:4595 , piece_id=SALDOXOWWNE6J2QM6L6HZCOMB6SV6MBM6KUXIRKNDDXF2INWVJZA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.360738086 (328h28m51.791818217s) [noise=true , address=79.127.205.233:4629 , piece_id=EJDBZ6ORQJOLSI7IXBGRMWRNUMKSXPHDTTKY5ZDPRJVFTWJV6P2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.361079008 (328h28m51.792159169s) [noise=true , address=104.36.82.10:4089 , piece_id=L2B4SOCDFKAJG4IFKPROEOY46DYTB6XW3Q5ZRTUHLNDJ5TF72LGA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.361469715 (328h28m51.792549846s) [noise=true , address=104.36.82.5:4859 , piece_id=JU27MEOIYGVW26TTB55GHTJAOY5HHHQTZYFPOHC2EEX5UESXJTLQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.361827670 (328h28m51.792907801s) [noise=true , address=45.91.116.11:4141 , piece_id=XS7HMYWARKQPHVWJQFFRNXSDZANE2HEPUGZ2IG2AZVYY6NV7BPJQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.362147011 (328h28m51.793227142s) [noise=true , address=77.90.31.19:4868 , piece_id=4OI4TZR2J4S4G5HDL2AU46KB324CYLECR2VUX2BOJAOETKLKGD2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.363452789 (328h28m51.79453292s) [noise=true , address=77.90.31.11:4585 , piece_id=CPDMLWXJAGX5CC5AXTRBAMIWTV4KTVXJ5PMRBHLKMEG7UPSNWRXQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.363678431 (328h28m51.794758563s) [noise=true , address=77.90.31.16:4766 , piece_id=2VYF3FZKYPTAJZSUY6XS4KAMUJ6KARTKI5EKFD66D5CWSIMNMJWQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.363890837 (328h28m51.794970968s) [noise=true , address=79.127.219.47:4061 , piece_id=PIOMHBN5YRLCBGPOHE54ETRGJNCZQW5SACWNDXRWO5PFBDUUQCAA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364158820 (328h28m51.795238951s) [noise=true , address=45.91.116.9:4289 , piece_id=5YIG5V7I5CFFHE34CJ4FPE2J7ULTM6CCZ3UMQ356OSYWGNGJKRSQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364384913 (328h28m51.795465044s) [noise=true , address=104.36.82.9:4034 , piece_id=5RFSFAPS6VA7N64FK2MBF2QKXPKRC4M4O65CBT6MDFGXDHDXL3XQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364598892 (328h28m51.795679033s) [noise=true , address=77.90.31.18:4829 , piece_id=2JQR4SJKQ5TSLI3I2MYOBVVBSXP6D575AL3G6ILOZBFXJY2Y4KRQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364807522 (328h28m51.795887653s) [noise=true , address=104.36.82.9:4015 , piece_id=7RAOMT3G5TKWJTPCLWC2NJ52M7ZX5RRIVC5LZQMRPU77XLCUZNRQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.365010119 (328h28m51.79609024s) [noise=true , address=77.90.31.10:4526 , piece_id=PSR7U3K4EP3KN5R2F3DGWTERLVG2Y7G7OEVCWBLCYPISMQCMAUSQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.365354328 (328h28m51.796434459s) [noise=true , address=79.127.201.215:4360 , piece_id=CRVCMZLSFTJS5EGCSRGVS2573QHIR3R2HNRNV5U2XMAWOLT4UW2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.365692665 (328h28m51.796772796s) [noise=true , address=156.146.43.225:4462 , piece_id=ERS5G5N2F2DOEGDTZ57L33RRXH5U747K7UWKH23IKLWRSTW3UEZQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:58.471074170 (328h28m52.902154291s) [upload=341747]: Next returned nil segment
Aug 22 09:54:58.471087335 (328h28m52.902167466s) [upload=341747]: Waiting for error group managing segments...
Aug 22 09:54:58.754503277 (328h28m53.185583408s) [noise=true , address=79.127.205.233:4629 , piece_id=EJDBZ6ORQJOLSI7IXBGRMWRNUMKSXPHDTTKY5ZDPRJVFTWJV6P2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.238695222 (328h28m53.669775353s) [noise=true , address=79.127.219.47:4061 , piece_id=PIOMHBN5YRLCBGPOHE54ETRGJNCZQW5SACWNDXRWO5PFBDUUQCAA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.260480245 (328h28m53.691560376s) [noise=true , address=45.91.116.9:4289 , piece_id=5YIG5V7I5CFFHE34CJ4FPE2J7ULTM6CCZ3UMQ356OSYWGNGJKRSQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.265556919 (328h28m53.69663705s) [noise=true , address=77.90.31.11:4585 , piece_id=CPDMLWXJAGX5CC5AXTRBAMIWTV4KTVXJ5PMRBHLKMEG7UPSNWRXQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.274213371 (328h28m53.705293502s) [noise=true , address=79.127.219.51:4215 , piece_id=ILMNVNEHSUM2UHG4GV3E2JRC6FUCGDNIQHSIMPX4VCNXBETTPFGA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.282223667 (328h28m53.713303828s) [noise=true , address=104.36.82.10:4089 , piece_id=L2B4SOCDFKAJG4IFKPROEOY46DYTB6XW3Q5ZRTUHLNDJ5TF72LGA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.331417983 (328h28m53.762498104s) [noise=true , address=104.36.82.9:4034 , piece_id=5RFSFAPS6VA7N64FK2MBF2QKXPKRC4M4O65CBT6MDFGXDHDXL3XQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.338786451 (328h28m53.769866572s) [noise=true , address=156.146.43.225:4462 , piece_id=ERS5G5N2F2DOEGDTZ57L33RRXH5U747K7UWKH23IKLWRSTW3UEZQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.350935406 (328h28m53.782015537s) [noise=true , address=79.127.201.215:4360 , piece_id=CRVCMZLSFTJS5EGCSRGVS2573QHIR3R2HNRNV5U2XMAWOLT4UW2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.363548069 (328h28m53.7946282s) [noise=true , address=104.36.82.5:4859 , piece_id=JU27MEOIYGVW26TTB55GHTJAOY5HHHQTZYFPOHC2EEX5UESXJTLQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.365276126 (328h28m53.796356257s) [noise=true , address=77.90.31.10:4526 , piece_id=PSR7U3K4EP3KN5R2F3DGWTERLVG2Y7G7OEVCWBLCYPISMQCMAUSQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.386267599 (328h28m53.81734773s) [noise=true , address=77.90.31.19:4868 , piece_id=4OI4TZR2J4S4G5HDL2AU46KB324CYLECR2VUX2BOJAOETKLKGD2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.390848094 (328h28m53.821928225s) [noise=true , address=104.36.82.20:4456 , piece_id=KNAZ7ZCBIWQHBXIJPKQSTFUJE3TYI3U476D5YOMTNKOAFUHBJK2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.394281172 (328h28m53.825361303s) [noise=true , address=77.90.31.12:4595 , piece_id=SALDOXOWWNE6J2QM6L6HZCOMB6SV6MBM6KUXIRKNDDXF2INWVJZA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.394307763 (328h28m53.825387894s) [seg_pos={0 0}, upload=341747]: Segment reached optimal threshold of 14 pieces.
Aug 22 09:54:59.394454273 (328h28m53.825534394s) [noise=true , address=45.91.116.11:4141 , piece_id=XS7HMYWARKQPHVWJQFFRNXSDZANE2HEPUGZ2IG2AZVYY6NV7BPJQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394467608 (328h28m53.825547739s) [noise=true , address=104.36.82.9:4015 , piece_id=7RAOMT3G5TKWJTPCLWC2NJ52M7ZX5RRIVC5LZQMRPU77XLCUZNRQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KXaAs7ZW21xGPAZRVUxGMBgH78eejQ2kxEm5CQR5ZdQvzZd6o): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394536000 (328h28m53.825616131s) [noise=true , address=77.90.31.16:4766 , piece_id=2VYF3FZKYPTAJZSUY6XS4KAMUJ6KARTKI5EKFD66D5CWSIMNMJWQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1V8iMvJLcTddWZihWQBQLLCyMTwbD2h7ruDUjMEtHD7EHtNVEK): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394556228 (328h28m53.82563635s) [noise=true , address=77.90.31.18:4829 , piece_id=2JQR4SJKQ5TSLI3I2MYOBVVBSXP6D575AL3G6ILOZBFXJY2Y4KRQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1548pzNGffaMonic7dMK5VtZhLHtae3iffd9wjfjyTCp4XJ7Lo): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394576687 (328h28m53.825656818s) [seg_pos={0 0}, upload=341747]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 09:54:59.394650749 (328h28m53.82573088s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 09:54:59.394654796 (328h28m53.825734928s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 09:54:59.684122445 (328h28m54.115202566s) [upload=341747]: Done uploading segments...
Aug 22 09:54:59.684141743 (328h28m54.115221864s) [upload=341747]: Upload finished. err: <nil>
Duration: 5.638003849s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......XX....................................................] duration:
2.047840372s
FAIL (2025-08-22 09:55:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 09:14:17.953419544 (327h48m12.384499675s) [upload=341042]: Starting upload Aug 22 09:14:17.953469550 (327h48m12.384549741s) [upload=341042]: Done starting upload Aug 22 09:14:17.953547469 (327h48m12.3846276s) [upload=341042]: Uploading segments... Aug 22 09:14:17.953592926 (327h48m12.384673057s) [upload=341042]: Got next segment. Inline: true Aug 22 09:14:17.953604819 (327h48m12.384685s) [upload=341042]: Waiting for error group managing segments... Aug 22 09:14:17.953667248 (327h48m12.384747429s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 09:14:17.953675263 (327h48m12.384755444s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 09:14:17.953681525 (327h48m12.384761686s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 09:14:18.172663380 (327h48m12.603743511s) [upload=341042]: Done uploading segments... Aug 22 09:14:18.172682727 (327h48m12.603762848s) [upload=341042]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.047858938s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.............X.........X.......XX....XX....................X] duration:
5.547911098s
FAIL (2025-08-22 09:55:01 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 847589912590ca78359fcb1602d5a39c0c337e01c5ccbde72debf5b20baae03e != before 82a1fe65e07d59753c7c43f13f07946896e91335fe46ee860af09c1a6fb90a6c
======LOGS======
Aug 22 09:54:56.911505118 (328h28m51.342585249s) [upload=341747]: Starting upload
Aug 22 09:54:56.911554011 (328h28m51.342634142s) [upload=341747]: Done starting upload
Aug 22 09:54:56.911671677 (328h28m51.342751808s) [upload=341747]: Uploading segments...
Aug 22 09:54:56.911818718 (328h28m51.342898849s) [upload=341747]: Got next segment. Inline: false
Aug 22 09:54:56.911858754 (328h28m51.342938885s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 09:54:56.911863875 (328h28m51.342944006s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 09:54:57.359755375 (328h28m51.790835506s) [seg_pos={0 0}, upload=341747]: Begin upload segment...
Aug 22 09:54:57.359795892 (328h28m51.790876023s) [seg_pos={0 0}, upload=341747]: Done begin upload segment.
Aug 22 09:54:57.359814508 (328h28m51.790894639s) [noise=true , address=79.127.219.51:4215 , piece_id=ILMNVNEHSUM2UHG4GV3E2JRC6FUCGDNIQHSIMPX4VCNXBETTPFGA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.360211587 (328h28m51.791291719s) [noise=true , address=104.36.82.20:4456 , piece_id=KNAZ7ZCBIWQHBXIJPKQSTFUJE3TYI3U476D5YOMTNKOAFUHBJK2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.360473349 (328h28m51.79155348s) [noise=true , address=77.90.31.12:4595 , piece_id=SALDOXOWWNE6J2QM6L6HZCOMB6SV6MBM6KUXIRKNDDXF2INWVJZA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.360738086 (328h28m51.791818217s) [noise=true , address=79.127.205.233:4629 , piece_id=EJDBZ6ORQJOLSI7IXBGRMWRNUMKSXPHDTTKY5ZDPRJVFTWJV6P2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.361079008 (328h28m51.792159169s) [noise=true , address=104.36.82.10:4089 , piece_id=L2B4SOCDFKAJG4IFKPROEOY46DYTB6XW3Q5ZRTUHLNDJ5TF72LGA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.361469715 (328h28m51.792549846s) [noise=true , address=104.36.82.5:4859 , piece_id=JU27MEOIYGVW26TTB55GHTJAOY5HHHQTZYFPOHC2EEX5UESXJTLQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.361827670 (328h28m51.792907801s) [noise=true , address=45.91.116.11:4141 , piece_id=XS7HMYWARKQPHVWJQFFRNXSDZANE2HEPUGZ2IG2AZVYY6NV7BPJQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.362147011 (328h28m51.793227142s) [noise=true , address=77.90.31.19:4868 , piece_id=4OI4TZR2J4S4G5HDL2AU46KB324CYLECR2VUX2BOJAOETKLKGD2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.363452789 (328h28m51.79453292s) [noise=true , address=77.90.31.11:4585 , piece_id=CPDMLWXJAGX5CC5AXTRBAMIWTV4KTVXJ5PMRBHLKMEG7UPSNWRXQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.363678431 (328h28m51.794758563s) [noise=true , address=77.90.31.16:4766 , piece_id=2VYF3FZKYPTAJZSUY6XS4KAMUJ6KARTKI5EKFD66D5CWSIMNMJWQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.363890837 (328h28m51.794970968s) [noise=true , address=79.127.219.47:4061 , piece_id=PIOMHBN5YRLCBGPOHE54ETRGJNCZQW5SACWNDXRWO5PFBDUUQCAA, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364158820 (328h28m51.795238951s) [noise=true , address=45.91.116.9:4289 , piece_id=5YIG5V7I5CFFHE34CJ4FPE2J7ULTM6CCZ3UMQ356OSYWGNGJKRSQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364384913 (328h28m51.795465044s) [noise=true , address=104.36.82.9:4034 , piece_id=5RFSFAPS6VA7N64FK2MBF2QKXPKRC4M4O65CBT6MDFGXDHDXL3XQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364598892 (328h28m51.795679033s) [noise=true , address=77.90.31.18:4829 , piece_id=2JQR4SJKQ5TSLI3I2MYOBVVBSXP6D575AL3G6ILOZBFXJY2Y4KRQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.364807522 (328h28m51.795887653s) [noise=true , address=104.36.82.9:4015 , piece_id=7RAOMT3G5TKWJTPCLWC2NJ52M7ZX5RRIVC5LZQMRPU77XLCUZNRQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.365010119 (328h28m51.79609024s) [noise=true , address=77.90.31.10:4526 , piece_id=PSR7U3K4EP3KN5R2F3DGWTERLVG2Y7G7OEVCWBLCYPISMQCMAUSQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.365354328 (328h28m51.796434459s) [noise=true , address=79.127.201.215:4360 , piece_id=CRVCMZLSFTJS5EGCSRGVS2573QHIR3R2HNRNV5U2XMAWOLT4UW2Q, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:57.365692665 (328h28m51.796772796s) [noise=true , address=156.146.43.225:4462 , piece_id=ERS5G5N2F2DOEGDTZ57L33RRXH5U747K7UWKH23IKLWRSTW3UEZQ, seg_pos={0 0}, upload=341747]: Uploading piece...
Aug 22 09:54:58.471074170 (328h28m52.902154291s) [upload=341747]: Next returned nil segment
Aug 22 09:54:58.471087335 (328h28m52.902167466s) [upload=341747]: Waiting for error group managing segments...
Aug 22 09:54:58.754503277 (328h28m53.185583408s) [noise=true , address=79.127.205.233:4629 , piece_id=EJDBZ6ORQJOLSI7IXBGRMWRNUMKSXPHDTTKY5ZDPRJVFTWJV6P2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.238695222 (328h28m53.669775353s) [noise=true , address=79.127.219.47:4061 , piece_id=PIOMHBN5YRLCBGPOHE54ETRGJNCZQW5SACWNDXRWO5PFBDUUQCAA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.260480245 (328h28m53.691560376s) [noise=true , address=45.91.116.9:4289 , piece_id=5YIG5V7I5CFFHE34CJ4FPE2J7ULTM6CCZ3UMQ356OSYWGNGJKRSQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.265556919 (328h28m53.69663705s) [noise=true , address=77.90.31.11:4585 , piece_id=CPDMLWXJAGX5CC5AXTRBAMIWTV4KTVXJ5PMRBHLKMEG7UPSNWRXQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.274213371 (328h28m53.705293502s) [noise=true , address=79.127.219.51:4215 , piece_id=ILMNVNEHSUM2UHG4GV3E2JRC6FUCGDNIQHSIMPX4VCNXBETTPFGA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.282223667 (328h28m53.713303828s) [noise=true , address=104.36.82.10:4089 , piece_id=L2B4SOCDFKAJG4IFKPROEOY46DYTB6XW3Q5ZRTUHLNDJ5TF72LGA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.331417983 (328h28m53.762498104s) [noise=true , address=104.36.82.9:4034 , piece_id=5RFSFAPS6VA7N64FK2MBF2QKXPKRC4M4O65CBT6MDFGXDHDXL3XQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.338786451 (328h28m53.769866572s) [noise=true , address=156.146.43.225:4462 , piece_id=ERS5G5N2F2DOEGDTZ57L33RRXH5U747K7UWKH23IKLWRSTW3UEZQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.350935406 (328h28m53.782015537s) [noise=true , address=79.127.201.215:4360 , piece_id=CRVCMZLSFTJS5EGCSRGVS2573QHIR3R2HNRNV5U2XMAWOLT4UW2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.363548069 (328h28m53.7946282s) [noise=true , address=104.36.82.5:4859 , piece_id=JU27MEOIYGVW26TTB55GHTJAOY5HHHQTZYFPOHC2EEX5UESXJTLQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.365276126 (328h28m53.796356257s) [noise=true , address=77.90.31.10:4526 , piece_id=PSR7U3K4EP3KN5R2F3DGWTERLVG2Y7G7OEVCWBLCYPISMQCMAUSQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.386267599 (328h28m53.81734773s) [noise=true , address=77.90.31.19:4868 , piece_id=4OI4TZR2J4S4G5HDL2AU46KB324CYLECR2VUX2BOJAOETKLKGD2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.390848094 (328h28m53.821928225s) [noise=true , address=104.36.82.20:4456 , piece_id=KNAZ7ZCBIWQHBXIJPKQSTFUJE3TYI3U476D5YOMTNKOAFUHBJK2Q, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.394281172 (328h28m53.825361303s) [noise=true , address=77.90.31.12:4595 , piece_id=SALDOXOWWNE6J2QM6L6HZCOMB6SV6MBM6KUXIRKNDDXF2INWVJZA, seg_pos={0 0}, upload=341747]: Done uploading piece. err: <nil>
Aug 22 09:54:59.394307763 (328h28m53.825387894s) [seg_pos={0 0}, upload=341747]: Segment reached optimal threshold of 14 pieces.
Aug 22 09:54:59.394454273 (328h28m53.825534394s) [noise=true , address=45.91.116.11:4141 , piece_id=XS7HMYWARKQPHVWJQFFRNXSDZANE2HEPUGZ2IG2AZVYY6NV7BPJQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394467608 (328h28m53.825547739s) [noise=true , address=104.36.82.9:4015 , piece_id=7RAOMT3G5TKWJTPCLWC2NJ52M7ZX5RRIVC5LZQMRPU77XLCUZNRQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KXaAs7ZW21xGPAZRVUxGMBgH78eejQ2kxEm5CQR5ZdQvzZd6o): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394536000 (328h28m53.825616131s) [noise=true , address=77.90.31.16:4766 , piece_id=2VYF3FZKYPTAJZSUY6XS4KAMUJ6KARTKI5EKFD66D5CWSIMNMJWQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1V8iMvJLcTddWZihWQBQLLCyMTwbD2h7ruDUjMEtHD7EHtNVEK): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394556228 (328h28m53.82563635s) [noise=true , address=77.90.31.18:4829 , piece_id=2JQR4SJKQ5TSLI3I2MYOBVVBSXP6D575AL3G6ILOZBFXJY2Y4KRQ, seg_pos={0 0}, upload=341747]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1548pzNGffaMonic7dMK5VtZhLHtae3iffd9wjfjyTCp4XJ7Lo): protocol: expected piece hash; context canceled; EOF
Aug 22 09:54:59.394576687 (328h28m53.825656818s) [seg_pos={0 0}, upload=341747]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 09:54:59.394650749 (328h28m53.82573088s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 09:54:59.394654796 (328h28m53.825734928s) [upload=341747]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 09:54:59.684122445 (328h28m54.115202566s) [upload=341747]: Done uploading segments...
Aug 22 09:54:59.684141743 (328h28m54.115221864s) [upload=341747]: Upload finished. err: <nil>
Duration: 5.547934524s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......XX...................................................] duration:
1.860151661s
FAIL (2025-08-22 09:54:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 09:14:17.953419544 (327h48m12.384499675s) [upload=341042]: Starting upload Aug 22 09:14:17.953469550 (327h48m12.384549741s) [upload=341042]: Done starting upload Aug 22 09:14:17.953547469 (327h48m12.3846276s) [upload=341042]: Uploading segments... Aug 22 09:14:17.953592926 (327h48m12.384673057s) [upload=341042]: Got next segment. Inline: true Aug 22 09:14:17.953604819 (327h48m12.384685s) [upload=341042]: Waiting for error group managing segments... Aug 22 09:14:17.953667248 (327h48m12.384747429s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 09:14:17.953675263 (327h48m12.384755444s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 09:14:17.953681525 (327h48m12.384761686s) [upload=341042]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 09:14:18.172663380 (327h48m12.603743511s) [upload=341042]: Done uploading segments... Aug 22 09:14:18.172682727 (327h48m12.603762848s) [upload=341042]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.860176277s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..............X.........X.......XX....XX....................] duration:
5.628065071s
FAIL (2025-08-22 09:53:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 09:40:16.070148069 (328h14m10.5012282s) [upload=341496]: Starting upload Aug 22 09:40:16.070214086 (328h14m10.501294217s) [upload=341496]: Done starting upload Aug 22 09:40:16.070319938 (328h14m10.50140008s) [upload=341496]: Uploading segments... Aug 22 09:40:16.070437764 (328h14m10.501517895s) [upload=341496]: Got next segment. Inline: false Aug 22 09:40:16.070491336 (328h14m10.501571467s) [upload=341496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 09:40:16.070502267 (328h14m10.501582408s) [upload=341496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 09:40:16.286541732 (328h14m10.717621863s) [upload=341496]: Next segment err: metaclient: Too Many Requests Aug 22 09:40:16.286575707 (328h14m10.717655868s) [upload=341496]: Done uploading segments... Aug 22 09:40:16.286593471 (328h14m10.717673612s) [upload=341496]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.628088827s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...............X.........X.......XX....XX...................] duration:
5.628718132s
FAIL (2025-08-22 09:53:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 09:40:16.070148069 (328h14m10.5012282s) [upload=341496]: Starting upload Aug 22 09:40:16.070214086 (328h14m10.501294217s) [upload=341496]: Done starting upload Aug 22 09:40:16.070319938 (328h14m10.50140008s) [upload=341496]: Uploading segments... Aug 22 09:40:16.070437764 (328h14m10.501517895s) [upload=341496]: Got next segment. Inline: false Aug 22 09:40:16.070491336 (328h14m10.501571467s) [upload=341496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 09:40:16.070502267 (328h14m10.501582408s) [upload=341496]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 09:40:16.286541732 (328h14m10.717621863s) [upload=341496]: Next segment err: metaclient: Too Many Requests Aug 22 09:40:16.286575707 (328h14m10.717655868s) [upload=341496]: Done uploading segments... Aug 22 09:40:16.286593471 (328h14m10.717673612s) [upload=341496]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.628740995s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|