Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X.................X........................] duration:
10.130516189s
FAIL (2025-08-09 21:51:50 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 21:32:58.743646467 (28h6m53.174726598s) [upload=29343]: Starting upload
Aug 9 21:32:58.743707774 (28h6m53.174787895s) [upload=29343]: Done starting upload
Aug 9 21:32:58.743801404 (28h6m53.174881535s) [upload=29343]: Uploading segments...
Aug 9 21:32:58.743883340 (28h6m53.174963471s) [upload=29343]: Got next segment. Inline: false
Aug 9 21:32:58.743930660 (28h6m53.175010791s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:32:58.743935861 (28h6m53.175015992s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 21:32:59.213889759 (28h6m53.64496989s) [seg_pos={0 0}, upload=29343]: Begin upload segment...
Aug 9 21:32:59.213970373 (28h6m53.645050494s) [seg_pos={0 0}, upload=29343]: Done begin upload segment.
Aug 9 21:32:59.214016252 (28h6m53.645096383s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214021141 (28h6m53.645101262s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214113617 (28h6m53.645193738s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214380749 (28h6m53.64546088s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214575822 (28h6m53.645655953s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214639604 (28h6m53.645719725s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214858843 (28h6m53.645938974s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214918126 (28h6m53.645998257s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215173295 (28h6m53.646253426s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215453160 (28h6m53.646533292s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215701466 (28h6m53.646781597s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215973536 (28h6m53.647053667s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216225959 (28h6m53.64730609s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216496968 (28h6m53.647577099s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216838721 (28h6m53.647918852s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217048964 (28h6m53.648129095s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217270928 (28h6m53.648351059s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217477994 (28h6m53.648558125s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:33:00.343481141 (28h6m54.774561272s) [upload=29343]: Next returned nil segment
Aug 9 21:33:00.343503263 (28h6m54.774583394s) [upload=29343]: Waiting for error group managing segments...
Aug 9 21:33:00.655564794 (28h6m55.086644925s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.676424365 (28h6m55.107504496s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.829706864 (28h6m55.260786995s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.119772961 (28h6m55.550853092s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.228012387 (28h6m55.659092528s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.233337386 (28h6m55.664417517s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235146947 (28h6m55.666227078s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235544097 (28h6m55.666624228s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.254624233 (28h6m55.685704375s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.323238895 (28h6m55.754319026s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.342654263 (28h6m55.773734404s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.437118842 (28h6m55.868198973s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.435393639 (28h6m57.86647377s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672630779 (28h6m58.10371091s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672663021 (28h6m58.103743172s) [seg_pos={0 0}, upload=29343]: Segment reached optimal threshold of 14 pieces.
Aug 9 21:33:03.673039952 (28h6m58.104120083s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: context canceled; context canceled
Aug 9 21:33:03.673057105 (28h6m58.104137236s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dGFWNmsuheRmfEfNGWHftPpCcWv7HHXKymgJxsye6P7ZKhZT): protocol: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection
Aug 9 21:33:03.673101660 (28h6m58.104181792s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DHKWSFHcN6FYabUR9Q8vpe7duLcyZmEPcDmqvvcQHDGm4bpvu): protocol: rpc: dial tcp 104.36.82.3:4779: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673118292 (28h6m58.104198423s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: rpc: dial tcp 104.36.82.43:4835: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673130946 (28h6m58.104211077s) [seg_pos={0 0}, upload=29343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 21:33:03.673200138 (28h6m58.104280269s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 21:33:03.673203915 (28h6m58.104284036s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:33:03.974816035 (28h6m58.405896166s) [upload=29343]: Done uploading segments...
Aug 9 21:33:03.974835111 (28h6m58.405915242s) [upload=29343]: Upload finished. err: <nil>
Duration: 10.130545385s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X.......X...................X.............] duration:
1.927754853s
FAIL (2025-08-09 21:51:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 21:40:20.835326620 (28h14m15.266406751s) [upload=29467]: Starting upload Aug 9 21:40:20.835376275 (28h14m15.266456407s) [upload=29467]: Done starting upload Aug 9 21:40:20.835435859 (28h14m15.26651598s) [upload=29467]: Uploading segments... Aug 9 21:40:20.835474494 (28h14m15.266554615s) [upload=29467]: Got next segment. Inline: true Aug 9 21:40:20.835478682 (28h14m15.266558813s) [upload=29467]: Waiting for error group managing segments... Aug 9 21:40:20.835516063 (28h14m15.266596194s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 21:40:20.835520561 (28h14m15.266600682s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 21:40:20.835523187 (28h14m15.266603318s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 21:40:21.049591667 (28h14m15.480671808s) [upload=29467]: Done uploading segments... Aug 9 21:40:21.049611705 (28h14m15.480691836s) [upload=29467]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.927783149s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X.......X...................X............] duration:
1.983635267s
FAIL (2025-08-09 21:50:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 21:40:20.835326620 (28h14m15.266406751s) [upload=29467]: Starting upload Aug 9 21:40:20.835376275 (28h14m15.266456407s) [upload=29467]: Done starting upload Aug 9 21:40:20.835435859 (28h14m15.26651598s) [upload=29467]: Uploading segments... Aug 9 21:40:20.835474494 (28h14m15.266554615s) [upload=29467]: Got next segment. Inline: true Aug 9 21:40:20.835478682 (28h14m15.266558813s) [upload=29467]: Waiting for error group managing segments... Aug 9 21:40:20.835516063 (28h14m15.266596194s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 21:40:20.835520561 (28h14m15.266600682s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 21:40:20.835523187 (28h14m15.266603318s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 21:40:21.049591667 (28h14m15.480671808s) [upload=29467]: Done uploading segments... Aug 9 21:40:21.049611705 (28h14m15.480691836s) [upload=29467]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.983660816s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X.................X.......................] duration:
6.74718079s
FAIL (2025-08-09 21:50:50 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 21:32:58.743646467 (28h6m53.174726598s) [upload=29343]: Starting upload
Aug 9 21:32:58.743707774 (28h6m53.174787895s) [upload=29343]: Done starting upload
Aug 9 21:32:58.743801404 (28h6m53.174881535s) [upload=29343]: Uploading segments...
Aug 9 21:32:58.743883340 (28h6m53.174963471s) [upload=29343]: Got next segment. Inline: false
Aug 9 21:32:58.743930660 (28h6m53.175010791s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:32:58.743935861 (28h6m53.175015992s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 21:32:59.213889759 (28h6m53.64496989s) [seg_pos={0 0}, upload=29343]: Begin upload segment...
Aug 9 21:32:59.213970373 (28h6m53.645050494s) [seg_pos={0 0}, upload=29343]: Done begin upload segment.
Aug 9 21:32:59.214016252 (28h6m53.645096383s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214021141 (28h6m53.645101262s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214113617 (28h6m53.645193738s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214380749 (28h6m53.64546088s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214575822 (28h6m53.645655953s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214639604 (28h6m53.645719725s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214858843 (28h6m53.645938974s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214918126 (28h6m53.645998257s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215173295 (28h6m53.646253426s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215453160 (28h6m53.646533292s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215701466 (28h6m53.646781597s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215973536 (28h6m53.647053667s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216225959 (28h6m53.64730609s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216496968 (28h6m53.647577099s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216838721 (28h6m53.647918852s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217048964 (28h6m53.648129095s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217270928 (28h6m53.648351059s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217477994 (28h6m53.648558125s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:33:00.343481141 (28h6m54.774561272s) [upload=29343]: Next returned nil segment
Aug 9 21:33:00.343503263 (28h6m54.774583394s) [upload=29343]: Waiting for error group managing segments...
Aug 9 21:33:00.655564794 (28h6m55.086644925s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.676424365 (28h6m55.107504496s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.829706864 (28h6m55.260786995s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.119772961 (28h6m55.550853092s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.228012387 (28h6m55.659092528s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.233337386 (28h6m55.664417517s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235146947 (28h6m55.666227078s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235544097 (28h6m55.666624228s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.254624233 (28h6m55.685704375s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.323238895 (28h6m55.754319026s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.342654263 (28h6m55.773734404s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.437118842 (28h6m55.868198973s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.435393639 (28h6m57.86647377s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672630779 (28h6m58.10371091s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672663021 (28h6m58.103743172s) [seg_pos={0 0}, upload=29343]: Segment reached optimal threshold of 14 pieces.
Aug 9 21:33:03.673039952 (28h6m58.104120083s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: context canceled; context canceled
Aug 9 21:33:03.673057105 (28h6m58.104137236s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dGFWNmsuheRmfEfNGWHftPpCcWv7HHXKymgJxsye6P7ZKhZT): protocol: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection
Aug 9 21:33:03.673101660 (28h6m58.104181792s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DHKWSFHcN6FYabUR9Q8vpe7duLcyZmEPcDmqvvcQHDGm4bpvu): protocol: rpc: dial tcp 104.36.82.3:4779: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673118292 (28h6m58.104198423s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: rpc: dial tcp 104.36.82.43:4835: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673130946 (28h6m58.104211077s) [seg_pos={0 0}, upload=29343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 21:33:03.673200138 (28h6m58.104280269s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 21:33:03.673203915 (28h6m58.104284036s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:33:03.974816035 (28h6m58.405896166s) [upload=29343]: Done uploading segments...
Aug 9 21:33:03.974835111 (28h6m58.405915242s) [upload=29343]: Upload finished. err: <nil>
Duration: 6.74720191s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X.......X...................X...........] duration:
1.92577301s
FAIL (2025-08-09 21:50:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 21:40:20.835326620 (28h14m15.266406751s) [upload=29467]: Starting upload Aug 9 21:40:20.835376275 (28h14m15.266456407s) [upload=29467]: Done starting upload Aug 9 21:40:20.835435859 (28h14m15.26651598s) [upload=29467]: Uploading segments... Aug 9 21:40:20.835474494 (28h14m15.266554615s) [upload=29467]: Got next segment. Inline: true Aug 9 21:40:20.835478682 (28h14m15.266558813s) [upload=29467]: Waiting for error group managing segments... Aug 9 21:40:20.835516063 (28h14m15.266596194s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 21:40:20.835520561 (28h14m15.266600682s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 21:40:20.835523187 (28h14m15.266603318s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 21:40:21.049591667 (28h14m15.480671808s) [upload=29467]: Done uploading segments... Aug 9 21:40:21.049611705 (28h14m15.480691836s) [upload=29467]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.925794921s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X.................X......................] duration:
9.756886579s
FAIL (2025-08-09 21:49:45 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 21:32:58.743646467 (28h6m53.174726598s) [upload=29343]: Starting upload
Aug 9 21:32:58.743707774 (28h6m53.174787895s) [upload=29343]: Done starting upload
Aug 9 21:32:58.743801404 (28h6m53.174881535s) [upload=29343]: Uploading segments...
Aug 9 21:32:58.743883340 (28h6m53.174963471s) [upload=29343]: Got next segment. Inline: false
Aug 9 21:32:58.743930660 (28h6m53.175010791s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:32:58.743935861 (28h6m53.175015992s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 21:32:59.213889759 (28h6m53.64496989s) [seg_pos={0 0}, upload=29343]: Begin upload segment...
Aug 9 21:32:59.213970373 (28h6m53.645050494s) [seg_pos={0 0}, upload=29343]: Done begin upload segment.
Aug 9 21:32:59.214016252 (28h6m53.645096383s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214021141 (28h6m53.645101262s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214113617 (28h6m53.645193738s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214380749 (28h6m53.64546088s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214575822 (28h6m53.645655953s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214639604 (28h6m53.645719725s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214858843 (28h6m53.645938974s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214918126 (28h6m53.645998257s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215173295 (28h6m53.646253426s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215453160 (28h6m53.646533292s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215701466 (28h6m53.646781597s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215973536 (28h6m53.647053667s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216225959 (28h6m53.64730609s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216496968 (28h6m53.647577099s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216838721 (28h6m53.647918852s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217048964 (28h6m53.648129095s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217270928 (28h6m53.648351059s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217477994 (28h6m53.648558125s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:33:00.343481141 (28h6m54.774561272s) [upload=29343]: Next returned nil segment
Aug 9 21:33:00.343503263 (28h6m54.774583394s) [upload=29343]: Waiting for error group managing segments...
Aug 9 21:33:00.655564794 (28h6m55.086644925s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.676424365 (28h6m55.107504496s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.829706864 (28h6m55.260786995s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.119772961 (28h6m55.550853092s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.228012387 (28h6m55.659092528s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.233337386 (28h6m55.664417517s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235146947 (28h6m55.666227078s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235544097 (28h6m55.666624228s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.254624233 (28h6m55.685704375s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.323238895 (28h6m55.754319026s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.342654263 (28h6m55.773734404s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.437118842 (28h6m55.868198973s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.435393639 (28h6m57.86647377s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672630779 (28h6m58.10371091s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672663021 (28h6m58.103743172s) [seg_pos={0 0}, upload=29343]: Segment reached optimal threshold of 14 pieces.
Aug 9 21:33:03.673039952 (28h6m58.104120083s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: context canceled; context canceled
Aug 9 21:33:03.673057105 (28h6m58.104137236s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dGFWNmsuheRmfEfNGWHftPpCcWv7HHXKymgJxsye6P7ZKhZT): protocol: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection
Aug 9 21:33:03.673101660 (28h6m58.104181792s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DHKWSFHcN6FYabUR9Q8vpe7duLcyZmEPcDmqvvcQHDGm4bpvu): protocol: rpc: dial tcp 104.36.82.3:4779: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673118292 (28h6m58.104198423s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: rpc: dial tcp 104.36.82.43:4835: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673130946 (28h6m58.104211077s) [seg_pos={0 0}, upload=29343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 21:33:03.673200138 (28h6m58.104280269s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 21:33:03.673203915 (28h6m58.104284036s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:33:03.974816035 (28h6m58.405896166s) [upload=29343]: Done uploading segments...
Aug 9 21:33:03.974835111 (28h6m58.405915242s) [upload=29343]: Upload finished. err: <nil>
Duration: 9.756906167s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X.......X...................X..........] duration:
1.933901899s
FAIL (2025-08-09 21:49:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 21:40:20.835326620 (28h14m15.266406751s) [upload=29467]: Starting upload Aug 9 21:40:20.835376275 (28h14m15.266456407s) [upload=29467]: Done starting upload Aug 9 21:40:20.835435859 (28h14m15.26651598s) [upload=29467]: Uploading segments... Aug 9 21:40:20.835474494 (28h14m15.266554615s) [upload=29467]: Got next segment. Inline: true Aug 9 21:40:20.835478682 (28h14m15.266558813s) [upload=29467]: Waiting for error group managing segments... Aug 9 21:40:20.835516063 (28h14m15.266596194s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 21:40:20.835520561 (28h14m15.266600682s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 21:40:20.835523187 (28h14m15.266603318s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 21:40:21.049591667 (28h14m15.480671808s) [upload=29467]: Done uploading segments... Aug 9 21:40:21.049611705 (28h14m15.480691836s) [upload=29467]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.933972774s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X.................X.....................] duration:
6.847405663s
FAIL (2025-08-09 21:48:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 21:32:58.743646467 (28h6m53.174726598s) [upload=29343]: Starting upload
Aug 9 21:32:58.743707774 (28h6m53.174787895s) [upload=29343]: Done starting upload
Aug 9 21:32:58.743801404 (28h6m53.174881535s) [upload=29343]: Uploading segments...
Aug 9 21:32:58.743883340 (28h6m53.174963471s) [upload=29343]: Got next segment. Inline: false
Aug 9 21:32:58.743930660 (28h6m53.175010791s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:32:58.743935861 (28h6m53.175015992s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 21:32:59.213889759 (28h6m53.64496989s) [seg_pos={0 0}, upload=29343]: Begin upload segment...
Aug 9 21:32:59.213970373 (28h6m53.645050494s) [seg_pos={0 0}, upload=29343]: Done begin upload segment.
Aug 9 21:32:59.214016252 (28h6m53.645096383s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214021141 (28h6m53.645101262s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214113617 (28h6m53.645193738s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214380749 (28h6m53.64546088s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214575822 (28h6m53.645655953s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214639604 (28h6m53.645719725s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214858843 (28h6m53.645938974s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214918126 (28h6m53.645998257s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215173295 (28h6m53.646253426s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215453160 (28h6m53.646533292s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215701466 (28h6m53.646781597s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215973536 (28h6m53.647053667s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216225959 (28h6m53.64730609s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216496968 (28h6m53.647577099s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216838721 (28h6m53.647918852s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217048964 (28h6m53.648129095s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217270928 (28h6m53.648351059s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217477994 (28h6m53.648558125s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:33:00.343481141 (28h6m54.774561272s) [upload=29343]: Next returned nil segment
Aug 9 21:33:00.343503263 (28h6m54.774583394s) [upload=29343]: Waiting for error group managing segments...
Aug 9 21:33:00.655564794 (28h6m55.086644925s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.676424365 (28h6m55.107504496s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.829706864 (28h6m55.260786995s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.119772961 (28h6m55.550853092s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.228012387 (28h6m55.659092528s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.233337386 (28h6m55.664417517s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235146947 (28h6m55.666227078s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235544097 (28h6m55.666624228s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.254624233 (28h6m55.685704375s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.323238895 (28h6m55.754319026s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.342654263 (28h6m55.773734404s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.437118842 (28h6m55.868198973s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.435393639 (28h6m57.86647377s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672630779 (28h6m58.10371091s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672663021 (28h6m58.103743172s) [seg_pos={0 0}, upload=29343]: Segment reached optimal threshold of 14 pieces.
Aug 9 21:33:03.673039952 (28h6m58.104120083s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: context canceled; context canceled
Aug 9 21:33:03.673057105 (28h6m58.104137236s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dGFWNmsuheRmfEfNGWHftPpCcWv7HHXKymgJxsye6P7ZKhZT): protocol: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection
Aug 9 21:33:03.673101660 (28h6m58.104181792s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DHKWSFHcN6FYabUR9Q8vpe7duLcyZmEPcDmqvvcQHDGm4bpvu): protocol: rpc: dial tcp 104.36.82.3:4779: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673118292 (28h6m58.104198423s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: rpc: dial tcp 104.36.82.43:4835: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673130946 (28h6m58.104211077s) [seg_pos={0 0}, upload=29343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 21:33:03.673200138 (28h6m58.104280269s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 21:33:03.673203915 (28h6m58.104284036s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:33:03.974816035 (28h6m58.405896166s) [upload=29343]: Done uploading segments...
Aug 9 21:33:03.974835111 (28h6m58.405915242s) [upload=29343]: Upload finished. err: <nil>
Duration: 6.847433084s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X.......X...................X.........] duration:
1.842169318s
FAIL (2025-08-09 21:48:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 21:40:20.835326620 (28h14m15.266406751s) [upload=29467]: Starting upload Aug 9 21:40:20.835376275 (28h14m15.266456407s) [upload=29467]: Done starting upload Aug 9 21:40:20.835435859 (28h14m15.26651598s) [upload=29467]: Uploading segments... Aug 9 21:40:20.835474494 (28h14m15.266554615s) [upload=29467]: Got next segment. Inline: true Aug 9 21:40:20.835478682 (28h14m15.266558813s) [upload=29467]: Waiting for error group managing segments... Aug 9 21:40:20.835516063 (28h14m15.266596194s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 21:40:20.835520561 (28h14m15.266600682s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 21:40:20.835523187 (28h14m15.266603318s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 21:40:21.049591667 (28h14m15.480671808s) [upload=29467]: Done uploading segments... Aug 9 21:40:21.049611705 (28h14m15.480691836s) [upload=29467]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.842193674s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......................X.......X...................X........] duration:
1.950416411s
FAIL (2025-08-09 21:47:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 21:40:20.835326620 (28h14m15.266406751s) [upload=29467]: Starting upload Aug 9 21:40:20.835376275 (28h14m15.266456407s) [upload=29467]: Done starting upload Aug 9 21:40:20.835435859 (28h14m15.26651598s) [upload=29467]: Uploading segments... Aug 9 21:40:20.835474494 (28h14m15.266554615s) [upload=29467]: Got next segment. Inline: true Aug 9 21:40:20.835478682 (28h14m15.266558813s) [upload=29467]: Waiting for error group managing segments... Aug 9 21:40:20.835516063 (28h14m15.266596194s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 21:40:20.835520561 (28h14m15.266600682s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 21:40:20.835523187 (28h14m15.266603318s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 21:40:21.049591667 (28h14m15.480671808s) [upload=29467]: Done uploading segments... Aug 9 21:40:21.049611705 (28h14m15.480691836s) [upload=29467]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.950440116s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X.................X....................] duration:
6.632254546s
FAIL (2025-08-09 21:47:35 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 21:32:58.743646467 (28h6m53.174726598s) [upload=29343]: Starting upload
Aug 9 21:32:58.743707774 (28h6m53.174787895s) [upload=29343]: Done starting upload
Aug 9 21:32:58.743801404 (28h6m53.174881535s) [upload=29343]: Uploading segments...
Aug 9 21:32:58.743883340 (28h6m53.174963471s) [upload=29343]: Got next segment. Inline: false
Aug 9 21:32:58.743930660 (28h6m53.175010791s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:32:58.743935861 (28h6m53.175015992s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 21:32:59.213889759 (28h6m53.64496989s) [seg_pos={0 0}, upload=29343]: Begin upload segment...
Aug 9 21:32:59.213970373 (28h6m53.645050494s) [seg_pos={0 0}, upload=29343]: Done begin upload segment.
Aug 9 21:32:59.214016252 (28h6m53.645096383s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214021141 (28h6m53.645101262s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214113617 (28h6m53.645193738s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214380749 (28h6m53.64546088s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214575822 (28h6m53.645655953s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214639604 (28h6m53.645719725s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214858843 (28h6m53.645938974s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214918126 (28h6m53.645998257s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215173295 (28h6m53.646253426s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215453160 (28h6m53.646533292s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215701466 (28h6m53.646781597s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215973536 (28h6m53.647053667s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216225959 (28h6m53.64730609s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216496968 (28h6m53.647577099s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216838721 (28h6m53.647918852s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217048964 (28h6m53.648129095s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217270928 (28h6m53.648351059s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217477994 (28h6m53.648558125s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:33:00.343481141 (28h6m54.774561272s) [upload=29343]: Next returned nil segment
Aug 9 21:33:00.343503263 (28h6m54.774583394s) [upload=29343]: Waiting for error group managing segments...
Aug 9 21:33:00.655564794 (28h6m55.086644925s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.676424365 (28h6m55.107504496s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.829706864 (28h6m55.260786995s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.119772961 (28h6m55.550853092s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.228012387 (28h6m55.659092528s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.233337386 (28h6m55.664417517s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235146947 (28h6m55.666227078s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235544097 (28h6m55.666624228s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.254624233 (28h6m55.685704375s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.323238895 (28h6m55.754319026s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.342654263 (28h6m55.773734404s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.437118842 (28h6m55.868198973s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.435393639 (28h6m57.86647377s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672630779 (28h6m58.10371091s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672663021 (28h6m58.103743172s) [seg_pos={0 0}, upload=29343]: Segment reached optimal threshold of 14 pieces.
Aug 9 21:33:03.673039952 (28h6m58.104120083s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: context canceled; context canceled
Aug 9 21:33:03.673057105 (28h6m58.104137236s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dGFWNmsuheRmfEfNGWHftPpCcWv7HHXKymgJxsye6P7ZKhZT): protocol: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection
Aug 9 21:33:03.673101660 (28h6m58.104181792s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DHKWSFHcN6FYabUR9Q8vpe7duLcyZmEPcDmqvvcQHDGm4bpvu): protocol: rpc: dial tcp 104.36.82.3:4779: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673118292 (28h6m58.104198423s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: rpc: dial tcp 104.36.82.43:4835: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673130946 (28h6m58.104211077s) [seg_pos={0 0}, upload=29343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 21:33:03.673200138 (28h6m58.104280269s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 21:33:03.673203915 (28h6m58.104284036s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:33:03.974816035 (28h6m58.405896166s) [upload=29343]: Done uploading segments...
Aug 9 21:33:03.974835111 (28h6m58.405915242s) [upload=29343]: Upload finished. err: <nil>
Duration: 6.632337626s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X.....................X.................X...................] duration:
7.088494923s
FAIL (2025-08-09 21:46:54 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 21:32:58.743646467 (28h6m53.174726598s) [upload=29343]: Starting upload
Aug 9 21:32:58.743707774 (28h6m53.174787895s) [upload=29343]: Done starting upload
Aug 9 21:32:58.743801404 (28h6m53.174881535s) [upload=29343]: Uploading segments...
Aug 9 21:32:58.743883340 (28h6m53.174963471s) [upload=29343]: Got next segment. Inline: false
Aug 9 21:32:58.743930660 (28h6m53.175010791s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:32:58.743935861 (28h6m53.175015992s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 21:32:59.213889759 (28h6m53.64496989s) [seg_pos={0 0}, upload=29343]: Begin upload segment...
Aug 9 21:32:59.213970373 (28h6m53.645050494s) [seg_pos={0 0}, upload=29343]: Done begin upload segment.
Aug 9 21:32:59.214016252 (28h6m53.645096383s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214021141 (28h6m53.645101262s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214113617 (28h6m53.645193738s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214380749 (28h6m53.64546088s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214575822 (28h6m53.645655953s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214639604 (28h6m53.645719725s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214858843 (28h6m53.645938974s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214918126 (28h6m53.645998257s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215173295 (28h6m53.646253426s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215453160 (28h6m53.646533292s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215701466 (28h6m53.646781597s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215973536 (28h6m53.647053667s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216225959 (28h6m53.64730609s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216496968 (28h6m53.647577099s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216838721 (28h6m53.647918852s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217048964 (28h6m53.648129095s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217270928 (28h6m53.648351059s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217477994 (28h6m53.648558125s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:33:00.343481141 (28h6m54.774561272s) [upload=29343]: Next returned nil segment
Aug 9 21:33:00.343503263 (28h6m54.774583394s) [upload=29343]: Waiting for error group managing segments...
Aug 9 21:33:00.655564794 (28h6m55.086644925s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.676424365 (28h6m55.107504496s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.829706864 (28h6m55.260786995s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.119772961 (28h6m55.550853092s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.228012387 (28h6m55.659092528s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.233337386 (28h6m55.664417517s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235146947 (28h6m55.666227078s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235544097 (28h6m55.666624228s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.254624233 (28h6m55.685704375s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.323238895 (28h6m55.754319026s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.342654263 (28h6m55.773734404s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.437118842 (28h6m55.868198973s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.435393639 (28h6m57.86647377s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672630779 (28h6m58.10371091s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672663021 (28h6m58.103743172s) [seg_pos={0 0}, upload=29343]: Segment reached optimal threshold of 14 pieces.
Aug 9 21:33:03.673039952 (28h6m58.104120083s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: context canceled; context canceled
Aug 9 21:33:03.673057105 (28h6m58.104137236s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dGFWNmsuheRmfEfNGWHftPpCcWv7HHXKymgJxsye6P7ZKhZT): protocol: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection
Aug 9 21:33:03.673101660 (28h6m58.104181792s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DHKWSFHcN6FYabUR9Q8vpe7duLcyZmEPcDmqvvcQHDGm4bpvu): protocol: rpc: dial tcp 104.36.82.3:4779: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673118292 (28h6m58.104198423s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: rpc: dial tcp 104.36.82.43:4835: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673130946 (28h6m58.104211077s) [seg_pos={0 0}, upload=29343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 21:33:03.673200138 (28h6m58.104280269s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 21:33:03.673203915 (28h6m58.104284036s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:33:03.974816035 (28h6m58.405896166s) [upload=29343]: Done uploading segments...
Aug 9 21:33:03.974835111 (28h6m58.405915242s) [upload=29343]: Upload finished. err: <nil>
Duration: 7.088520974s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........................X.......X...................X.......] duration:
1.958676881s
FAIL (2025-08-09 21:46:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 21:40:20.835326620 (28h14m15.266406751s) [upload=29467]: Starting upload Aug 9 21:40:20.835376275 (28h14m15.266456407s) [upload=29467]: Done starting upload Aug 9 21:40:20.835435859 (28h14m15.26651598s) [upload=29467]: Uploading segments... Aug 9 21:40:20.835474494 (28h14m15.266554615s) [upload=29467]: Got next segment. Inline: true Aug 9 21:40:20.835478682 (28h14m15.266558813s) [upload=29467]: Waiting for error group managing segments... Aug 9 21:40:20.835516063 (28h14m15.266596194s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 21:40:20.835520561 (28h14m15.266600682s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 21:40:20.835523187 (28h14m15.266603318s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 21:40:21.049591667 (28h14m15.480671808s) [upload=29467]: Done uploading segments... Aug 9 21:40:21.049611705 (28h14m15.480691836s) [upload=29467]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.958703022s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........................X.......X...................X......] duration:
2.015786093s
FAIL (2025-08-09 21:46:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 21:40:20.835326620 (28h14m15.266406751s) [upload=29467]: Starting upload Aug 9 21:40:20.835376275 (28h14m15.266456407s) [upload=29467]: Done starting upload Aug 9 21:40:20.835435859 (28h14m15.26651598s) [upload=29467]: Uploading segments... Aug 9 21:40:20.835474494 (28h14m15.266554615s) [upload=29467]: Got next segment. Inline: true Aug 9 21:40:20.835478682 (28h14m15.266558813s) [upload=29467]: Waiting for error group managing segments... Aug 9 21:40:20.835516063 (28h14m15.266596194s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 21:40:20.835520561 (28h14m15.266600682s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 21:40:20.835523187 (28h14m15.266603318s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 21:40:21.049591667 (28h14m15.480671808s) [upload=29467]: Done uploading segments... Aug 9 21:40:21.049611705 (28h14m15.480691836s) [upload=29467]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.01582126s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X.....................X.................X..................] duration:
25.131362053s
FAIL (2025-08-09 21:46:05 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 21:32:58.743646467 (28h6m53.174726598s) [upload=29343]: Starting upload
Aug 9 21:32:58.743707774 (28h6m53.174787895s) [upload=29343]: Done starting upload
Aug 9 21:32:58.743801404 (28h6m53.174881535s) [upload=29343]: Uploading segments...
Aug 9 21:32:58.743883340 (28h6m53.174963471s) [upload=29343]: Got next segment. Inline: false
Aug 9 21:32:58.743930660 (28h6m53.175010791s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:32:58.743935861 (28h6m53.175015992s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 21:32:59.213889759 (28h6m53.64496989s) [seg_pos={0 0}, upload=29343]: Begin upload segment...
Aug 9 21:32:59.213970373 (28h6m53.645050494s) [seg_pos={0 0}, upload=29343]: Done begin upload segment.
Aug 9 21:32:59.214016252 (28h6m53.645096383s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214021141 (28h6m53.645101262s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214113617 (28h6m53.645193738s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214380749 (28h6m53.64546088s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214575822 (28h6m53.645655953s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214639604 (28h6m53.645719725s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214858843 (28h6m53.645938974s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214918126 (28h6m53.645998257s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215173295 (28h6m53.646253426s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215453160 (28h6m53.646533292s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215701466 (28h6m53.646781597s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215973536 (28h6m53.647053667s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216225959 (28h6m53.64730609s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216496968 (28h6m53.647577099s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216838721 (28h6m53.647918852s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217048964 (28h6m53.648129095s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217270928 (28h6m53.648351059s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217477994 (28h6m53.648558125s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:33:00.343481141 (28h6m54.774561272s) [upload=29343]: Next returned nil segment
Aug 9 21:33:00.343503263 (28h6m54.774583394s) [upload=29343]: Waiting for error group managing segments...
Aug 9 21:33:00.655564794 (28h6m55.086644925s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.676424365 (28h6m55.107504496s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.829706864 (28h6m55.260786995s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.119772961 (28h6m55.550853092s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.228012387 (28h6m55.659092528s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.233337386 (28h6m55.664417517s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235146947 (28h6m55.666227078s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235544097 (28h6m55.666624228s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.254624233 (28h6m55.685704375s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.323238895 (28h6m55.754319026s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.342654263 (28h6m55.773734404s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.437118842 (28h6m55.868198973s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.435393639 (28h6m57.86647377s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672630779 (28h6m58.10371091s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672663021 (28h6m58.103743172s) [seg_pos={0 0}, upload=29343]: Segment reached optimal threshold of 14 pieces.
Aug 9 21:33:03.673039952 (28h6m58.104120083s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: context canceled; context canceled
Aug 9 21:33:03.673057105 (28h6m58.104137236s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dGFWNmsuheRmfEfNGWHftPpCcWv7HHXKymgJxsye6P7ZKhZT): protocol: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection
Aug 9 21:33:03.673101660 (28h6m58.104181792s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DHKWSFHcN6FYabUR9Q8vpe7duLcyZmEPcDmqvvcQHDGm4bpvu): protocol: rpc: dial tcp 104.36.82.3:4779: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673118292 (28h6m58.104198423s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: rpc: dial tcp 104.36.82.43:4835: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673130946 (28h6m58.104211077s) [seg_pos={0 0}, upload=29343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 21:33:03.673200138 (28h6m58.104280269s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 21:33:03.673203915 (28h6m58.104284036s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:33:03.974816035 (28h6m58.405896166s) [upload=29343]: Done uploading segments...
Aug 9 21:33:03.974835111 (28h6m58.405915242s) [upload=29343]: Upload finished. err: <nil>
Duration: 25.131385256s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........................X.......X...................X.....] duration:
1.977550772s
FAIL (2025-08-09 21:45:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 21:40:20.835326620 (28h14m15.266406751s) [upload=29467]: Starting upload Aug 9 21:40:20.835376275 (28h14m15.266456407s) [upload=29467]: Done starting upload Aug 9 21:40:20.835435859 (28h14m15.26651598s) [upload=29467]: Uploading segments... Aug 9 21:40:20.835474494 (28h14m15.266554615s) [upload=29467]: Got next segment. Inline: true Aug 9 21:40:20.835478682 (28h14m15.266558813s) [upload=29467]: Waiting for error group managing segments... Aug 9 21:40:20.835516063 (28h14m15.266596194s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 21:40:20.835520561 (28h14m15.266600682s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 21:40:20.835523187 (28h14m15.266603318s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 21:40:21.049591667 (28h14m15.480671808s) [upload=29467]: Done uploading segments... Aug 9 21:40:21.049611705 (28h14m15.480691836s) [upload=29467]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.977576862s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X.....................X.................X.................] duration:
7.953700042s
FAIL (2025-08-09 21:45:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 21:32:58.743646467 (28h6m53.174726598s) [upload=29343]: Starting upload
Aug 9 21:32:58.743707774 (28h6m53.174787895s) [upload=29343]: Done starting upload
Aug 9 21:32:58.743801404 (28h6m53.174881535s) [upload=29343]: Uploading segments...
Aug 9 21:32:58.743883340 (28h6m53.174963471s) [upload=29343]: Got next segment. Inline: false
Aug 9 21:32:58.743930660 (28h6m53.175010791s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:32:58.743935861 (28h6m53.175015992s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 21:32:59.213889759 (28h6m53.64496989s) [seg_pos={0 0}, upload=29343]: Begin upload segment...
Aug 9 21:32:59.213970373 (28h6m53.645050494s) [seg_pos={0 0}, upload=29343]: Done begin upload segment.
Aug 9 21:32:59.214016252 (28h6m53.645096383s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214021141 (28h6m53.645101262s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214113617 (28h6m53.645193738s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214380749 (28h6m53.64546088s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214575822 (28h6m53.645655953s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214639604 (28h6m53.645719725s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214858843 (28h6m53.645938974s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214918126 (28h6m53.645998257s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215173295 (28h6m53.646253426s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215453160 (28h6m53.646533292s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215701466 (28h6m53.646781597s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215973536 (28h6m53.647053667s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216225959 (28h6m53.64730609s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216496968 (28h6m53.647577099s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216838721 (28h6m53.647918852s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217048964 (28h6m53.648129095s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217270928 (28h6m53.648351059s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217477994 (28h6m53.648558125s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:33:00.343481141 (28h6m54.774561272s) [upload=29343]: Next returned nil segment
Aug 9 21:33:00.343503263 (28h6m54.774583394s) [upload=29343]: Waiting for error group managing segments...
Aug 9 21:33:00.655564794 (28h6m55.086644925s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.676424365 (28h6m55.107504496s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.829706864 (28h6m55.260786995s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.119772961 (28h6m55.550853092s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.228012387 (28h6m55.659092528s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.233337386 (28h6m55.664417517s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235146947 (28h6m55.666227078s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235544097 (28h6m55.666624228s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.254624233 (28h6m55.685704375s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.323238895 (28h6m55.754319026s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.342654263 (28h6m55.773734404s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.437118842 (28h6m55.868198973s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.435393639 (28h6m57.86647377s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672630779 (28h6m58.10371091s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672663021 (28h6m58.103743172s) [seg_pos={0 0}, upload=29343]: Segment reached optimal threshold of 14 pieces.
Aug 9 21:33:03.673039952 (28h6m58.104120083s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: context canceled; context canceled
Aug 9 21:33:03.673057105 (28h6m58.104137236s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dGFWNmsuheRmfEfNGWHftPpCcWv7HHXKymgJxsye6P7ZKhZT): protocol: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection
Aug 9 21:33:03.673101660 (28h6m58.104181792s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DHKWSFHcN6FYabUR9Q8vpe7duLcyZmEPcDmqvvcQHDGm4bpvu): protocol: rpc: dial tcp 104.36.82.3:4779: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673118292 (28h6m58.104198423s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: rpc: dial tcp 104.36.82.43:4835: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673130946 (28h6m58.104211077s) [seg_pos={0 0}, upload=29343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 21:33:03.673200138 (28h6m58.104280269s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 21:33:03.673203915 (28h6m58.104284036s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:33:03.974816035 (28h6m58.405896166s) [upload=29343]: Done uploading segments...
Aug 9 21:33:03.974835111 (28h6m58.405915242s) [upload=29343]: Upload finished. err: <nil>
Duration: 7.953724708s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X.....................X.................X................] duration:
7.229981101s
FAIL (2025-08-09 21:44:34 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 21:32:58.743646467 (28h6m53.174726598s) [upload=29343]: Starting upload
Aug 9 21:32:58.743707774 (28h6m53.174787895s) [upload=29343]: Done starting upload
Aug 9 21:32:58.743801404 (28h6m53.174881535s) [upload=29343]: Uploading segments...
Aug 9 21:32:58.743883340 (28h6m53.174963471s) [upload=29343]: Got next segment. Inline: false
Aug 9 21:32:58.743930660 (28h6m53.175010791s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:32:58.743935861 (28h6m53.175015992s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 21:32:59.213889759 (28h6m53.64496989s) [seg_pos={0 0}, upload=29343]: Begin upload segment...
Aug 9 21:32:59.213970373 (28h6m53.645050494s) [seg_pos={0 0}, upload=29343]: Done begin upload segment.
Aug 9 21:32:59.214016252 (28h6m53.645096383s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214021141 (28h6m53.645101262s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214113617 (28h6m53.645193738s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214380749 (28h6m53.64546088s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214575822 (28h6m53.645655953s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214639604 (28h6m53.645719725s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214858843 (28h6m53.645938974s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214918126 (28h6m53.645998257s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215173295 (28h6m53.646253426s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215453160 (28h6m53.646533292s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215701466 (28h6m53.646781597s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215973536 (28h6m53.647053667s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216225959 (28h6m53.64730609s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216496968 (28h6m53.647577099s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216838721 (28h6m53.647918852s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217048964 (28h6m53.648129095s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217270928 (28h6m53.648351059s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217477994 (28h6m53.648558125s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:33:00.343481141 (28h6m54.774561272s) [upload=29343]: Next returned nil segment
Aug 9 21:33:00.343503263 (28h6m54.774583394s) [upload=29343]: Waiting for error group managing segments...
Aug 9 21:33:00.655564794 (28h6m55.086644925s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.676424365 (28h6m55.107504496s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.829706864 (28h6m55.260786995s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.119772961 (28h6m55.550853092s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.228012387 (28h6m55.659092528s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.233337386 (28h6m55.664417517s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235146947 (28h6m55.666227078s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235544097 (28h6m55.666624228s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.254624233 (28h6m55.685704375s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.323238895 (28h6m55.754319026s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.342654263 (28h6m55.773734404s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.437118842 (28h6m55.868198973s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.435393639 (28h6m57.86647377s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672630779 (28h6m58.10371091s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672663021 (28h6m58.103743172s) [seg_pos={0 0}, upload=29343]: Segment reached optimal threshold of 14 pieces.
Aug 9 21:33:03.673039952 (28h6m58.104120083s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: context canceled; context canceled
Aug 9 21:33:03.673057105 (28h6m58.104137236s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dGFWNmsuheRmfEfNGWHftPpCcWv7HHXKymgJxsye6P7ZKhZT): protocol: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection
Aug 9 21:33:03.673101660 (28h6m58.104181792s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DHKWSFHcN6FYabUR9Q8vpe7duLcyZmEPcDmqvvcQHDGm4bpvu): protocol: rpc: dial tcp 104.36.82.3:4779: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673118292 (28h6m58.104198423s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: rpc: dial tcp 104.36.82.43:4835: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673130946 (28h6m58.104211077s) [seg_pos={0 0}, upload=29343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 21:33:03.673200138 (28h6m58.104280269s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 21:33:03.673203915 (28h6m58.104284036s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:33:03.974816035 (28h6m58.405896166s) [upload=29343]: Done uploading segments...
Aug 9 21:33:03.974835111 (28h6m58.405915242s) [upload=29343]: Upload finished. err: <nil>
Duration: 7.23000693s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........................X.......X...................X....] duration:
1.862928918s
FAIL (2025-08-09 21:44:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 21:40:20.835326620 (28h14m15.266406751s) [upload=29467]: Starting upload Aug 9 21:40:20.835376275 (28h14m15.266456407s) [upload=29467]: Done starting upload Aug 9 21:40:20.835435859 (28h14m15.26651598s) [upload=29467]: Uploading segments... Aug 9 21:40:20.835474494 (28h14m15.266554615s) [upload=29467]: Got next segment. Inline: true Aug 9 21:40:20.835478682 (28h14m15.266558813s) [upload=29467]: Waiting for error group managing segments... Aug 9 21:40:20.835516063 (28h14m15.266596194s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 21:40:20.835520561 (28h14m15.266600682s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 21:40:20.835523187 (28h14m15.266603318s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 21:40:21.049591667 (28h14m15.480671808s) [upload=29467]: Done uploading segments... Aug 9 21:40:21.049611705 (28h14m15.480691836s) [upload=29467]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.862956449s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X.....................X.................X...............] duration:
9.23397437s
FAIL (2025-08-09 21:43:50 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 21:32:58.743646467 (28h6m53.174726598s) [upload=29343]: Starting upload
Aug 9 21:32:58.743707774 (28h6m53.174787895s) [upload=29343]: Done starting upload
Aug 9 21:32:58.743801404 (28h6m53.174881535s) [upload=29343]: Uploading segments...
Aug 9 21:32:58.743883340 (28h6m53.174963471s) [upload=29343]: Got next segment. Inline: false
Aug 9 21:32:58.743930660 (28h6m53.175010791s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:32:58.743935861 (28h6m53.175015992s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 21:32:59.213889759 (28h6m53.64496989s) [seg_pos={0 0}, upload=29343]: Begin upload segment...
Aug 9 21:32:59.213970373 (28h6m53.645050494s) [seg_pos={0 0}, upload=29343]: Done begin upload segment.
Aug 9 21:32:59.214016252 (28h6m53.645096383s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214021141 (28h6m53.645101262s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214113617 (28h6m53.645193738s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214380749 (28h6m53.64546088s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214575822 (28h6m53.645655953s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214639604 (28h6m53.645719725s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214858843 (28h6m53.645938974s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214918126 (28h6m53.645998257s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215173295 (28h6m53.646253426s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215453160 (28h6m53.646533292s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215701466 (28h6m53.646781597s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215973536 (28h6m53.647053667s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216225959 (28h6m53.64730609s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216496968 (28h6m53.647577099s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216838721 (28h6m53.647918852s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217048964 (28h6m53.648129095s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217270928 (28h6m53.648351059s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217477994 (28h6m53.648558125s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:33:00.343481141 (28h6m54.774561272s) [upload=29343]: Next returned nil segment
Aug 9 21:33:00.343503263 (28h6m54.774583394s) [upload=29343]: Waiting for error group managing segments...
Aug 9 21:33:00.655564794 (28h6m55.086644925s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.676424365 (28h6m55.107504496s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.829706864 (28h6m55.260786995s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.119772961 (28h6m55.550853092s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.228012387 (28h6m55.659092528s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.233337386 (28h6m55.664417517s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235146947 (28h6m55.666227078s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235544097 (28h6m55.666624228s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.254624233 (28h6m55.685704375s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.323238895 (28h6m55.754319026s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.342654263 (28h6m55.773734404s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.437118842 (28h6m55.868198973s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.435393639 (28h6m57.86647377s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672630779 (28h6m58.10371091s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672663021 (28h6m58.103743172s) [seg_pos={0 0}, upload=29343]: Segment reached optimal threshold of 14 pieces.
Aug 9 21:33:03.673039952 (28h6m58.104120083s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: context canceled; context canceled
Aug 9 21:33:03.673057105 (28h6m58.104137236s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dGFWNmsuheRmfEfNGWHftPpCcWv7HHXKymgJxsye6P7ZKhZT): protocol: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection
Aug 9 21:33:03.673101660 (28h6m58.104181792s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DHKWSFHcN6FYabUR9Q8vpe7duLcyZmEPcDmqvvcQHDGm4bpvu): protocol: rpc: dial tcp 104.36.82.3:4779: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673118292 (28h6m58.104198423s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: rpc: dial tcp 104.36.82.43:4835: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673130946 (28h6m58.104211077s) [seg_pos={0 0}, upload=29343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 21:33:03.673200138 (28h6m58.104280269s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 21:33:03.673203915 (28h6m58.104284036s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:33:03.974816035 (28h6m58.405896166s) [upload=29343]: Done uploading segments...
Aug 9 21:33:03.974835111 (28h6m58.405915242s) [upload=29343]: Upload finished. err: <nil>
Duration: 9.234001862s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............................X.......X...................X...] duration:
2.036793313s
FAIL (2025-08-09 21:43:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 21:40:20.835326620 (28h14m15.266406751s) [upload=29467]: Starting upload Aug 9 21:40:20.835376275 (28h14m15.266456407s) [upload=29467]: Done starting upload Aug 9 21:40:20.835435859 (28h14m15.26651598s) [upload=29467]: Uploading segments... Aug 9 21:40:20.835474494 (28h14m15.266554615s) [upload=29467]: Got next segment. Inline: true Aug 9 21:40:20.835478682 (28h14m15.266558813s) [upload=29467]: Waiting for error group managing segments... Aug 9 21:40:20.835516063 (28h14m15.266596194s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 21:40:20.835520561 (28h14m15.266600682s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 21:40:20.835523187 (28h14m15.266603318s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 21:40:21.049591667 (28h14m15.480671808s) [upload=29467]: Done uploading segments... Aug 9 21:40:21.049611705 (28h14m15.480691836s) [upload=29467]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.036820225s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X.....................X.................X..............] duration:
9.837376462s
FAIL (2025-08-09 21:42:57 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 21:32:58.743646467 (28h6m53.174726598s) [upload=29343]: Starting upload
Aug 9 21:32:58.743707774 (28h6m53.174787895s) [upload=29343]: Done starting upload
Aug 9 21:32:58.743801404 (28h6m53.174881535s) [upload=29343]: Uploading segments...
Aug 9 21:32:58.743883340 (28h6m53.174963471s) [upload=29343]: Got next segment. Inline: false
Aug 9 21:32:58.743930660 (28h6m53.175010791s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:32:58.743935861 (28h6m53.175015992s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 21:32:59.213889759 (28h6m53.64496989s) [seg_pos={0 0}, upload=29343]: Begin upload segment...
Aug 9 21:32:59.213970373 (28h6m53.645050494s) [seg_pos={0 0}, upload=29343]: Done begin upload segment.
Aug 9 21:32:59.214016252 (28h6m53.645096383s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214021141 (28h6m53.645101262s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214113617 (28h6m53.645193738s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214380749 (28h6m53.64546088s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214575822 (28h6m53.645655953s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214639604 (28h6m53.645719725s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214858843 (28h6m53.645938974s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214918126 (28h6m53.645998257s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215173295 (28h6m53.646253426s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215453160 (28h6m53.646533292s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215701466 (28h6m53.646781597s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215973536 (28h6m53.647053667s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216225959 (28h6m53.64730609s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216496968 (28h6m53.647577099s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216838721 (28h6m53.647918852s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217048964 (28h6m53.648129095s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217270928 (28h6m53.648351059s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217477994 (28h6m53.648558125s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:33:00.343481141 (28h6m54.774561272s) [upload=29343]: Next returned nil segment
Aug 9 21:33:00.343503263 (28h6m54.774583394s) [upload=29343]: Waiting for error group managing segments...
Aug 9 21:33:00.655564794 (28h6m55.086644925s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.676424365 (28h6m55.107504496s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.829706864 (28h6m55.260786995s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.119772961 (28h6m55.550853092s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.228012387 (28h6m55.659092528s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.233337386 (28h6m55.664417517s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235146947 (28h6m55.666227078s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235544097 (28h6m55.666624228s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.254624233 (28h6m55.685704375s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.323238895 (28h6m55.754319026s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.342654263 (28h6m55.773734404s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.437118842 (28h6m55.868198973s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.435393639 (28h6m57.86647377s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672630779 (28h6m58.10371091s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672663021 (28h6m58.103743172s) [seg_pos={0 0}, upload=29343]: Segment reached optimal threshold of 14 pieces.
Aug 9 21:33:03.673039952 (28h6m58.104120083s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: context canceled; context canceled
Aug 9 21:33:03.673057105 (28h6m58.104137236s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dGFWNmsuheRmfEfNGWHftPpCcWv7HHXKymgJxsye6P7ZKhZT): protocol: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection
Aug 9 21:33:03.673101660 (28h6m58.104181792s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DHKWSFHcN6FYabUR9Q8vpe7duLcyZmEPcDmqvvcQHDGm4bpvu): protocol: rpc: dial tcp 104.36.82.3:4779: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673118292 (28h6m58.104198423s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: rpc: dial tcp 104.36.82.43:4835: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673130946 (28h6m58.104211077s) [seg_pos={0 0}, upload=29343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 21:33:03.673200138 (28h6m58.104280269s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 21:33:03.673203915 (28h6m58.104284036s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:33:03.974816035 (28h6m58.405896166s) [upload=29343]: Done uploading segments...
Aug 9 21:33:03.974835111 (28h6m58.405915242s) [upload=29343]: Upload finished. err: <nil>
Duration: 9.837405176s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............................X.......X...................X..] duration:
1.855075779s
FAIL (2025-08-09 21:42:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 21:40:20.835326620 (28h14m15.266406751s) [upload=29467]: Starting upload Aug 9 21:40:20.835376275 (28h14m15.266456407s) [upload=29467]: Done starting upload Aug 9 21:40:20.835435859 (28h14m15.26651598s) [upload=29467]: Uploading segments... Aug 9 21:40:20.835474494 (28h14m15.266554615s) [upload=29467]: Got next segment. Inline: true Aug 9 21:40:20.835478682 (28h14m15.266558813s) [upload=29467]: Waiting for error group managing segments... Aug 9 21:40:20.835516063 (28h14m15.266596194s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 21:40:20.835520561 (28h14m15.266600682s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 21:40:20.835523187 (28h14m15.266603318s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 21:40:21.049591667 (28h14m15.480671808s) [upload=29467]: Done uploading segments... Aug 9 21:40:21.049611705 (28h14m15.480691836s) [upload=29467]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.855102361s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X.....................X.................X.............] duration:
9.943200207s
FAIL (2025-08-09 21:42:15 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 21:32:58.743646467 (28h6m53.174726598s) [upload=29343]: Starting upload
Aug 9 21:32:58.743707774 (28h6m53.174787895s) [upload=29343]: Done starting upload
Aug 9 21:32:58.743801404 (28h6m53.174881535s) [upload=29343]: Uploading segments...
Aug 9 21:32:58.743883340 (28h6m53.174963471s) [upload=29343]: Got next segment. Inline: false
Aug 9 21:32:58.743930660 (28h6m53.175010791s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:32:58.743935861 (28h6m53.175015992s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 21:32:59.213889759 (28h6m53.64496989s) [seg_pos={0 0}, upload=29343]: Begin upload segment...
Aug 9 21:32:59.213970373 (28h6m53.645050494s) [seg_pos={0 0}, upload=29343]: Done begin upload segment.
Aug 9 21:32:59.214016252 (28h6m53.645096383s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214021141 (28h6m53.645101262s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214113617 (28h6m53.645193738s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214380749 (28h6m53.64546088s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214575822 (28h6m53.645655953s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214639604 (28h6m53.645719725s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214858843 (28h6m53.645938974s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214918126 (28h6m53.645998257s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215173295 (28h6m53.646253426s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215453160 (28h6m53.646533292s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215701466 (28h6m53.646781597s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215973536 (28h6m53.647053667s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216225959 (28h6m53.64730609s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216496968 (28h6m53.647577099s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216838721 (28h6m53.647918852s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217048964 (28h6m53.648129095s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217270928 (28h6m53.648351059s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217477994 (28h6m53.648558125s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:33:00.343481141 (28h6m54.774561272s) [upload=29343]: Next returned nil segment
Aug 9 21:33:00.343503263 (28h6m54.774583394s) [upload=29343]: Waiting for error group managing segments...
Aug 9 21:33:00.655564794 (28h6m55.086644925s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.676424365 (28h6m55.107504496s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.829706864 (28h6m55.260786995s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.119772961 (28h6m55.550853092s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.228012387 (28h6m55.659092528s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.233337386 (28h6m55.664417517s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235146947 (28h6m55.666227078s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235544097 (28h6m55.666624228s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.254624233 (28h6m55.685704375s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.323238895 (28h6m55.754319026s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.342654263 (28h6m55.773734404s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.437118842 (28h6m55.868198973s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.435393639 (28h6m57.86647377s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672630779 (28h6m58.10371091s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672663021 (28h6m58.103743172s) [seg_pos={0 0}, upload=29343]: Segment reached optimal threshold of 14 pieces.
Aug 9 21:33:03.673039952 (28h6m58.104120083s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: context canceled; context canceled
Aug 9 21:33:03.673057105 (28h6m58.104137236s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dGFWNmsuheRmfEfNGWHftPpCcWv7HHXKymgJxsye6P7ZKhZT): protocol: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection
Aug 9 21:33:03.673101660 (28h6m58.104181792s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DHKWSFHcN6FYabUR9Q8vpe7duLcyZmEPcDmqvvcQHDGm4bpvu): protocol: rpc: dial tcp 104.36.82.3:4779: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673118292 (28h6m58.104198423s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: rpc: dial tcp 104.36.82.43:4835: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673130946 (28h6m58.104211077s) [seg_pos={0 0}, upload=29343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 21:33:03.673200138 (28h6m58.104280269s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 21:33:03.673203915 (28h6m58.104284036s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:33:03.974816035 (28h6m58.405896166s) [upload=29343]: Done uploading segments...
Aug 9 21:33:03.974835111 (28h6m58.405915242s) [upload=29343]: Upload finished. err: <nil>
Duration: 9.94322828s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X.....................X.................X............] duration:
9.167084144s
FAIL (2025-08-09 21:41:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 21:32:58.743646467 (28h6m53.174726598s) [upload=29343]: Starting upload
Aug 9 21:32:58.743707774 (28h6m53.174787895s) [upload=29343]: Done starting upload
Aug 9 21:32:58.743801404 (28h6m53.174881535s) [upload=29343]: Uploading segments...
Aug 9 21:32:58.743883340 (28h6m53.174963471s) [upload=29343]: Got next segment. Inline: false
Aug 9 21:32:58.743930660 (28h6m53.175010791s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:32:58.743935861 (28h6m53.175015992s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 21:32:59.213889759 (28h6m53.64496989s) [seg_pos={0 0}, upload=29343]: Begin upload segment...
Aug 9 21:32:59.213970373 (28h6m53.645050494s) [seg_pos={0 0}, upload=29343]: Done begin upload segment.
Aug 9 21:32:59.214016252 (28h6m53.645096383s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214021141 (28h6m53.645101262s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214113617 (28h6m53.645193738s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214380749 (28h6m53.64546088s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214575822 (28h6m53.645655953s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214639604 (28h6m53.645719725s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214858843 (28h6m53.645938974s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214918126 (28h6m53.645998257s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215173295 (28h6m53.646253426s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215453160 (28h6m53.646533292s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215701466 (28h6m53.646781597s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215973536 (28h6m53.647053667s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216225959 (28h6m53.64730609s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216496968 (28h6m53.647577099s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216838721 (28h6m53.647918852s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217048964 (28h6m53.648129095s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217270928 (28h6m53.648351059s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217477994 (28h6m53.648558125s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:33:00.343481141 (28h6m54.774561272s) [upload=29343]: Next returned nil segment
Aug 9 21:33:00.343503263 (28h6m54.774583394s) [upload=29343]: Waiting for error group managing segments...
Aug 9 21:33:00.655564794 (28h6m55.086644925s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.676424365 (28h6m55.107504496s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.829706864 (28h6m55.260786995s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.119772961 (28h6m55.550853092s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.228012387 (28h6m55.659092528s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.233337386 (28h6m55.664417517s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235146947 (28h6m55.666227078s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235544097 (28h6m55.666624228s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.254624233 (28h6m55.685704375s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.323238895 (28h6m55.754319026s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.342654263 (28h6m55.773734404s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.437118842 (28h6m55.868198973s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.435393639 (28h6m57.86647377s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672630779 (28h6m58.10371091s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672663021 (28h6m58.103743172s) [seg_pos={0 0}, upload=29343]: Segment reached optimal threshold of 14 pieces.
Aug 9 21:33:03.673039952 (28h6m58.104120083s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: context canceled; context canceled
Aug 9 21:33:03.673057105 (28h6m58.104137236s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dGFWNmsuheRmfEfNGWHftPpCcWv7HHXKymgJxsye6P7ZKhZT): protocol: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection
Aug 9 21:33:03.673101660 (28h6m58.104181792s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DHKWSFHcN6FYabUR9Q8vpe7duLcyZmEPcDmqvvcQHDGm4bpvu): protocol: rpc: dial tcp 104.36.82.3:4779: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673118292 (28h6m58.104198423s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: rpc: dial tcp 104.36.82.43:4835: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673130946 (28h6m58.104211077s) [seg_pos={0 0}, upload=29343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 21:33:03.673200138 (28h6m58.104280269s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 21:33:03.673203915 (28h6m58.104284036s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:33:03.974816035 (28h6m58.405896166s) [upload=29343]: Done uploading segments...
Aug 9 21:33:03.974835111 (28h6m58.405915242s) [upload=29343]: Upload finished. err: <nil>
Duration: 9.167148216s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............................X.......X...................X.] duration:
1.938101346s
FAIL (2025-08-09 21:41:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 21:40:20.835326620 (28h14m15.266406751s) [upload=29467]: Starting upload Aug 9 21:40:20.835376275 (28h14m15.266456407s) [upload=29467]: Done starting upload Aug 9 21:40:20.835435859 (28h14m15.26651598s) [upload=29467]: Uploading segments... Aug 9 21:40:20.835474494 (28h14m15.266554615s) [upload=29467]: Got next segment. Inline: true Aug 9 21:40:20.835478682 (28h14m15.266558813s) [upload=29467]: Waiting for error group managing segments... Aug 9 21:40:20.835516063 (28h14m15.266596194s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 21:40:20.835520561 (28h14m15.266600682s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 21:40:20.835523187 (28h14m15.266603318s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 21:40:21.049591667 (28h14m15.480671808s) [upload=29467]: Done uploading segments... Aug 9 21:40:21.049611705 (28h14m15.480691836s) [upload=29467]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.938130922s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X.....................X.................X...........] duration:
9.763965947s
FAIL (2025-08-09 21:41:03 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 21:32:58.743646467 (28h6m53.174726598s) [upload=29343]: Starting upload
Aug 9 21:32:58.743707774 (28h6m53.174787895s) [upload=29343]: Done starting upload
Aug 9 21:32:58.743801404 (28h6m53.174881535s) [upload=29343]: Uploading segments...
Aug 9 21:32:58.743883340 (28h6m53.174963471s) [upload=29343]: Got next segment. Inline: false
Aug 9 21:32:58.743930660 (28h6m53.175010791s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:32:58.743935861 (28h6m53.175015992s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 21:32:59.213889759 (28h6m53.64496989s) [seg_pos={0 0}, upload=29343]: Begin upload segment...
Aug 9 21:32:59.213970373 (28h6m53.645050494s) [seg_pos={0 0}, upload=29343]: Done begin upload segment.
Aug 9 21:32:59.214016252 (28h6m53.645096383s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214021141 (28h6m53.645101262s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214113617 (28h6m53.645193738s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214380749 (28h6m53.64546088s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214575822 (28h6m53.645655953s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214639604 (28h6m53.645719725s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214858843 (28h6m53.645938974s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214918126 (28h6m53.645998257s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215173295 (28h6m53.646253426s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215453160 (28h6m53.646533292s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215701466 (28h6m53.646781597s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215973536 (28h6m53.647053667s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216225959 (28h6m53.64730609s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216496968 (28h6m53.647577099s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216838721 (28h6m53.647918852s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217048964 (28h6m53.648129095s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217270928 (28h6m53.648351059s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217477994 (28h6m53.648558125s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:33:00.343481141 (28h6m54.774561272s) [upload=29343]: Next returned nil segment
Aug 9 21:33:00.343503263 (28h6m54.774583394s) [upload=29343]: Waiting for error group managing segments...
Aug 9 21:33:00.655564794 (28h6m55.086644925s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.676424365 (28h6m55.107504496s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.829706864 (28h6m55.260786995s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.119772961 (28h6m55.550853092s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.228012387 (28h6m55.659092528s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.233337386 (28h6m55.664417517s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235146947 (28h6m55.666227078s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235544097 (28h6m55.666624228s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.254624233 (28h6m55.685704375s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.323238895 (28h6m55.754319026s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.342654263 (28h6m55.773734404s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.437118842 (28h6m55.868198973s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.435393639 (28h6m57.86647377s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672630779 (28h6m58.10371091s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672663021 (28h6m58.103743172s) [seg_pos={0 0}, upload=29343]: Segment reached optimal threshold of 14 pieces.
Aug 9 21:33:03.673039952 (28h6m58.104120083s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: context canceled; context canceled
Aug 9 21:33:03.673057105 (28h6m58.104137236s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dGFWNmsuheRmfEfNGWHftPpCcWv7HHXKymgJxsye6P7ZKhZT): protocol: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection
Aug 9 21:33:03.673101660 (28h6m58.104181792s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DHKWSFHcN6FYabUR9Q8vpe7duLcyZmEPcDmqvvcQHDGm4bpvu): protocol: rpc: dial tcp 104.36.82.3:4779: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673118292 (28h6m58.104198423s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: rpc: dial tcp 104.36.82.43:4835: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673130946 (28h6m58.104211077s) [seg_pos={0 0}, upload=29343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 21:33:03.673200138 (28h6m58.104280269s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 21:33:03.673203915 (28h6m58.104284036s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:33:03.974816035 (28h6m58.405896166s) [upload=29343]: Done uploading segments...
Aug 9 21:33:03.974835111 (28h6m58.405915242s) [upload=29343]: Upload finished. err: <nil>
Duration: 9.76399337s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X.....................X.................X..........] duration:
10.775420577s
FAIL (2025-08-09 21:40:48 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 21:32:58.743646467 (28h6m53.174726598s) [upload=29343]: Starting upload
Aug 9 21:32:58.743707774 (28h6m53.174787895s) [upload=29343]: Done starting upload
Aug 9 21:32:58.743801404 (28h6m53.174881535s) [upload=29343]: Uploading segments...
Aug 9 21:32:58.743883340 (28h6m53.174963471s) [upload=29343]: Got next segment. Inline: false
Aug 9 21:32:58.743930660 (28h6m53.175010791s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:32:58.743935861 (28h6m53.175015992s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 21:32:59.213889759 (28h6m53.64496989s) [seg_pos={0 0}, upload=29343]: Begin upload segment...
Aug 9 21:32:59.213970373 (28h6m53.645050494s) [seg_pos={0 0}, upload=29343]: Done begin upload segment.
Aug 9 21:32:59.214016252 (28h6m53.645096383s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214021141 (28h6m53.645101262s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214113617 (28h6m53.645193738s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214380749 (28h6m53.64546088s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214575822 (28h6m53.645655953s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214639604 (28h6m53.645719725s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214858843 (28h6m53.645938974s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214918126 (28h6m53.645998257s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215173295 (28h6m53.646253426s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215453160 (28h6m53.646533292s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215701466 (28h6m53.646781597s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215973536 (28h6m53.647053667s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216225959 (28h6m53.64730609s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216496968 (28h6m53.647577099s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216838721 (28h6m53.647918852s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217048964 (28h6m53.648129095s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217270928 (28h6m53.648351059s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217477994 (28h6m53.648558125s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:33:00.343481141 (28h6m54.774561272s) [upload=29343]: Next returned nil segment
Aug 9 21:33:00.343503263 (28h6m54.774583394s) [upload=29343]: Waiting for error group managing segments...
Aug 9 21:33:00.655564794 (28h6m55.086644925s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.676424365 (28h6m55.107504496s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.829706864 (28h6m55.260786995s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.119772961 (28h6m55.550853092s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.228012387 (28h6m55.659092528s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.233337386 (28h6m55.664417517s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235146947 (28h6m55.666227078s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235544097 (28h6m55.666624228s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.254624233 (28h6m55.685704375s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.323238895 (28h6m55.754319026s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.342654263 (28h6m55.773734404s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.437118842 (28h6m55.868198973s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.435393639 (28h6m57.86647377s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672630779 (28h6m58.10371091s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672663021 (28h6m58.103743172s) [seg_pos={0 0}, upload=29343]: Segment reached optimal threshold of 14 pieces.
Aug 9 21:33:03.673039952 (28h6m58.104120083s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: context canceled; context canceled
Aug 9 21:33:03.673057105 (28h6m58.104137236s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dGFWNmsuheRmfEfNGWHftPpCcWv7HHXKymgJxsye6P7ZKhZT): protocol: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection
Aug 9 21:33:03.673101660 (28h6m58.104181792s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DHKWSFHcN6FYabUR9Q8vpe7duLcyZmEPcDmqvvcQHDGm4bpvu): protocol: rpc: dial tcp 104.36.82.3:4779: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673118292 (28h6m58.104198423s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: rpc: dial tcp 104.36.82.43:4835: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673130946 (28h6m58.104211077s) [seg_pos={0 0}, upload=29343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 21:33:03.673200138 (28h6m58.104280269s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 21:33:03.673203915 (28h6m58.104284036s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:33:03.974816035 (28h6m58.405896166s) [upload=29343]: Done uploading segments...
Aug 9 21:33:03.974835111 (28h6m58.405915242s) [upload=29343]: Upload finished. err: <nil>
Duration: 10.775451296s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............................X.......X...................X] duration:
859.704522ms
FAIL (2025-08-09 21:40:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 21:40:20.835326620 (28h14m15.266406751s) [upload=29467]: Starting upload Aug 9 21:40:20.835376275 (28h14m15.266456407s) [upload=29467]: Done starting upload Aug 9 21:40:20.835435859 (28h14m15.26651598s) [upload=29467]: Uploading segments... Aug 9 21:40:20.835474494 (28h14m15.266554615s) [upload=29467]: Got next segment. Inline: true Aug 9 21:40:20.835478682 (28h14m15.266558813s) [upload=29467]: Waiting for error group managing segments... Aug 9 21:40:20.835516063 (28h14m15.266596194s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 21:40:20.835520561 (28h14m15.266600682s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 21:40:20.835523187 (28h14m15.266603318s) [upload=29467]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 21:40:21.049591667 (28h14m15.480671808s) [upload=29467]: Done uploading segments... Aug 9 21:40:21.049611705 (28h14m15.480691836s) [upload=29467]: Upload finished. err: metaclient: Too Many Requests
Duration: 859.728649ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X.....................X.................X.........] duration:
9.395800789s
FAIL (2025-08-09 21:39:57 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 21:32:58.743646467 (28h6m53.174726598s) [upload=29343]: Starting upload
Aug 9 21:32:58.743707774 (28h6m53.174787895s) [upload=29343]: Done starting upload
Aug 9 21:32:58.743801404 (28h6m53.174881535s) [upload=29343]: Uploading segments...
Aug 9 21:32:58.743883340 (28h6m53.174963471s) [upload=29343]: Got next segment. Inline: false
Aug 9 21:32:58.743930660 (28h6m53.175010791s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:32:58.743935861 (28h6m53.175015992s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 21:32:59.213889759 (28h6m53.64496989s) [seg_pos={0 0}, upload=29343]: Begin upload segment...
Aug 9 21:32:59.213970373 (28h6m53.645050494s) [seg_pos={0 0}, upload=29343]: Done begin upload segment.
Aug 9 21:32:59.214016252 (28h6m53.645096383s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214021141 (28h6m53.645101262s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214113617 (28h6m53.645193738s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214380749 (28h6m53.64546088s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214575822 (28h6m53.645655953s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214639604 (28h6m53.645719725s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214858843 (28h6m53.645938974s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214918126 (28h6m53.645998257s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215173295 (28h6m53.646253426s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215453160 (28h6m53.646533292s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215701466 (28h6m53.646781597s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215973536 (28h6m53.647053667s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216225959 (28h6m53.64730609s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216496968 (28h6m53.647577099s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216838721 (28h6m53.647918852s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217048964 (28h6m53.648129095s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217270928 (28h6m53.648351059s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217477994 (28h6m53.648558125s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:33:00.343481141 (28h6m54.774561272s) [upload=29343]: Next returned nil segment
Aug 9 21:33:00.343503263 (28h6m54.774583394s) [upload=29343]: Waiting for error group managing segments...
Aug 9 21:33:00.655564794 (28h6m55.086644925s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.676424365 (28h6m55.107504496s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.829706864 (28h6m55.260786995s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.119772961 (28h6m55.550853092s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.228012387 (28h6m55.659092528s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.233337386 (28h6m55.664417517s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235146947 (28h6m55.666227078s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235544097 (28h6m55.666624228s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.254624233 (28h6m55.685704375s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.323238895 (28h6m55.754319026s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.342654263 (28h6m55.773734404s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.437118842 (28h6m55.868198973s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.435393639 (28h6m57.86647377s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672630779 (28h6m58.10371091s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672663021 (28h6m58.103743172s) [seg_pos={0 0}, upload=29343]: Segment reached optimal threshold of 14 pieces.
Aug 9 21:33:03.673039952 (28h6m58.104120083s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: context canceled; context canceled
Aug 9 21:33:03.673057105 (28h6m58.104137236s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dGFWNmsuheRmfEfNGWHftPpCcWv7HHXKymgJxsye6P7ZKhZT): protocol: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection
Aug 9 21:33:03.673101660 (28h6m58.104181792s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DHKWSFHcN6FYabUR9Q8vpe7duLcyZmEPcDmqvvcQHDGm4bpvu): protocol: rpc: dial tcp 104.36.82.3:4779: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673118292 (28h6m58.104198423s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: rpc: dial tcp 104.36.82.43:4835: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673130946 (28h6m58.104211077s) [seg_pos={0 0}, upload=29343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 21:33:03.673200138 (28h6m58.104280269s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 21:33:03.673203915 (28h6m58.104284036s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:33:03.974816035 (28h6m58.405896166s) [upload=29343]: Done uploading segments...
Aug 9 21:33:03.974835111 (28h6m58.405915242s) [upload=29343]: Upload finished. err: <nil>
Duration: 9.395820507s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X.....................X.................X........] duration:
7.660141702s
FAIL (2025-08-09 21:39:34 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 21:32:58.743646467 (28h6m53.174726598s) [upload=29343]: Starting upload
Aug 9 21:32:58.743707774 (28h6m53.174787895s) [upload=29343]: Done starting upload
Aug 9 21:32:58.743801404 (28h6m53.174881535s) [upload=29343]: Uploading segments...
Aug 9 21:32:58.743883340 (28h6m53.174963471s) [upload=29343]: Got next segment. Inline: false
Aug 9 21:32:58.743930660 (28h6m53.175010791s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:32:58.743935861 (28h6m53.175015992s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 21:32:59.213889759 (28h6m53.64496989s) [seg_pos={0 0}, upload=29343]: Begin upload segment...
Aug 9 21:32:59.213970373 (28h6m53.645050494s) [seg_pos={0 0}, upload=29343]: Done begin upload segment.
Aug 9 21:32:59.214016252 (28h6m53.645096383s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214021141 (28h6m53.645101262s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214113617 (28h6m53.645193738s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214380749 (28h6m53.64546088s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214575822 (28h6m53.645655953s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214639604 (28h6m53.645719725s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214858843 (28h6m53.645938974s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214918126 (28h6m53.645998257s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215173295 (28h6m53.646253426s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215453160 (28h6m53.646533292s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215701466 (28h6m53.646781597s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215973536 (28h6m53.647053667s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216225959 (28h6m53.64730609s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216496968 (28h6m53.647577099s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216838721 (28h6m53.647918852s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217048964 (28h6m53.648129095s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217270928 (28h6m53.648351059s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217477994 (28h6m53.648558125s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:33:00.343481141 (28h6m54.774561272s) [upload=29343]: Next returned nil segment
Aug 9 21:33:00.343503263 (28h6m54.774583394s) [upload=29343]: Waiting for error group managing segments...
Aug 9 21:33:00.655564794 (28h6m55.086644925s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.676424365 (28h6m55.107504496s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.829706864 (28h6m55.260786995s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.119772961 (28h6m55.550853092s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.228012387 (28h6m55.659092528s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.233337386 (28h6m55.664417517s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235146947 (28h6m55.666227078s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235544097 (28h6m55.666624228s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.254624233 (28h6m55.685704375s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.323238895 (28h6m55.754319026s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.342654263 (28h6m55.773734404s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.437118842 (28h6m55.868198973s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.435393639 (28h6m57.86647377s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672630779 (28h6m58.10371091s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672663021 (28h6m58.103743172s) [seg_pos={0 0}, upload=29343]: Segment reached optimal threshold of 14 pieces.
Aug 9 21:33:03.673039952 (28h6m58.104120083s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: context canceled; context canceled
Aug 9 21:33:03.673057105 (28h6m58.104137236s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dGFWNmsuheRmfEfNGWHftPpCcWv7HHXKymgJxsye6P7ZKhZT): protocol: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection
Aug 9 21:33:03.673101660 (28h6m58.104181792s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DHKWSFHcN6FYabUR9Q8vpe7duLcyZmEPcDmqvvcQHDGm4bpvu): protocol: rpc: dial tcp 104.36.82.3:4779: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673118292 (28h6m58.104198423s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: rpc: dial tcp 104.36.82.43:4835: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673130946 (28h6m58.104211077s) [seg_pos={0 0}, upload=29343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 21:33:03.673200138 (28h6m58.104280269s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 21:33:03.673203915 (28h6m58.104284036s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:33:03.974816035 (28h6m58.405896166s) [upload=29343]: Done uploading segments...
Aug 9 21:33:03.974835111 (28h6m58.405915242s) [upload=29343]: Upload finished. err: <nil>
Duration: 7.660170757s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X.......X...................] duration:
1.869750027s
FAIL (2025-08-09 21:39:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 21:27:26.346156588 (28h1m20.777236719s) [upload=29246]: Starting upload
Aug 9 21:27:26.346202206 (28h1m20.777282337s) [upload=29246]: Done starting upload
Aug 9 21:27:26.346268232 (28h1m20.777348363s) [upload=29246]: Uploading segments...
Aug 9 21:27:26.346303089 (28h1m20.77738322s) [upload=29246]: Got next segment. Inline: true
Aug 9 21:27:26.346306836 (28h1m20.777386967s) [upload=29246]: Waiting for error group managing segments...
Aug 9 21:27:26.346337585 (28h1m20.777417706s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:27:26.346341412 (28h1m20.777421533s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 21:27:26.346343827 (28h1m20.777423948s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:27:27.287548737 (28h1m21.718628869s) [upload=29246]: Done uploading segments...
Aug 9 21:27:27.287566862 (28h1m21.718646994s) [upload=29246]: Upload finished. err: <nil>
Duration: 1.869805153s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X.......X..................] duration:
1.902955431s
FAIL (2025-08-09 21:39:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 21:27:26.346156588 (28h1m20.777236719s) [upload=29246]: Starting upload
Aug 9 21:27:26.346202206 (28h1m20.777282337s) [upload=29246]: Done starting upload
Aug 9 21:27:26.346268232 (28h1m20.777348363s) [upload=29246]: Uploading segments...
Aug 9 21:27:26.346303089 (28h1m20.77738322s) [upload=29246]: Got next segment. Inline: true
Aug 9 21:27:26.346306836 (28h1m20.777386967s) [upload=29246]: Waiting for error group managing segments...
Aug 9 21:27:26.346337585 (28h1m20.777417706s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:27:26.346341412 (28h1m20.777421533s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 21:27:26.346343827 (28h1m20.777423948s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:27:27.287548737 (28h1m21.718628869s) [upload=29246]: Done uploading segments...
Aug 9 21:27:27.287566862 (28h1m21.718646994s) [upload=29246]: Upload finished. err: <nil>
Duration: 1.902982442s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X.......X.................] duration:
1.942514136s
FAIL (2025-08-09 21:38:55 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 21:27:26.346156588 (28h1m20.777236719s) [upload=29246]: Starting upload
Aug 9 21:27:26.346202206 (28h1m20.777282337s) [upload=29246]: Done starting upload
Aug 9 21:27:26.346268232 (28h1m20.777348363s) [upload=29246]: Uploading segments...
Aug 9 21:27:26.346303089 (28h1m20.77738322s) [upload=29246]: Got next segment. Inline: true
Aug 9 21:27:26.346306836 (28h1m20.777386967s) [upload=29246]: Waiting for error group managing segments...
Aug 9 21:27:26.346337585 (28h1m20.777417706s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:27:26.346341412 (28h1m20.777421533s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 21:27:26.346343827 (28h1m20.777423948s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:27:27.287548737 (28h1m21.718628869s) [upload=29246]: Done uploading segments...
Aug 9 21:27:27.287566862 (28h1m21.718646994s) [upload=29246]: Upload finished. err: <nil>
Duration: 1.942541019s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X.....................X.................X.......] duration:
7.020073482s
FAIL (2025-08-09 21:38:40 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 21:32:58.743646467 (28h6m53.174726598s) [upload=29343]: Starting upload
Aug 9 21:32:58.743707774 (28h6m53.174787895s) [upload=29343]: Done starting upload
Aug 9 21:32:58.743801404 (28h6m53.174881535s) [upload=29343]: Uploading segments...
Aug 9 21:32:58.743883340 (28h6m53.174963471s) [upload=29343]: Got next segment. Inline: false
Aug 9 21:32:58.743930660 (28h6m53.175010791s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:32:58.743935861 (28h6m53.175015992s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 21:32:59.213889759 (28h6m53.64496989s) [seg_pos={0 0}, upload=29343]: Begin upload segment...
Aug 9 21:32:59.213970373 (28h6m53.645050494s) [seg_pos={0 0}, upload=29343]: Done begin upload segment.
Aug 9 21:32:59.214016252 (28h6m53.645096383s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214021141 (28h6m53.645101262s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214113617 (28h6m53.645193738s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214380749 (28h6m53.64546088s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214575822 (28h6m53.645655953s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214639604 (28h6m53.645719725s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214858843 (28h6m53.645938974s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214918126 (28h6m53.645998257s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215173295 (28h6m53.646253426s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215453160 (28h6m53.646533292s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215701466 (28h6m53.646781597s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215973536 (28h6m53.647053667s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216225959 (28h6m53.64730609s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216496968 (28h6m53.647577099s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216838721 (28h6m53.647918852s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217048964 (28h6m53.648129095s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217270928 (28h6m53.648351059s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217477994 (28h6m53.648558125s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:33:00.343481141 (28h6m54.774561272s) [upload=29343]: Next returned nil segment
Aug 9 21:33:00.343503263 (28h6m54.774583394s) [upload=29343]: Waiting for error group managing segments...
Aug 9 21:33:00.655564794 (28h6m55.086644925s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.676424365 (28h6m55.107504496s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.829706864 (28h6m55.260786995s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.119772961 (28h6m55.550853092s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.228012387 (28h6m55.659092528s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.233337386 (28h6m55.664417517s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235146947 (28h6m55.666227078s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235544097 (28h6m55.666624228s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.254624233 (28h6m55.685704375s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.323238895 (28h6m55.754319026s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.342654263 (28h6m55.773734404s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.437118842 (28h6m55.868198973s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.435393639 (28h6m57.86647377s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672630779 (28h6m58.10371091s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672663021 (28h6m58.103743172s) [seg_pos={0 0}, upload=29343]: Segment reached optimal threshold of 14 pieces.
Aug 9 21:33:03.673039952 (28h6m58.104120083s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: context canceled; context canceled
Aug 9 21:33:03.673057105 (28h6m58.104137236s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dGFWNmsuheRmfEfNGWHftPpCcWv7HHXKymgJxsye6P7ZKhZT): protocol: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection
Aug 9 21:33:03.673101660 (28h6m58.104181792s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DHKWSFHcN6FYabUR9Q8vpe7duLcyZmEPcDmqvvcQHDGm4bpvu): protocol: rpc: dial tcp 104.36.82.3:4779: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673118292 (28h6m58.104198423s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: rpc: dial tcp 104.36.82.43:4835: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673130946 (28h6m58.104211077s) [seg_pos={0 0}, upload=29343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 21:33:03.673200138 (28h6m58.104280269s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 21:33:03.673203915 (28h6m58.104284036s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:33:03.974816035 (28h6m58.405896166s) [upload=29343]: Done uploading segments...
Aug 9 21:33:03.974835111 (28h6m58.405915242s) [upload=29343]: Upload finished. err: <nil>
Duration: 7.020110503s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................X.......X................] duration:
1.931819826s
FAIL (2025-08-09 21:38:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 21:27:26.346156588 (28h1m20.777236719s) [upload=29246]: Starting upload
Aug 9 21:27:26.346202206 (28h1m20.777282337s) [upload=29246]: Done starting upload
Aug 9 21:27:26.346268232 (28h1m20.777348363s) [upload=29246]: Uploading segments...
Aug 9 21:27:26.346303089 (28h1m20.77738322s) [upload=29246]: Got next segment. Inline: true
Aug 9 21:27:26.346306836 (28h1m20.777386967s) [upload=29246]: Waiting for error group managing segments...
Aug 9 21:27:26.346337585 (28h1m20.777417706s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:27:26.346341412 (28h1m20.777421533s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 21:27:26.346343827 (28h1m20.777423948s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:27:27.287548737 (28h1m21.718628869s) [upload=29246]: Done uploading segments...
Aug 9 21:27:27.287566862 (28h1m21.718646994s) [upload=29246]: Upload finished. err: <nil>
Duration: 1.931849943s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X.....................X.................X......] duration:
9.697679029s
FAIL (2025-08-09 21:37:51 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 21:32:58.743646467 (28h6m53.174726598s) [upload=29343]: Starting upload
Aug 9 21:32:58.743707774 (28h6m53.174787895s) [upload=29343]: Done starting upload
Aug 9 21:32:58.743801404 (28h6m53.174881535s) [upload=29343]: Uploading segments...
Aug 9 21:32:58.743883340 (28h6m53.174963471s) [upload=29343]: Got next segment. Inline: false
Aug 9 21:32:58.743930660 (28h6m53.175010791s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:32:58.743935861 (28h6m53.175015992s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 21:32:59.213889759 (28h6m53.64496989s) [seg_pos={0 0}, upload=29343]: Begin upload segment...
Aug 9 21:32:59.213970373 (28h6m53.645050494s) [seg_pos={0 0}, upload=29343]: Done begin upload segment.
Aug 9 21:32:59.214016252 (28h6m53.645096383s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214021141 (28h6m53.645101262s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214113617 (28h6m53.645193738s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214380749 (28h6m53.64546088s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214575822 (28h6m53.645655953s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214639604 (28h6m53.645719725s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214858843 (28h6m53.645938974s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214918126 (28h6m53.645998257s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215173295 (28h6m53.646253426s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215453160 (28h6m53.646533292s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215701466 (28h6m53.646781597s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215973536 (28h6m53.647053667s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216225959 (28h6m53.64730609s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216496968 (28h6m53.647577099s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216838721 (28h6m53.647918852s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217048964 (28h6m53.648129095s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217270928 (28h6m53.648351059s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217477994 (28h6m53.648558125s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:33:00.343481141 (28h6m54.774561272s) [upload=29343]: Next returned nil segment
Aug 9 21:33:00.343503263 (28h6m54.774583394s) [upload=29343]: Waiting for error group managing segments...
Aug 9 21:33:00.655564794 (28h6m55.086644925s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.676424365 (28h6m55.107504496s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.829706864 (28h6m55.260786995s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.119772961 (28h6m55.550853092s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.228012387 (28h6m55.659092528s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.233337386 (28h6m55.664417517s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235146947 (28h6m55.666227078s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235544097 (28h6m55.666624228s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.254624233 (28h6m55.685704375s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.323238895 (28h6m55.754319026s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.342654263 (28h6m55.773734404s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.437118842 (28h6m55.868198973s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.435393639 (28h6m57.86647377s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672630779 (28h6m58.10371091s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672663021 (28h6m58.103743172s) [seg_pos={0 0}, upload=29343]: Segment reached optimal threshold of 14 pieces.
Aug 9 21:33:03.673039952 (28h6m58.104120083s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: context canceled; context canceled
Aug 9 21:33:03.673057105 (28h6m58.104137236s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dGFWNmsuheRmfEfNGWHftPpCcWv7HHXKymgJxsye6P7ZKhZT): protocol: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection
Aug 9 21:33:03.673101660 (28h6m58.104181792s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DHKWSFHcN6FYabUR9Q8vpe7duLcyZmEPcDmqvvcQHDGm4bpvu): protocol: rpc: dial tcp 104.36.82.3:4779: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673118292 (28h6m58.104198423s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: rpc: dial tcp 104.36.82.43:4835: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673130946 (28h6m58.104211077s) [seg_pos={0 0}, upload=29343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 21:33:03.673200138 (28h6m58.104280269s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 21:33:03.673203915 (28h6m58.104284036s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:33:03.974816035 (28h6m58.405896166s) [upload=29343]: Done uploading segments...
Aug 9 21:33:03.974835111 (28h6m58.405915242s) [upload=29343]: Upload finished. err: <nil>
Duration: 9.697709578s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X.....................X.................X.....] duration:
7.590349627s
FAIL (2025-08-09 21:37:01 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 21:32:58.743646467 (28h6m53.174726598s) [upload=29343]: Starting upload
Aug 9 21:32:58.743707774 (28h6m53.174787895s) [upload=29343]: Done starting upload
Aug 9 21:32:58.743801404 (28h6m53.174881535s) [upload=29343]: Uploading segments...
Aug 9 21:32:58.743883340 (28h6m53.174963471s) [upload=29343]: Got next segment. Inline: false
Aug 9 21:32:58.743930660 (28h6m53.175010791s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:32:58.743935861 (28h6m53.175015992s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 21:32:59.213889759 (28h6m53.64496989s) [seg_pos={0 0}, upload=29343]: Begin upload segment...
Aug 9 21:32:59.213970373 (28h6m53.645050494s) [seg_pos={0 0}, upload=29343]: Done begin upload segment.
Aug 9 21:32:59.214016252 (28h6m53.645096383s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214021141 (28h6m53.645101262s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214113617 (28h6m53.645193738s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214380749 (28h6m53.64546088s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214575822 (28h6m53.645655953s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214639604 (28h6m53.645719725s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214858843 (28h6m53.645938974s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214918126 (28h6m53.645998257s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215173295 (28h6m53.646253426s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215453160 (28h6m53.646533292s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215701466 (28h6m53.646781597s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215973536 (28h6m53.647053667s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216225959 (28h6m53.64730609s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216496968 (28h6m53.647577099s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216838721 (28h6m53.647918852s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217048964 (28h6m53.648129095s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217270928 (28h6m53.648351059s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217477994 (28h6m53.648558125s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:33:00.343481141 (28h6m54.774561272s) [upload=29343]: Next returned nil segment
Aug 9 21:33:00.343503263 (28h6m54.774583394s) [upload=29343]: Waiting for error group managing segments...
Aug 9 21:33:00.655564794 (28h6m55.086644925s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.676424365 (28h6m55.107504496s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.829706864 (28h6m55.260786995s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.119772961 (28h6m55.550853092s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.228012387 (28h6m55.659092528s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.233337386 (28h6m55.664417517s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235146947 (28h6m55.666227078s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235544097 (28h6m55.666624228s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.254624233 (28h6m55.685704375s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.323238895 (28h6m55.754319026s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.342654263 (28h6m55.773734404s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.437118842 (28h6m55.868198973s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.435393639 (28h6m57.86647377s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672630779 (28h6m58.10371091s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672663021 (28h6m58.103743172s) [seg_pos={0 0}, upload=29343]: Segment reached optimal threshold of 14 pieces.
Aug 9 21:33:03.673039952 (28h6m58.104120083s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: context canceled; context canceled
Aug 9 21:33:03.673057105 (28h6m58.104137236s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dGFWNmsuheRmfEfNGWHftPpCcWv7HHXKymgJxsye6P7ZKhZT): protocol: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection
Aug 9 21:33:03.673101660 (28h6m58.104181792s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DHKWSFHcN6FYabUR9Q8vpe7duLcyZmEPcDmqvvcQHDGm4bpvu): protocol: rpc: dial tcp 104.36.82.3:4779: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673118292 (28h6m58.104198423s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: rpc: dial tcp 104.36.82.43:4835: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673130946 (28h6m58.104211077s) [seg_pos={0 0}, upload=29343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 21:33:03.673200138 (28h6m58.104280269s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 21:33:03.673203915 (28h6m58.104284036s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:33:03.974816035 (28h6m58.405896166s) [upload=29343]: Done uploading segments...
Aug 9 21:33:03.974835111 (28h6m58.405915242s) [upload=29343]: Upload finished. err: <nil>
Duration: 7.5903773s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................X.......X...............] duration:
1.936650842s
FAIL (2025-08-09 21:37:01 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 21:27:26.346156588 (28h1m20.777236719s) [upload=29246]: Starting upload
Aug 9 21:27:26.346202206 (28h1m20.777282337s) [upload=29246]: Done starting upload
Aug 9 21:27:26.346268232 (28h1m20.777348363s) [upload=29246]: Uploading segments...
Aug 9 21:27:26.346303089 (28h1m20.77738322s) [upload=29246]: Got next segment. Inline: true
Aug 9 21:27:26.346306836 (28h1m20.777386967s) [upload=29246]: Waiting for error group managing segments...
Aug 9 21:27:26.346337585 (28h1m20.777417706s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:27:26.346341412 (28h1m20.777421533s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 21:27:26.346343827 (28h1m20.777423948s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:27:27.287548737 (28h1m21.718628869s) [upload=29246]: Done uploading segments...
Aug 9 21:27:27.287566862 (28h1m21.718646994s) [upload=29246]: Upload finished. err: <nil>
Duration: 1.936680047s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X.....................X.................X....] duration:
6.612886194s
FAIL (2025-08-09 21:36:10 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 21:32:58.743646467 (28h6m53.174726598s) [upload=29343]: Starting upload
Aug 9 21:32:58.743707774 (28h6m53.174787895s) [upload=29343]: Done starting upload
Aug 9 21:32:58.743801404 (28h6m53.174881535s) [upload=29343]: Uploading segments...
Aug 9 21:32:58.743883340 (28h6m53.174963471s) [upload=29343]: Got next segment. Inline: false
Aug 9 21:32:58.743930660 (28h6m53.175010791s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:32:58.743935861 (28h6m53.175015992s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 21:32:59.213889759 (28h6m53.64496989s) [seg_pos={0 0}, upload=29343]: Begin upload segment...
Aug 9 21:32:59.213970373 (28h6m53.645050494s) [seg_pos={0 0}, upload=29343]: Done begin upload segment.
Aug 9 21:32:59.214016252 (28h6m53.645096383s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214021141 (28h6m53.645101262s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214113617 (28h6m53.645193738s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214380749 (28h6m53.64546088s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214575822 (28h6m53.645655953s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214639604 (28h6m53.645719725s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214858843 (28h6m53.645938974s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214918126 (28h6m53.645998257s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215173295 (28h6m53.646253426s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215453160 (28h6m53.646533292s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215701466 (28h6m53.646781597s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215973536 (28h6m53.647053667s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216225959 (28h6m53.64730609s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216496968 (28h6m53.647577099s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216838721 (28h6m53.647918852s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217048964 (28h6m53.648129095s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217270928 (28h6m53.648351059s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217477994 (28h6m53.648558125s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:33:00.343481141 (28h6m54.774561272s) [upload=29343]: Next returned nil segment
Aug 9 21:33:00.343503263 (28h6m54.774583394s) [upload=29343]: Waiting for error group managing segments...
Aug 9 21:33:00.655564794 (28h6m55.086644925s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.676424365 (28h6m55.107504496s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.829706864 (28h6m55.260786995s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.119772961 (28h6m55.550853092s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.228012387 (28h6m55.659092528s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.233337386 (28h6m55.664417517s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235146947 (28h6m55.666227078s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235544097 (28h6m55.666624228s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.254624233 (28h6m55.685704375s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.323238895 (28h6m55.754319026s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.342654263 (28h6m55.773734404s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.437118842 (28h6m55.868198973s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.435393639 (28h6m57.86647377s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672630779 (28h6m58.10371091s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672663021 (28h6m58.103743172s) [seg_pos={0 0}, upload=29343]: Segment reached optimal threshold of 14 pieces.
Aug 9 21:33:03.673039952 (28h6m58.104120083s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: context canceled; context canceled
Aug 9 21:33:03.673057105 (28h6m58.104137236s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dGFWNmsuheRmfEfNGWHftPpCcWv7HHXKymgJxsye6P7ZKhZT): protocol: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection
Aug 9 21:33:03.673101660 (28h6m58.104181792s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DHKWSFHcN6FYabUR9Q8vpe7duLcyZmEPcDmqvvcQHDGm4bpvu): protocol: rpc: dial tcp 104.36.82.3:4779: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673118292 (28h6m58.104198423s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: rpc: dial tcp 104.36.82.43:4835: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673130946 (28h6m58.104211077s) [seg_pos={0 0}, upload=29343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 21:33:03.673200138 (28h6m58.104280269s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 21:33:03.673203915 (28h6m58.104284036s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:33:03.974816035 (28h6m58.405896166s) [upload=29343]: Done uploading segments...
Aug 9 21:33:03.974835111 (28h6m58.405915242s) [upload=29343]: Upload finished. err: <nil>
Duration: 6.612913226s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X.......X..............] duration:
1.839314752s
FAIL (2025-08-09 21:36:00 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 21:27:26.346156588 (28h1m20.777236719s) [upload=29246]: Starting upload
Aug 9 21:27:26.346202206 (28h1m20.777282337s) [upload=29246]: Done starting upload
Aug 9 21:27:26.346268232 (28h1m20.777348363s) [upload=29246]: Uploading segments...
Aug 9 21:27:26.346303089 (28h1m20.77738322s) [upload=29246]: Got next segment. Inline: true
Aug 9 21:27:26.346306836 (28h1m20.777386967s) [upload=29246]: Waiting for error group managing segments...
Aug 9 21:27:26.346337585 (28h1m20.777417706s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:27:26.346341412 (28h1m20.777421533s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 21:27:26.346343827 (28h1m20.777423948s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:27:27.287548737 (28h1m21.718628869s) [upload=29246]: Done uploading segments...
Aug 9 21:27:27.287566862 (28h1m21.718646994s) [upload=29246]: Upload finished. err: <nil>
Duration: 1.839340942s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................X.......X.............] duration:
1.847107274s
FAIL (2025-08-09 21:35:35 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 21:27:26.346156588 (28h1m20.777236719s) [upload=29246]: Starting upload
Aug 9 21:27:26.346202206 (28h1m20.777282337s) [upload=29246]: Done starting upload
Aug 9 21:27:26.346268232 (28h1m20.777348363s) [upload=29246]: Uploading segments...
Aug 9 21:27:26.346303089 (28h1m20.77738322s) [upload=29246]: Got next segment. Inline: true
Aug 9 21:27:26.346306836 (28h1m20.777386967s) [upload=29246]: Waiting for error group managing segments...
Aug 9 21:27:26.346337585 (28h1m20.777417706s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:27:26.346341412 (28h1m20.777421533s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 21:27:26.346343827 (28h1m20.777423948s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:27:27.287548737 (28h1m21.718628869s) [upload=29246]: Done uploading segments...
Aug 9 21:27:27.287566862 (28h1m21.718646994s) [upload=29246]: Upload finished. err: <nil>
Duration: 1.847141149s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X.....................X.................X...] duration:
9.383530125s
FAIL (2025-08-09 21:35:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 21:32:58.743646467 (28h6m53.174726598s) [upload=29343]: Starting upload
Aug 9 21:32:58.743707774 (28h6m53.174787895s) [upload=29343]: Done starting upload
Aug 9 21:32:58.743801404 (28h6m53.174881535s) [upload=29343]: Uploading segments...
Aug 9 21:32:58.743883340 (28h6m53.174963471s) [upload=29343]: Got next segment. Inline: false
Aug 9 21:32:58.743930660 (28h6m53.175010791s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:32:58.743935861 (28h6m53.175015992s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 21:32:59.213889759 (28h6m53.64496989s) [seg_pos={0 0}, upload=29343]: Begin upload segment...
Aug 9 21:32:59.213970373 (28h6m53.645050494s) [seg_pos={0 0}, upload=29343]: Done begin upload segment.
Aug 9 21:32:59.214016252 (28h6m53.645096383s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214021141 (28h6m53.645101262s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214113617 (28h6m53.645193738s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214380749 (28h6m53.64546088s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214575822 (28h6m53.645655953s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214639604 (28h6m53.645719725s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214858843 (28h6m53.645938974s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214918126 (28h6m53.645998257s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215173295 (28h6m53.646253426s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215453160 (28h6m53.646533292s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215701466 (28h6m53.646781597s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215973536 (28h6m53.647053667s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216225959 (28h6m53.64730609s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216496968 (28h6m53.647577099s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216838721 (28h6m53.647918852s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217048964 (28h6m53.648129095s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217270928 (28h6m53.648351059s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217477994 (28h6m53.648558125s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:33:00.343481141 (28h6m54.774561272s) [upload=29343]: Next returned nil segment
Aug 9 21:33:00.343503263 (28h6m54.774583394s) [upload=29343]: Waiting for error group managing segments...
Aug 9 21:33:00.655564794 (28h6m55.086644925s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.676424365 (28h6m55.107504496s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.829706864 (28h6m55.260786995s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.119772961 (28h6m55.550853092s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.228012387 (28h6m55.659092528s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.233337386 (28h6m55.664417517s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235146947 (28h6m55.666227078s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235544097 (28h6m55.666624228s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.254624233 (28h6m55.685704375s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.323238895 (28h6m55.754319026s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.342654263 (28h6m55.773734404s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.437118842 (28h6m55.868198973s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.435393639 (28h6m57.86647377s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672630779 (28h6m58.10371091s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672663021 (28h6m58.103743172s) [seg_pos={0 0}, upload=29343]: Segment reached optimal threshold of 14 pieces.
Aug 9 21:33:03.673039952 (28h6m58.104120083s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: context canceled; context canceled
Aug 9 21:33:03.673057105 (28h6m58.104137236s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dGFWNmsuheRmfEfNGWHftPpCcWv7HHXKymgJxsye6P7ZKhZT): protocol: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection
Aug 9 21:33:03.673101660 (28h6m58.104181792s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DHKWSFHcN6FYabUR9Q8vpe7duLcyZmEPcDmqvvcQHDGm4bpvu): protocol: rpc: dial tcp 104.36.82.3:4779: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673118292 (28h6m58.104198423s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: rpc: dial tcp 104.36.82.43:4835: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673130946 (28h6m58.104211077s) [seg_pos={0 0}, upload=29343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 21:33:03.673200138 (28h6m58.104280269s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 21:33:03.673203915 (28h6m58.104284036s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:33:03.974816035 (28h6m58.405896166s) [upload=29343]: Done uploading segments...
Aug 9 21:33:03.974835111 (28h6m58.405915242s) [upload=29343]: Upload finished. err: <nil>
Duration: 9.383564229s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X.......X............] duration:
1.93926454s
FAIL (2025-08-09 21:35:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 21:27:26.346156588 (28h1m20.777236719s) [upload=29246]: Starting upload
Aug 9 21:27:26.346202206 (28h1m20.777282337s) [upload=29246]: Done starting upload
Aug 9 21:27:26.346268232 (28h1m20.777348363s) [upload=29246]: Uploading segments...
Aug 9 21:27:26.346303089 (28h1m20.77738322s) [upload=29246]: Got next segment. Inline: true
Aug 9 21:27:26.346306836 (28h1m20.777386967s) [upload=29246]: Waiting for error group managing segments...
Aug 9 21:27:26.346337585 (28h1m20.777417706s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:27:26.346341412 (28h1m20.777421533s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 21:27:26.346343827 (28h1m20.777423948s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:27:27.287548737 (28h1m21.718628869s) [upload=29246]: Done uploading segments...
Aug 9 21:27:27.287566862 (28h1m21.718646994s) [upload=29246]: Upload finished. err: <nil>
Duration: 1.939294107s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X.....................X.................X..] duration:
8.679284248s
FAIL (2025-08-09 21:34:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 21:32:58.743646467 (28h6m53.174726598s) [upload=29343]: Starting upload
Aug 9 21:32:58.743707774 (28h6m53.174787895s) [upload=29343]: Done starting upload
Aug 9 21:32:58.743801404 (28h6m53.174881535s) [upload=29343]: Uploading segments...
Aug 9 21:32:58.743883340 (28h6m53.174963471s) [upload=29343]: Got next segment. Inline: false
Aug 9 21:32:58.743930660 (28h6m53.175010791s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:32:58.743935861 (28h6m53.175015992s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 21:32:59.213889759 (28h6m53.64496989s) [seg_pos={0 0}, upload=29343]: Begin upload segment...
Aug 9 21:32:59.213970373 (28h6m53.645050494s) [seg_pos={0 0}, upload=29343]: Done begin upload segment.
Aug 9 21:32:59.214016252 (28h6m53.645096383s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214021141 (28h6m53.645101262s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214113617 (28h6m53.645193738s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214380749 (28h6m53.64546088s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214575822 (28h6m53.645655953s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214639604 (28h6m53.645719725s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214858843 (28h6m53.645938974s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214918126 (28h6m53.645998257s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215173295 (28h6m53.646253426s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215453160 (28h6m53.646533292s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215701466 (28h6m53.646781597s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215973536 (28h6m53.647053667s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216225959 (28h6m53.64730609s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216496968 (28h6m53.647577099s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216838721 (28h6m53.647918852s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217048964 (28h6m53.648129095s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217270928 (28h6m53.648351059s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217477994 (28h6m53.648558125s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:33:00.343481141 (28h6m54.774561272s) [upload=29343]: Next returned nil segment
Aug 9 21:33:00.343503263 (28h6m54.774583394s) [upload=29343]: Waiting for error group managing segments...
Aug 9 21:33:00.655564794 (28h6m55.086644925s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.676424365 (28h6m55.107504496s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.829706864 (28h6m55.260786995s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.119772961 (28h6m55.550853092s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.228012387 (28h6m55.659092528s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.233337386 (28h6m55.664417517s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235146947 (28h6m55.666227078s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235544097 (28h6m55.666624228s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.254624233 (28h6m55.685704375s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.323238895 (28h6m55.754319026s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.342654263 (28h6m55.773734404s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.437118842 (28h6m55.868198973s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.435393639 (28h6m57.86647377s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672630779 (28h6m58.10371091s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672663021 (28h6m58.103743172s) [seg_pos={0 0}, upload=29343]: Segment reached optimal threshold of 14 pieces.
Aug 9 21:33:03.673039952 (28h6m58.104120083s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: context canceled; context canceled
Aug 9 21:33:03.673057105 (28h6m58.104137236s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dGFWNmsuheRmfEfNGWHftPpCcWv7HHXKymgJxsye6P7ZKhZT): protocol: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection
Aug 9 21:33:03.673101660 (28h6m58.104181792s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DHKWSFHcN6FYabUR9Q8vpe7duLcyZmEPcDmqvvcQHDGm4bpvu): protocol: rpc: dial tcp 104.36.82.3:4779: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673118292 (28h6m58.104198423s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: rpc: dial tcp 104.36.82.43:4835: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673130946 (28h6m58.104211077s) [seg_pos={0 0}, upload=29343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 21:33:03.673200138 (28h6m58.104280269s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 21:33:03.673203915 (28h6m58.104284036s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:33:03.974816035 (28h6m58.405896166s) [upload=29343]: Done uploading segments...
Aug 9 21:33:03.974835111 (28h6m58.405915242s) [upload=29343]: Upload finished. err: <nil>
Duration: 8.679317151s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................X.....................X.................X.] duration:
10.653897333s
FAIL (2025-08-09 21:34:08 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 21:32:58.743646467 (28h6m53.174726598s) [upload=29343]: Starting upload
Aug 9 21:32:58.743707774 (28h6m53.174787895s) [upload=29343]: Done starting upload
Aug 9 21:32:58.743801404 (28h6m53.174881535s) [upload=29343]: Uploading segments...
Aug 9 21:32:58.743883340 (28h6m53.174963471s) [upload=29343]: Got next segment. Inline: false
Aug 9 21:32:58.743930660 (28h6m53.175010791s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:32:58.743935861 (28h6m53.175015992s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 21:32:59.213889759 (28h6m53.64496989s) [seg_pos={0 0}, upload=29343]: Begin upload segment...
Aug 9 21:32:59.213970373 (28h6m53.645050494s) [seg_pos={0 0}, upload=29343]: Done begin upload segment.
Aug 9 21:32:59.214016252 (28h6m53.645096383s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214021141 (28h6m53.645101262s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214113617 (28h6m53.645193738s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214380749 (28h6m53.64546088s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214575822 (28h6m53.645655953s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214639604 (28h6m53.645719725s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214858843 (28h6m53.645938974s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214918126 (28h6m53.645998257s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215173295 (28h6m53.646253426s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215453160 (28h6m53.646533292s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215701466 (28h6m53.646781597s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215973536 (28h6m53.647053667s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216225959 (28h6m53.64730609s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216496968 (28h6m53.647577099s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216838721 (28h6m53.647918852s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217048964 (28h6m53.648129095s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217270928 (28h6m53.648351059s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217477994 (28h6m53.648558125s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:33:00.343481141 (28h6m54.774561272s) [upload=29343]: Next returned nil segment
Aug 9 21:33:00.343503263 (28h6m54.774583394s) [upload=29343]: Waiting for error group managing segments...
Aug 9 21:33:00.655564794 (28h6m55.086644925s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.676424365 (28h6m55.107504496s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.829706864 (28h6m55.260786995s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.119772961 (28h6m55.550853092s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.228012387 (28h6m55.659092528s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.233337386 (28h6m55.664417517s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235146947 (28h6m55.666227078s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235544097 (28h6m55.666624228s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.254624233 (28h6m55.685704375s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.323238895 (28h6m55.754319026s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.342654263 (28h6m55.773734404s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.437118842 (28h6m55.868198973s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.435393639 (28h6m57.86647377s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672630779 (28h6m58.10371091s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672663021 (28h6m58.103743172s) [seg_pos={0 0}, upload=29343]: Segment reached optimal threshold of 14 pieces.
Aug 9 21:33:03.673039952 (28h6m58.104120083s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: context canceled; context canceled
Aug 9 21:33:03.673057105 (28h6m58.104137236s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dGFWNmsuheRmfEfNGWHftPpCcWv7HHXKymgJxsye6P7ZKhZT): protocol: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection
Aug 9 21:33:03.673101660 (28h6m58.104181792s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DHKWSFHcN6FYabUR9Q8vpe7duLcyZmEPcDmqvvcQHDGm4bpvu): protocol: rpc: dial tcp 104.36.82.3:4779: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673118292 (28h6m58.104198423s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: rpc: dial tcp 104.36.82.43:4835: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673130946 (28h6m58.104211077s) [seg_pos={0 0}, upload=29343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 21:33:03.673200138 (28h6m58.104280269s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 21:33:03.673203915 (28h6m58.104284036s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:33:03.974816035 (28h6m58.405896166s) [upload=29343]: Done uploading segments...
Aug 9 21:33:03.974835111 (28h6m58.405915242s) [upload=29343]: Upload finished. err: <nil>
Duration: 10.653922742s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................................X.......X...........] duration:
1.868259335s
FAIL (2025-08-09 21:33:54 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 21:27:26.346156588 (28h1m20.777236719s) [upload=29246]: Starting upload
Aug 9 21:27:26.346202206 (28h1m20.777282337s) [upload=29246]: Done starting upload
Aug 9 21:27:26.346268232 (28h1m20.777348363s) [upload=29246]: Uploading segments...
Aug 9 21:27:26.346303089 (28h1m20.77738322s) [upload=29246]: Got next segment. Inline: true
Aug 9 21:27:26.346306836 (28h1m20.777386967s) [upload=29246]: Waiting for error group managing segments...
Aug 9 21:27:26.346337585 (28h1m20.777417706s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:27:26.346341412 (28h1m20.777421533s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 21:27:26.346343827 (28h1m20.777423948s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:27:27.287548737 (28h1m21.718628869s) [upload=29246]: Done uploading segments...
Aug 9 21:27:27.287566862 (28h1m21.718646994s) [upload=29246]: Upload finished. err: <nil>
Duration: 1.868306926s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X.......X..........] duration:
1.849872695s
FAIL (2025-08-09 21:33:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 21:27:26.346156588 (28h1m20.777236719s) [upload=29246]: Starting upload
Aug 9 21:27:26.346202206 (28h1m20.777282337s) [upload=29246]: Done starting upload
Aug 9 21:27:26.346268232 (28h1m20.777348363s) [upload=29246]: Uploading segments...
Aug 9 21:27:26.346303089 (28h1m20.77738322s) [upload=29246]: Got next segment. Inline: true
Aug 9 21:27:26.346306836 (28h1m20.777386967s) [upload=29246]: Waiting for error group managing segments...
Aug 9 21:27:26.346337585 (28h1m20.777417706s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:27:26.346341412 (28h1m20.777421533s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 21:27:26.346343827 (28h1m20.777423948s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:27:27.287548737 (28h1m21.718628869s) [upload=29246]: Done uploading segments...
Aug 9 21:27:27.287566862 (28h1m21.718646994s) [upload=29246]: Upload finished. err: <nil>
Duration: 1.849899597s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................X.....................X.................X] duration:
6.562264149s
FAIL (2025-08-09 21:33:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 21:32:58.743646467 (28h6m53.174726598s) [upload=29343]: Starting upload
Aug 9 21:32:58.743707774 (28h6m53.174787895s) [upload=29343]: Done starting upload
Aug 9 21:32:58.743801404 (28h6m53.174881535s) [upload=29343]: Uploading segments...
Aug 9 21:32:58.743883340 (28h6m53.174963471s) [upload=29343]: Got next segment. Inline: false
Aug 9 21:32:58.743930660 (28h6m53.175010791s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:32:58.743935861 (28h6m53.175015992s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 21:32:59.213889759 (28h6m53.64496989s) [seg_pos={0 0}, upload=29343]: Begin upload segment...
Aug 9 21:32:59.213970373 (28h6m53.645050494s) [seg_pos={0 0}, upload=29343]: Done begin upload segment.
Aug 9 21:32:59.214016252 (28h6m53.645096383s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214021141 (28h6m53.645101262s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214113617 (28h6m53.645193738s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214380749 (28h6m53.64546088s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214575822 (28h6m53.645655953s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214639604 (28h6m53.645719725s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214858843 (28h6m53.645938974s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.214918126 (28h6m53.645998257s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215173295 (28h6m53.646253426s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215453160 (28h6m53.646533292s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215701466 (28h6m53.646781597s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.215973536 (28h6m53.647053667s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216225959 (28h6m53.64730609s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216496968 (28h6m53.647577099s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.216838721 (28h6m53.647918852s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217048964 (28h6m53.648129095s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217270928 (28h6m53.648351059s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:32:59.217477994 (28h6m53.648558125s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Uploading piece...
Aug 9 21:33:00.343481141 (28h6m54.774561272s) [upload=29343]: Next returned nil segment
Aug 9 21:33:00.343503263 (28h6m54.774583394s) [upload=29343]: Waiting for error group managing segments...
Aug 9 21:33:00.655564794 (28h6m55.086644925s) [noise=true , address=64.49.13.137:4499 , piece_id=44JNRYPYXWMD4E64RITF63KDW7WH6VOPBSMF4YYKLLHLXQIFT6ZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.676424365 (28h6m55.107504496s) [noise=true , address=64.49.13.154:4927 , piece_id=BNYBGGSC35PBG3BIK3LGPSQNL5DQRQ6YSGHKJEQOLDSKB3K65RIA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:00.829706864 (28h6m55.260786995s) [noise=true , address=64.49.13.169:4706 , piece_id=BHYEOL5HBZ4AZIM4WFAWOMKEYNBQNURNTV4EGYB6ID6XFWUGFD4A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.119772961 (28h6m55.550853092s) [noise=true , address=79.127.219.51:4194 , piece_id=CFKH2ALWSVTIVMP3AWOK736GGNIYTVWEXKSJHFLKFTGQTD3EMHPQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.228012387 (28h6m55.659092528s) [noise=true , address=104.36.82.2:4762 , piece_id=X43SPYSONTR76NTPCCCNIYCMSIGNFMM2DM5J2RBGMQEBAI2DM4TQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.233337386 (28h6m55.664417517s) [noise=true , address=104.36.82.5:4848 , piece_id=YLPVWHB2A5LCRAZNM7RNW7QTYTL37E2ISM5TP73QHDKGA3ARM6HQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235146947 (28h6m55.666227078s) [noise=true , address=104.36.82.61:4384 , piece_id=W5DI3T5WGIUYPT7XACENGPJC3AAM2AV7EK4TZ6MEHKFGZMBWUE5A, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.235544097 (28h6m55.666624228s) [noise=true , address=104.36.82.42:4807 , piece_id=TNRDTHU4HVPRSJOYW3UAKFZYIKUPSUB7FY6YOLPUIHNGIVX5LQTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.254624233 (28h6m55.685704375s) [noise=true , address=104.36.82.8:4998 , piece_id=WFEXZQH5HGTXY523XANHQ3W2NOKAH4MMGQIJHYPO4RZ6WMZIOOAA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.323238895 (28h6m55.754319026s) [noise=true , address=104.36.82.17:4335 , piece_id=XCJKTZJYR6V5SFDZ5CCX2R2M5IVCHBTGDOHLI66I6F422TK3KZZQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.342654263 (28h6m55.773734404s) [noise=true , address=104.36.82.22:4544 , piece_id=KFG32GD7SQUIRJROECVBPLXVL5O7WW6AFKY7N62KODW5TKNLGPOA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:01.437118842 (28h6m55.868198973s) [noise=true , address=104.36.82.56:4242 , piece_id=VC3RSS24QQIWBDO6RGS3YZX67NNC6AS7RUAUEY6TGCUKHUJJK5XA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.435393639 (28h6m57.86647377s) [noise=true , address=104.36.82.18:4377 , piece_id=56F2MTF7D7KWF3T7RACIILEF6K47NHFBCKLECUXVIMIINBMZYVQQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672630779 (28h6m58.10371091s) [noise=true , address=104.36.82.46:4497 , piece_id=5D3LNKPCJVOY3KAGBAGPLJ6CTTHGACB3GC3KY3KFOIM2UH2V6BHQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: <nil>
Aug 9 21:33:03.672663021 (28h6m58.103743172s) [seg_pos={0 0}, upload=29343]: Segment reached optimal threshold of 14 pieces.
Aug 9 21:33:03.673039952 (28h6m58.104120083s) [noise=true , address=104.36.82.60:4344 , piece_id=RTBCXKRPKN2EDUKYKERCARSR7ED7S2KA4EE7ICKIQZALWNCLDRXA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: context canceled; context canceled
Aug 9 21:33:03.673057105 (28h6m58.104137236s) [noise=true , address=104.36.82.52:4099 , piece_id=FSUPEWLP4BFQDOAXHHUEYJJZIZKHEGWAXOIPYYCUJ6N7XWMFMZFA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dGFWNmsuheRmfEfNGWHftPpCcWv7HHXKymgJxsye6P7ZKhZT): protocol: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51992->104.36.82.52:4099: use of closed network connection
Aug 9 21:33:03.673101660 (28h6m58.104181792s) [noise=true , address=104.36.82.3:4779 , piece_id=RBFVT7KIKLJXRMNEZ5VPDP72DZYBYHGOJTPNZ56XXULAVZQYMSZA, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DHKWSFHcN6FYabUR9Q8vpe7duLcyZmEPcDmqvvcQHDGm4bpvu): protocol: rpc: dial tcp 104.36.82.3:4779: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673118292 (28h6m58.104198423s) [noise=true , address=104.36.82.43:4835 , piece_id=WXBGSSY4MTOBU66MD64XUZK22G6AGT54C2VYRDHNX5SMUGO63LTQ, seg_pos={0 0}, upload=29343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: rpc: dial tcp 104.36.82.43:4835: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 21:33:03.673130946 (28h6m58.104211077s) [seg_pos={0 0}, upload=29343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 21:33:03.673200138 (28h6m58.104280269s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 21:33:03.673203915 (28h6m58.104284036s) [upload=29343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:33:03.974816035 (28h6m58.405896166s) [upload=29343]: Done uploading segments...
Aug 9 21:33:03.974835111 (28h6m58.405915242s) [upload=29343]: Upload finished. err: <nil>
Duration: 6.562289959s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X.........................................X.......X.........] duration:
1.988813968s
FAIL (2025-08-09 21:32:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 21:27:26.346156588 (28h1m20.777236719s) [upload=29246]: Starting upload
Aug 9 21:27:26.346202206 (28h1m20.777282337s) [upload=29246]: Done starting upload
Aug 9 21:27:26.346268232 (28h1m20.777348363s) [upload=29246]: Uploading segments...
Aug 9 21:27:26.346303089 (28h1m20.77738322s) [upload=29246]: Got next segment. Inline: true
Aug 9 21:27:26.346306836 (28h1m20.777386967s) [upload=29246]: Waiting for error group managing segments...
Aug 9 21:27:26.346337585 (28h1m20.777417706s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 21:27:26.346341412 (28h1m20.777421533s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 21:27:26.346343827 (28h1m20.777423948s) [upload=29246]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 21:27:27.287548737 (28h1m21.718628869s) [upload=29246]: Done uploading segments...
Aug 9 21:27:27.287566862 (28h1m21.718646994s) [upload=29246]: Upload finished. err: <nil>
Duration: 1.98884624s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|