Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [......X...................X.X....X......X...X..X............] duration:
2.278731909s
FAIL (2025-08-21 08:21:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.278760524s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...........................X..................X.....X..X....] duration:
5.63626111s
FAIL (2025-08-21 08:21:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 08:18:04.515966506 (302h51m58.947046637s) [upload=315044]: Starting upload
Aug 21 08:18:04.516012584 (302h51m58.947092715s) [upload=315044]: Done starting upload
Aug 21 08:18:04.516115160 (302h51m58.947195291s) [upload=315044]: Uploading segments...
Aug 21 08:18:04.516253375 (302h51m58.947333506s) [upload=315044]: Got next segment. Inline: false
Aug 21 08:18:04.516287581 (302h51m58.947367712s) [upload=315044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:18:04.516313911 (302h51m58.947394042s) [upload=315044]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:18:04.970219931 (302h51m59.401300062s) [seg_pos={0 0}, upload=315044]: Begin upload segment...
Aug 21 08:18:04.970277491 (302h51m59.401357622s) [seg_pos={0 0}, upload=315044]: Done begin upload segment.
Aug 21 08:18:04.970297490 (302h51m59.401377621s) [noise=true , address=104.36.82.49:4004 , piece_id=YL2V2PKAL2XLRYFHVQ7LPRX6X7IQQOK7FQW7UBWRWI6OYM3FYQKQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.970687837 (302h51m59.401767968s) [noise=true , address=77.90.31.16:4749 , piece_id=Z2I4PDUTHJGPINQHVS2ISWINT6KU4EETH7EWDS2XKSIX7KTLRKRQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.970881487 (302h51m59.401961618s) [noise=true , address=45.91.116.7:4033 , piece_id=7QVB2SEVSEF3RSGRO3WYI6C4NM4RXLRG6HG4U3P5T37MSQOHMF5Q, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.971047965 (302h51m59.402128087s) [noise=true , address=45.91.116.12:4258 , piece_id=V7E7DYYSODA7GUBSSYBWBMVMOTPIHL2P6DWYWXX23PGOGZVZWYWA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.971252127 (302h51m59.402332258s) [noise=true , address=79.127.219.47:4068 , piece_id=6TB6ITF3TFIX26EOVI7AQ7CZHZFTHXKGXJWEFVOCK4BXMZ3R2IJQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.971450997 (302h51m59.402531128s) [noise=true , address=77.90.31.13:4647 , piece_id=7EHZB4EHH266IF5GNYPMXCI5PVI6LBFOICOI6BJJN4HAVLHZI5YA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.971485583 (302h51m59.402565704s) [noise=true , address=45.91.116.8:4076 , piece_id=H2Z4IUQIOYHFHYWIJZVO5YBRN5BV3QAD2LOSB5ZQLDYHO33Q5RZA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.971734930 (302h51m59.402815051s) [noise=true , address=77.90.31.15:4712 , piece_id=KPYSCPYS43EK5ZTN7WAKMNSQ44LLFWCA7BLXITZI2CUCLI23G4SQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972003183 (302h51m59.403083314s) [noise=true , address=77.90.31.18:4831 , piece_id=D7LDSIZUSKBTEUZ3GAFCA7XUAAYF3PK4OWOUDSBK7KFRIMGBUK5Q, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972130077 (302h51m59.403210198s) [noise=true , address=104.36.82.44:4889 , piece_id=QBABOM6MZ4Z7DTTXYURN53T4RAHCTBHRKXZV4U353MD3YZUT5VUQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972285133 (302h51m59.403365264s) [noise=true , address=77.90.31.12:4614 , piece_id=WJBM7OCBPW6MHRS3WUPXCBWGZ6FTPIMK3GG44ZLFKH5VFZMDG62A, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972402969 (302h51m59.4034831s) [noise=true , address=104.36.82.5:4861 , piece_id=SGEKIBE24KNBBMVXGKO6TPCYL42UKQFQOLTXOLZLUYDKJGDNZYUA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972614052 (302h51m59.403694173s) [noise=true , address=104.36.82.19:4423 , piece_id=HBRYY6ZK4NOTTFQKZY3TB2DDIZOWC7NLRKS6MSI3PYNP74NVPL7Q, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972819245 (302h51m59.403899376s) [noise=true , address=104.36.82.50:4014 , piece_id=PM2BW5IKSZV4SFGCVTLI7XGXC2UFS7A4DIYXOSE3WORYXENILAUQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.973020730 (302h51m59.404100861s) [noise=true , address=77.90.31.21:4902 , piece_id=ORFR3KKQHQW4GKFIMXRWE7JZ2LAGJZCJP5NSXHHNH7LJ2LCA3LJQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.973259788 (302h51m59.404339919s) [noise=true , address=77.90.31.10:4529 , piece_id=DA4VMANHJ7BKZWDCO7SSSRJCWGGWPFKRHBQFYG2LOENDUZMHNVFA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.973466223 (302h51m59.404546354s) [noise=true , address=104.36.82.44:4894 , piece_id=5YMQEQDIDOZWDU63UQN32V3AHBCSJGJ4Y5F6FCRBTSAK44GMZXVQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.973658471 (302h51m59.404738602s) [noise=true , address=77.90.31.17:4801 , piece_id=3ZTGA7LBXDOVFYJ3IS2NBV5ZDHIE63QIK4QPWLWZF35LVMXY5DFA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:06.482745246 (302h52m0.913825377s) [upload=315044]: Next returned nil segment
Aug 21 08:18:06.482758753 (302h52m0.913838884s) [upload=315044]: Waiting for error group managing segments...
Aug 21 08:18:06.864337522 (302h52m1.295417653s) [noise=true , address=77.90.31.18:4831 , piece_id=D7LDSIZUSKBTEUZ3GAFCA7XUAAYF3PK4OWOUDSBK7KFRIMGBUK5Q, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.868586702 (302h52m1.299666833s) [noise=true , address=45.91.116.7:4033 , piece_id=7QVB2SEVSEF3RSGRO3WYI6C4NM4RXLRG6HG4U3P5T37MSQOHMF5Q, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.869304476 (302h52m1.300384597s) [noise=true , address=77.90.31.16:4749 , piece_id=Z2I4PDUTHJGPINQHVS2ISWINT6KU4EETH7EWDS2XKSIX7KTLRKRQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.869697237 (302h52m1.300777369s) [noise=true , address=79.127.219.47:4068 , piece_id=6TB6ITF3TFIX26EOVI7AQ7CZHZFTHXKGXJWEFVOCK4BXMZ3R2IJQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.909771515 (302h52m1.340851646s) [noise=true , address=77.90.31.15:4712 , piece_id=KPYSCPYS43EK5ZTN7WAKMNSQ44LLFWCA7BLXITZI2CUCLI23G4SQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.938883568 (302h52m1.369963699s) [noise=true , address=77.90.31.21:4902 , piece_id=ORFR3KKQHQW4GKFIMXRWE7JZ2LAGJZCJP5NSXHHNH7LJ2LCA3LJQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.940118662 (302h52m1.371198793s) [noise=true , address=104.36.82.5:4861 , piece_id=SGEKIBE24KNBBMVXGKO6TPCYL42UKQFQOLTXOLZLUYDKJGDNZYUA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.964532936 (302h52m1.395613067s) [noise=true , address=77.90.31.13:4647 , piece_id=7EHZB4EHH266IF5GNYPMXCI5PVI6LBFOICOI6BJJN4HAVLHZI5YA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.965028253 (302h52m1.396108384s) [noise=true , address=77.90.31.10:4529 , piece_id=DA4VMANHJ7BKZWDCO7SSSRJCWGGWPFKRHBQFYG2LOENDUZMHNVFA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.967305881 (302h52m1.398386012s) [noise=true , address=104.36.82.44:4894 , piece_id=5YMQEQDIDOZWDU63UQN32V3AHBCSJGJ4Y5F6FCRBTSAK44GMZXVQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.983495528 (302h52m1.414575659s) [noise=true , address=104.36.82.49:4004 , piece_id=YL2V2PKAL2XLRYFHVQ7LPRX6X7IQQOK7FQW7UBWRWI6OYM3FYQKQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.986669832 (302h52m1.417749963s) [noise=true , address=77.90.31.17:4801 , piece_id=3ZTGA7LBXDOVFYJ3IS2NBV5ZDHIE63QIK4QPWLWZF35LVMXY5DFA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:07.002715884 (302h52m1.433796025s) [noise=true , address=104.36.82.50:4014 , piece_id=PM2BW5IKSZV4SFGCVTLI7XGXC2UFS7A4DIYXOSE3WORYXENILAUQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:07.006350449 (302h52m1.43743058s) [noise=true , address=45.91.116.12:4258 , piece_id=V7E7DYYSODA7GUBSSYBWBMVMOTPIHL2P6DWYWXX23PGOGZVZWYWA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:07.006367080 (302h52m1.437447211s) [seg_pos={0 0}, upload=315044]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:18:07.006463265 (302h52m1.437543396s) [noise=true , address=77.90.31.12:4614 , piece_id=WJBM7OCBPW6MHRS3WUPXCBWGZ6FTPIMK3GG44ZLFKH5VFZMDG62A, seg_pos={0 0}, upload=315044]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wKLBwTAdUVAQmQGcafdpUcjiDE89jxdptEwXoAvV6WXf2Xbc3): protocol: expected piece hash; context canceled; EOF
Aug 21 08:18:07.006521606 (302h52m1.437601737s) [noise=true , address=104.36.82.19:4423 , piece_id=HBRYY6ZK4NOTTFQKZY3TB2DDIZOWC7NLRKS6MSI3PYNP74NVPL7Q, seg_pos={0 0}, upload=315044]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rpox27kwUgBKkqhfexgNQPEomMivnFFy5bJAmNmbaFDhaaBSM): protocol: expected piece hash; context canceled; EOF
Aug 21 08:18:07.006570079 (302h52m1.43765021s) [noise=true , address=104.36.82.44:4889 , piece_id=QBABOM6MZ4Z7DTTXYURN53T4RAHCTBHRKXZV4U353MD3YZUT5VUQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PCtJRFHPHi1dHJNcRnGZg8HZPQDfo5L3aw6DgVnUzVUz92Kyv): protocol: expected piece hash; context canceled; EOF
Aug 21 08:18:07.006662947 (302h52m1.437743078s) [noise=true , address=45.91.116.8:4076 , piece_id=H2Z4IUQIOYHFHYWIJZVO5YBRN5BV3QAD2LOSB5ZQLDYHO33Q5RZA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WWDBuhCg17uYobyN1WCxT6TdHXjHg9NknseutbiCpKdGo1Nd1): protocol: write tcp 188.166.225.170:40308->45.91.116.8:4076: use of closed network connection; write tcp 188.166.225.170:40308->45.91.116.8:4076: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40308->45.91.116.8:4076: use of closed network connection
Aug 21 08:18:07.006697072 (302h52m1.437777203s) [seg_pos={0 0}, upload=315044]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:18:07.006774871 (302h52m1.437855002s) [upload=315044]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:18:07.006778858 (302h52m1.437858979s) [upload=315044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:18:07.297592168 (302h52m1.728672299s) [upload=315044]: Done uploading segments...
Aug 21 08:18:07.297609962 (302h52m1.728690093s) [upload=315044]: Upload finished. err: <nil>
Duration: 5.636287529s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [............................X..................X.....X..X...] duration:
5.799251503s
FAIL (2025-08-21 08:20:22 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 08:18:04.515966506 (302h51m58.947046637s) [upload=315044]: Starting upload
Aug 21 08:18:04.516012584 (302h51m58.947092715s) [upload=315044]: Done starting upload
Aug 21 08:18:04.516115160 (302h51m58.947195291s) [upload=315044]: Uploading segments...
Aug 21 08:18:04.516253375 (302h51m58.947333506s) [upload=315044]: Got next segment. Inline: false
Aug 21 08:18:04.516287581 (302h51m58.947367712s) [upload=315044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:18:04.516313911 (302h51m58.947394042s) [upload=315044]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:18:04.970219931 (302h51m59.401300062s) [seg_pos={0 0}, upload=315044]: Begin upload segment...
Aug 21 08:18:04.970277491 (302h51m59.401357622s) [seg_pos={0 0}, upload=315044]: Done begin upload segment.
Aug 21 08:18:04.970297490 (302h51m59.401377621s) [noise=true , address=104.36.82.49:4004 , piece_id=YL2V2PKAL2XLRYFHVQ7LPRX6X7IQQOK7FQW7UBWRWI6OYM3FYQKQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.970687837 (302h51m59.401767968s) [noise=true , address=77.90.31.16:4749 , piece_id=Z2I4PDUTHJGPINQHVS2ISWINT6KU4EETH7EWDS2XKSIX7KTLRKRQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.970881487 (302h51m59.401961618s) [noise=true , address=45.91.116.7:4033 , piece_id=7QVB2SEVSEF3RSGRO3WYI6C4NM4RXLRG6HG4U3P5T37MSQOHMF5Q, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.971047965 (302h51m59.402128087s) [noise=true , address=45.91.116.12:4258 , piece_id=V7E7DYYSODA7GUBSSYBWBMVMOTPIHL2P6DWYWXX23PGOGZVZWYWA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.971252127 (302h51m59.402332258s) [noise=true , address=79.127.219.47:4068 , piece_id=6TB6ITF3TFIX26EOVI7AQ7CZHZFTHXKGXJWEFVOCK4BXMZ3R2IJQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.971450997 (302h51m59.402531128s) [noise=true , address=77.90.31.13:4647 , piece_id=7EHZB4EHH266IF5GNYPMXCI5PVI6LBFOICOI6BJJN4HAVLHZI5YA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.971485583 (302h51m59.402565704s) [noise=true , address=45.91.116.8:4076 , piece_id=H2Z4IUQIOYHFHYWIJZVO5YBRN5BV3QAD2LOSB5ZQLDYHO33Q5RZA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.971734930 (302h51m59.402815051s) [noise=true , address=77.90.31.15:4712 , piece_id=KPYSCPYS43EK5ZTN7WAKMNSQ44LLFWCA7BLXITZI2CUCLI23G4SQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972003183 (302h51m59.403083314s) [noise=true , address=77.90.31.18:4831 , piece_id=D7LDSIZUSKBTEUZ3GAFCA7XUAAYF3PK4OWOUDSBK7KFRIMGBUK5Q, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972130077 (302h51m59.403210198s) [noise=true , address=104.36.82.44:4889 , piece_id=QBABOM6MZ4Z7DTTXYURN53T4RAHCTBHRKXZV4U353MD3YZUT5VUQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972285133 (302h51m59.403365264s) [noise=true , address=77.90.31.12:4614 , piece_id=WJBM7OCBPW6MHRS3WUPXCBWGZ6FTPIMK3GG44ZLFKH5VFZMDG62A, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972402969 (302h51m59.4034831s) [noise=true , address=104.36.82.5:4861 , piece_id=SGEKIBE24KNBBMVXGKO6TPCYL42UKQFQOLTXOLZLUYDKJGDNZYUA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972614052 (302h51m59.403694173s) [noise=true , address=104.36.82.19:4423 , piece_id=HBRYY6ZK4NOTTFQKZY3TB2DDIZOWC7NLRKS6MSI3PYNP74NVPL7Q, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972819245 (302h51m59.403899376s) [noise=true , address=104.36.82.50:4014 , piece_id=PM2BW5IKSZV4SFGCVTLI7XGXC2UFS7A4DIYXOSE3WORYXENILAUQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.973020730 (302h51m59.404100861s) [noise=true , address=77.90.31.21:4902 , piece_id=ORFR3KKQHQW4GKFIMXRWE7JZ2LAGJZCJP5NSXHHNH7LJ2LCA3LJQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.973259788 (302h51m59.404339919s) [noise=true , address=77.90.31.10:4529 , piece_id=DA4VMANHJ7BKZWDCO7SSSRJCWGGWPFKRHBQFYG2LOENDUZMHNVFA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.973466223 (302h51m59.404546354s) [noise=true , address=104.36.82.44:4894 , piece_id=5YMQEQDIDOZWDU63UQN32V3AHBCSJGJ4Y5F6FCRBTSAK44GMZXVQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.973658471 (302h51m59.404738602s) [noise=true , address=77.90.31.17:4801 , piece_id=3ZTGA7LBXDOVFYJ3IS2NBV5ZDHIE63QIK4QPWLWZF35LVMXY5DFA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:06.482745246 (302h52m0.913825377s) [upload=315044]: Next returned nil segment
Aug 21 08:18:06.482758753 (302h52m0.913838884s) [upload=315044]: Waiting for error group managing segments...
Aug 21 08:18:06.864337522 (302h52m1.295417653s) [noise=true , address=77.90.31.18:4831 , piece_id=D7LDSIZUSKBTEUZ3GAFCA7XUAAYF3PK4OWOUDSBK7KFRIMGBUK5Q, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.868586702 (302h52m1.299666833s) [noise=true , address=45.91.116.7:4033 , piece_id=7QVB2SEVSEF3RSGRO3WYI6C4NM4RXLRG6HG4U3P5T37MSQOHMF5Q, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.869304476 (302h52m1.300384597s) [noise=true , address=77.90.31.16:4749 , piece_id=Z2I4PDUTHJGPINQHVS2ISWINT6KU4EETH7EWDS2XKSIX7KTLRKRQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.869697237 (302h52m1.300777369s) [noise=true , address=79.127.219.47:4068 , piece_id=6TB6ITF3TFIX26EOVI7AQ7CZHZFTHXKGXJWEFVOCK4BXMZ3R2IJQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.909771515 (302h52m1.340851646s) [noise=true , address=77.90.31.15:4712 , piece_id=KPYSCPYS43EK5ZTN7WAKMNSQ44LLFWCA7BLXITZI2CUCLI23G4SQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.938883568 (302h52m1.369963699s) [noise=true , address=77.90.31.21:4902 , piece_id=ORFR3KKQHQW4GKFIMXRWE7JZ2LAGJZCJP5NSXHHNH7LJ2LCA3LJQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.940118662 (302h52m1.371198793s) [noise=true , address=104.36.82.5:4861 , piece_id=SGEKIBE24KNBBMVXGKO6TPCYL42UKQFQOLTXOLZLUYDKJGDNZYUA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.964532936 (302h52m1.395613067s) [noise=true , address=77.90.31.13:4647 , piece_id=7EHZB4EHH266IF5GNYPMXCI5PVI6LBFOICOI6BJJN4HAVLHZI5YA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.965028253 (302h52m1.396108384s) [noise=true , address=77.90.31.10:4529 , piece_id=DA4VMANHJ7BKZWDCO7SSSRJCWGGWPFKRHBQFYG2LOENDUZMHNVFA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.967305881 (302h52m1.398386012s) [noise=true , address=104.36.82.44:4894 , piece_id=5YMQEQDIDOZWDU63UQN32V3AHBCSJGJ4Y5F6FCRBTSAK44GMZXVQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.983495528 (302h52m1.414575659s) [noise=true , address=104.36.82.49:4004 , piece_id=YL2V2PKAL2XLRYFHVQ7LPRX6X7IQQOK7FQW7UBWRWI6OYM3FYQKQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.986669832 (302h52m1.417749963s) [noise=true , address=77.90.31.17:4801 , piece_id=3ZTGA7LBXDOVFYJ3IS2NBV5ZDHIE63QIK4QPWLWZF35LVMXY5DFA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:07.002715884 (302h52m1.433796025s) [noise=true , address=104.36.82.50:4014 , piece_id=PM2BW5IKSZV4SFGCVTLI7XGXC2UFS7A4DIYXOSE3WORYXENILAUQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:07.006350449 (302h52m1.43743058s) [noise=true , address=45.91.116.12:4258 , piece_id=V7E7DYYSODA7GUBSSYBWBMVMOTPIHL2P6DWYWXX23PGOGZVZWYWA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:07.006367080 (302h52m1.437447211s) [seg_pos={0 0}, upload=315044]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:18:07.006463265 (302h52m1.437543396s) [noise=true , address=77.90.31.12:4614 , piece_id=WJBM7OCBPW6MHRS3WUPXCBWGZ6FTPIMK3GG44ZLFKH5VFZMDG62A, seg_pos={0 0}, upload=315044]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wKLBwTAdUVAQmQGcafdpUcjiDE89jxdptEwXoAvV6WXf2Xbc3): protocol: expected piece hash; context canceled; EOF
Aug 21 08:18:07.006521606 (302h52m1.437601737s) [noise=true , address=104.36.82.19:4423 , piece_id=HBRYY6ZK4NOTTFQKZY3TB2DDIZOWC7NLRKS6MSI3PYNP74NVPL7Q, seg_pos={0 0}, upload=315044]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rpox27kwUgBKkqhfexgNQPEomMivnFFy5bJAmNmbaFDhaaBSM): protocol: expected piece hash; context canceled; EOF
Aug 21 08:18:07.006570079 (302h52m1.43765021s) [noise=true , address=104.36.82.44:4889 , piece_id=QBABOM6MZ4Z7DTTXYURN53T4RAHCTBHRKXZV4U353MD3YZUT5VUQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PCtJRFHPHi1dHJNcRnGZg8HZPQDfo5L3aw6DgVnUzVUz92Kyv): protocol: expected piece hash; context canceled; EOF
Aug 21 08:18:07.006662947 (302h52m1.437743078s) [noise=true , address=45.91.116.8:4076 , piece_id=H2Z4IUQIOYHFHYWIJZVO5YBRN5BV3QAD2LOSB5ZQLDYHO33Q5RZA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WWDBuhCg17uYobyN1WCxT6TdHXjHg9NknseutbiCpKdGo1Nd1): protocol: write tcp 188.166.225.170:40308->45.91.116.8:4076: use of closed network connection; write tcp 188.166.225.170:40308->45.91.116.8:4076: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40308->45.91.116.8:4076: use of closed network connection
Aug 21 08:18:07.006697072 (302h52m1.437777203s) [seg_pos={0 0}, upload=315044]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:18:07.006774871 (302h52m1.437855002s) [upload=315044]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:18:07.006778858 (302h52m1.437858979s) [upload=315044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:18:07.297592168 (302h52m1.728672299s) [upload=315044]: Done uploading segments...
Aug 21 08:18:07.297609962 (302h52m1.728690093s) [upload=315044]: Upload finished. err: <nil>
Duration: 5.799308161s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
8 out of 60 is failed (threshold=3) [X......X...................X.X....X......X...X..X...........] duration:
1.821867266s
FAIL (2025-08-21 08:20:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.821893697s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.............................X..................X.....X..X..] duration:
5.671831016s
FAIL (2025-08-21 08:19:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 08:18:04.515966506 (302h51m58.947046637s) [upload=315044]: Starting upload
Aug 21 08:18:04.516012584 (302h51m58.947092715s) [upload=315044]: Done starting upload
Aug 21 08:18:04.516115160 (302h51m58.947195291s) [upload=315044]: Uploading segments...
Aug 21 08:18:04.516253375 (302h51m58.947333506s) [upload=315044]: Got next segment. Inline: false
Aug 21 08:18:04.516287581 (302h51m58.947367712s) [upload=315044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:18:04.516313911 (302h51m58.947394042s) [upload=315044]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:18:04.970219931 (302h51m59.401300062s) [seg_pos={0 0}, upload=315044]: Begin upload segment...
Aug 21 08:18:04.970277491 (302h51m59.401357622s) [seg_pos={0 0}, upload=315044]: Done begin upload segment.
Aug 21 08:18:04.970297490 (302h51m59.401377621s) [noise=true , address=104.36.82.49:4004 , piece_id=YL2V2PKAL2XLRYFHVQ7LPRX6X7IQQOK7FQW7UBWRWI6OYM3FYQKQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.970687837 (302h51m59.401767968s) [noise=true , address=77.90.31.16:4749 , piece_id=Z2I4PDUTHJGPINQHVS2ISWINT6KU4EETH7EWDS2XKSIX7KTLRKRQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.970881487 (302h51m59.401961618s) [noise=true , address=45.91.116.7:4033 , piece_id=7QVB2SEVSEF3RSGRO3WYI6C4NM4RXLRG6HG4U3P5T37MSQOHMF5Q, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.971047965 (302h51m59.402128087s) [noise=true , address=45.91.116.12:4258 , piece_id=V7E7DYYSODA7GUBSSYBWBMVMOTPIHL2P6DWYWXX23PGOGZVZWYWA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.971252127 (302h51m59.402332258s) [noise=true , address=79.127.219.47:4068 , piece_id=6TB6ITF3TFIX26EOVI7AQ7CZHZFTHXKGXJWEFVOCK4BXMZ3R2IJQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.971450997 (302h51m59.402531128s) [noise=true , address=77.90.31.13:4647 , piece_id=7EHZB4EHH266IF5GNYPMXCI5PVI6LBFOICOI6BJJN4HAVLHZI5YA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.971485583 (302h51m59.402565704s) [noise=true , address=45.91.116.8:4076 , piece_id=H2Z4IUQIOYHFHYWIJZVO5YBRN5BV3QAD2LOSB5ZQLDYHO33Q5RZA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.971734930 (302h51m59.402815051s) [noise=true , address=77.90.31.15:4712 , piece_id=KPYSCPYS43EK5ZTN7WAKMNSQ44LLFWCA7BLXITZI2CUCLI23G4SQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972003183 (302h51m59.403083314s) [noise=true , address=77.90.31.18:4831 , piece_id=D7LDSIZUSKBTEUZ3GAFCA7XUAAYF3PK4OWOUDSBK7KFRIMGBUK5Q, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972130077 (302h51m59.403210198s) [noise=true , address=104.36.82.44:4889 , piece_id=QBABOM6MZ4Z7DTTXYURN53T4RAHCTBHRKXZV4U353MD3YZUT5VUQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972285133 (302h51m59.403365264s) [noise=true , address=77.90.31.12:4614 , piece_id=WJBM7OCBPW6MHRS3WUPXCBWGZ6FTPIMK3GG44ZLFKH5VFZMDG62A, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972402969 (302h51m59.4034831s) [noise=true , address=104.36.82.5:4861 , piece_id=SGEKIBE24KNBBMVXGKO6TPCYL42UKQFQOLTXOLZLUYDKJGDNZYUA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972614052 (302h51m59.403694173s) [noise=true , address=104.36.82.19:4423 , piece_id=HBRYY6ZK4NOTTFQKZY3TB2DDIZOWC7NLRKS6MSI3PYNP74NVPL7Q, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972819245 (302h51m59.403899376s) [noise=true , address=104.36.82.50:4014 , piece_id=PM2BW5IKSZV4SFGCVTLI7XGXC2UFS7A4DIYXOSE3WORYXENILAUQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.973020730 (302h51m59.404100861s) [noise=true , address=77.90.31.21:4902 , piece_id=ORFR3KKQHQW4GKFIMXRWE7JZ2LAGJZCJP5NSXHHNH7LJ2LCA3LJQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.973259788 (302h51m59.404339919s) [noise=true , address=77.90.31.10:4529 , piece_id=DA4VMANHJ7BKZWDCO7SSSRJCWGGWPFKRHBQFYG2LOENDUZMHNVFA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.973466223 (302h51m59.404546354s) [noise=true , address=104.36.82.44:4894 , piece_id=5YMQEQDIDOZWDU63UQN32V3AHBCSJGJ4Y5F6FCRBTSAK44GMZXVQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.973658471 (302h51m59.404738602s) [noise=true , address=77.90.31.17:4801 , piece_id=3ZTGA7LBXDOVFYJ3IS2NBV5ZDHIE63QIK4QPWLWZF35LVMXY5DFA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:06.482745246 (302h52m0.913825377s) [upload=315044]: Next returned nil segment
Aug 21 08:18:06.482758753 (302h52m0.913838884s) [upload=315044]: Waiting for error group managing segments...
Aug 21 08:18:06.864337522 (302h52m1.295417653s) [noise=true , address=77.90.31.18:4831 , piece_id=D7LDSIZUSKBTEUZ3GAFCA7XUAAYF3PK4OWOUDSBK7KFRIMGBUK5Q, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.868586702 (302h52m1.299666833s) [noise=true , address=45.91.116.7:4033 , piece_id=7QVB2SEVSEF3RSGRO3WYI6C4NM4RXLRG6HG4U3P5T37MSQOHMF5Q, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.869304476 (302h52m1.300384597s) [noise=true , address=77.90.31.16:4749 , piece_id=Z2I4PDUTHJGPINQHVS2ISWINT6KU4EETH7EWDS2XKSIX7KTLRKRQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.869697237 (302h52m1.300777369s) [noise=true , address=79.127.219.47:4068 , piece_id=6TB6ITF3TFIX26EOVI7AQ7CZHZFTHXKGXJWEFVOCK4BXMZ3R2IJQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.909771515 (302h52m1.340851646s) [noise=true , address=77.90.31.15:4712 , piece_id=KPYSCPYS43EK5ZTN7WAKMNSQ44LLFWCA7BLXITZI2CUCLI23G4SQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.938883568 (302h52m1.369963699s) [noise=true , address=77.90.31.21:4902 , piece_id=ORFR3KKQHQW4GKFIMXRWE7JZ2LAGJZCJP5NSXHHNH7LJ2LCA3LJQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.940118662 (302h52m1.371198793s) [noise=true , address=104.36.82.5:4861 , piece_id=SGEKIBE24KNBBMVXGKO6TPCYL42UKQFQOLTXOLZLUYDKJGDNZYUA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.964532936 (302h52m1.395613067s) [noise=true , address=77.90.31.13:4647 , piece_id=7EHZB4EHH266IF5GNYPMXCI5PVI6LBFOICOI6BJJN4HAVLHZI5YA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.965028253 (302h52m1.396108384s) [noise=true , address=77.90.31.10:4529 , piece_id=DA4VMANHJ7BKZWDCO7SSSRJCWGGWPFKRHBQFYG2LOENDUZMHNVFA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.967305881 (302h52m1.398386012s) [noise=true , address=104.36.82.44:4894 , piece_id=5YMQEQDIDOZWDU63UQN32V3AHBCSJGJ4Y5F6FCRBTSAK44GMZXVQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.983495528 (302h52m1.414575659s) [noise=true , address=104.36.82.49:4004 , piece_id=YL2V2PKAL2XLRYFHVQ7LPRX6X7IQQOK7FQW7UBWRWI6OYM3FYQKQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.986669832 (302h52m1.417749963s) [noise=true , address=77.90.31.17:4801 , piece_id=3ZTGA7LBXDOVFYJ3IS2NBV5ZDHIE63QIK4QPWLWZF35LVMXY5DFA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:07.002715884 (302h52m1.433796025s) [noise=true , address=104.36.82.50:4014 , piece_id=PM2BW5IKSZV4SFGCVTLI7XGXC2UFS7A4DIYXOSE3WORYXENILAUQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:07.006350449 (302h52m1.43743058s) [noise=true , address=45.91.116.12:4258 , piece_id=V7E7DYYSODA7GUBSSYBWBMVMOTPIHL2P6DWYWXX23PGOGZVZWYWA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:07.006367080 (302h52m1.437447211s) [seg_pos={0 0}, upload=315044]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:18:07.006463265 (302h52m1.437543396s) [noise=true , address=77.90.31.12:4614 , piece_id=WJBM7OCBPW6MHRS3WUPXCBWGZ6FTPIMK3GG44ZLFKH5VFZMDG62A, seg_pos={0 0}, upload=315044]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wKLBwTAdUVAQmQGcafdpUcjiDE89jxdptEwXoAvV6WXf2Xbc3): protocol: expected piece hash; context canceled; EOF
Aug 21 08:18:07.006521606 (302h52m1.437601737s) [noise=true , address=104.36.82.19:4423 , piece_id=HBRYY6ZK4NOTTFQKZY3TB2DDIZOWC7NLRKS6MSI3PYNP74NVPL7Q, seg_pos={0 0}, upload=315044]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rpox27kwUgBKkqhfexgNQPEomMivnFFy5bJAmNmbaFDhaaBSM): protocol: expected piece hash; context canceled; EOF
Aug 21 08:18:07.006570079 (302h52m1.43765021s) [noise=true , address=104.36.82.44:4889 , piece_id=QBABOM6MZ4Z7DTTXYURN53T4RAHCTBHRKXZV4U353MD3YZUT5VUQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PCtJRFHPHi1dHJNcRnGZg8HZPQDfo5L3aw6DgVnUzVUz92Kyv): protocol: expected piece hash; context canceled; EOF
Aug 21 08:18:07.006662947 (302h52m1.437743078s) [noise=true , address=45.91.116.8:4076 , piece_id=H2Z4IUQIOYHFHYWIJZVO5YBRN5BV3QAD2LOSB5ZQLDYHO33Q5RZA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WWDBuhCg17uYobyN1WCxT6TdHXjHg9NknseutbiCpKdGo1Nd1): protocol: write tcp 188.166.225.170:40308->45.91.116.8:4076: use of closed network connection; write tcp 188.166.225.170:40308->45.91.116.8:4076: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40308->45.91.116.8:4076: use of closed network connection
Aug 21 08:18:07.006697072 (302h52m1.437777203s) [seg_pos={0 0}, upload=315044]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:18:07.006774871 (302h52m1.437855002s) [upload=315044]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:18:07.006778858 (302h52m1.437858979s) [upload=315044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:18:07.297592168 (302h52m1.728672299s) [upload=315044]: Done uploading segments...
Aug 21 08:18:07.297609962 (302h52m1.728690093s) [upload=315044]: Upload finished. err: <nil>
Duration: 5.67185893s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
9 out of 60 is failed (threshold=3) [XX......X...................X.X....X......X...X..X..........] duration:
1.875221754s
FAIL (2025-08-21 08:19:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.875250409s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..............................X..................X.....X..X.] duration:
5.476647506s
FAIL (2025-08-21 08:18:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 08:18:04.515966506 (302h51m58.947046637s) [upload=315044]: Starting upload
Aug 21 08:18:04.516012584 (302h51m58.947092715s) [upload=315044]: Done starting upload
Aug 21 08:18:04.516115160 (302h51m58.947195291s) [upload=315044]: Uploading segments...
Aug 21 08:18:04.516253375 (302h51m58.947333506s) [upload=315044]: Got next segment. Inline: false
Aug 21 08:18:04.516287581 (302h51m58.947367712s) [upload=315044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:18:04.516313911 (302h51m58.947394042s) [upload=315044]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:18:04.970219931 (302h51m59.401300062s) [seg_pos={0 0}, upload=315044]: Begin upload segment...
Aug 21 08:18:04.970277491 (302h51m59.401357622s) [seg_pos={0 0}, upload=315044]: Done begin upload segment.
Aug 21 08:18:04.970297490 (302h51m59.401377621s) [noise=true , address=104.36.82.49:4004 , piece_id=YL2V2PKAL2XLRYFHVQ7LPRX6X7IQQOK7FQW7UBWRWI6OYM3FYQKQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.970687837 (302h51m59.401767968s) [noise=true , address=77.90.31.16:4749 , piece_id=Z2I4PDUTHJGPINQHVS2ISWINT6KU4EETH7EWDS2XKSIX7KTLRKRQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.970881487 (302h51m59.401961618s) [noise=true , address=45.91.116.7:4033 , piece_id=7QVB2SEVSEF3RSGRO3WYI6C4NM4RXLRG6HG4U3P5T37MSQOHMF5Q, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.971047965 (302h51m59.402128087s) [noise=true , address=45.91.116.12:4258 , piece_id=V7E7DYYSODA7GUBSSYBWBMVMOTPIHL2P6DWYWXX23PGOGZVZWYWA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.971252127 (302h51m59.402332258s) [noise=true , address=79.127.219.47:4068 , piece_id=6TB6ITF3TFIX26EOVI7AQ7CZHZFTHXKGXJWEFVOCK4BXMZ3R2IJQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.971450997 (302h51m59.402531128s) [noise=true , address=77.90.31.13:4647 , piece_id=7EHZB4EHH266IF5GNYPMXCI5PVI6LBFOICOI6BJJN4HAVLHZI5YA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.971485583 (302h51m59.402565704s) [noise=true , address=45.91.116.8:4076 , piece_id=H2Z4IUQIOYHFHYWIJZVO5YBRN5BV3QAD2LOSB5ZQLDYHO33Q5RZA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.971734930 (302h51m59.402815051s) [noise=true , address=77.90.31.15:4712 , piece_id=KPYSCPYS43EK5ZTN7WAKMNSQ44LLFWCA7BLXITZI2CUCLI23G4SQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972003183 (302h51m59.403083314s) [noise=true , address=77.90.31.18:4831 , piece_id=D7LDSIZUSKBTEUZ3GAFCA7XUAAYF3PK4OWOUDSBK7KFRIMGBUK5Q, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972130077 (302h51m59.403210198s) [noise=true , address=104.36.82.44:4889 , piece_id=QBABOM6MZ4Z7DTTXYURN53T4RAHCTBHRKXZV4U353MD3YZUT5VUQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972285133 (302h51m59.403365264s) [noise=true , address=77.90.31.12:4614 , piece_id=WJBM7OCBPW6MHRS3WUPXCBWGZ6FTPIMK3GG44ZLFKH5VFZMDG62A, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972402969 (302h51m59.4034831s) [noise=true , address=104.36.82.5:4861 , piece_id=SGEKIBE24KNBBMVXGKO6TPCYL42UKQFQOLTXOLZLUYDKJGDNZYUA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972614052 (302h51m59.403694173s) [noise=true , address=104.36.82.19:4423 , piece_id=HBRYY6ZK4NOTTFQKZY3TB2DDIZOWC7NLRKS6MSI3PYNP74NVPL7Q, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972819245 (302h51m59.403899376s) [noise=true , address=104.36.82.50:4014 , piece_id=PM2BW5IKSZV4SFGCVTLI7XGXC2UFS7A4DIYXOSE3WORYXENILAUQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.973020730 (302h51m59.404100861s) [noise=true , address=77.90.31.21:4902 , piece_id=ORFR3KKQHQW4GKFIMXRWE7JZ2LAGJZCJP5NSXHHNH7LJ2LCA3LJQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.973259788 (302h51m59.404339919s) [noise=true , address=77.90.31.10:4529 , piece_id=DA4VMANHJ7BKZWDCO7SSSRJCWGGWPFKRHBQFYG2LOENDUZMHNVFA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.973466223 (302h51m59.404546354s) [noise=true , address=104.36.82.44:4894 , piece_id=5YMQEQDIDOZWDU63UQN32V3AHBCSJGJ4Y5F6FCRBTSAK44GMZXVQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.973658471 (302h51m59.404738602s) [noise=true , address=77.90.31.17:4801 , piece_id=3ZTGA7LBXDOVFYJ3IS2NBV5ZDHIE63QIK4QPWLWZF35LVMXY5DFA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:06.482745246 (302h52m0.913825377s) [upload=315044]: Next returned nil segment
Aug 21 08:18:06.482758753 (302h52m0.913838884s) [upload=315044]: Waiting for error group managing segments...
Aug 21 08:18:06.864337522 (302h52m1.295417653s) [noise=true , address=77.90.31.18:4831 , piece_id=D7LDSIZUSKBTEUZ3GAFCA7XUAAYF3PK4OWOUDSBK7KFRIMGBUK5Q, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.868586702 (302h52m1.299666833s) [noise=true , address=45.91.116.7:4033 , piece_id=7QVB2SEVSEF3RSGRO3WYI6C4NM4RXLRG6HG4U3P5T37MSQOHMF5Q, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.869304476 (302h52m1.300384597s) [noise=true , address=77.90.31.16:4749 , piece_id=Z2I4PDUTHJGPINQHVS2ISWINT6KU4EETH7EWDS2XKSIX7KTLRKRQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.869697237 (302h52m1.300777369s) [noise=true , address=79.127.219.47:4068 , piece_id=6TB6ITF3TFIX26EOVI7AQ7CZHZFTHXKGXJWEFVOCK4BXMZ3R2IJQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.909771515 (302h52m1.340851646s) [noise=true , address=77.90.31.15:4712 , piece_id=KPYSCPYS43EK5ZTN7WAKMNSQ44LLFWCA7BLXITZI2CUCLI23G4SQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.938883568 (302h52m1.369963699s) [noise=true , address=77.90.31.21:4902 , piece_id=ORFR3KKQHQW4GKFIMXRWE7JZ2LAGJZCJP5NSXHHNH7LJ2LCA3LJQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.940118662 (302h52m1.371198793s) [noise=true , address=104.36.82.5:4861 , piece_id=SGEKIBE24KNBBMVXGKO6TPCYL42UKQFQOLTXOLZLUYDKJGDNZYUA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.964532936 (302h52m1.395613067s) [noise=true , address=77.90.31.13:4647 , piece_id=7EHZB4EHH266IF5GNYPMXCI5PVI6LBFOICOI6BJJN4HAVLHZI5YA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.965028253 (302h52m1.396108384s) [noise=true , address=77.90.31.10:4529 , piece_id=DA4VMANHJ7BKZWDCO7SSSRJCWGGWPFKRHBQFYG2LOENDUZMHNVFA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.967305881 (302h52m1.398386012s) [noise=true , address=104.36.82.44:4894 , piece_id=5YMQEQDIDOZWDU63UQN32V3AHBCSJGJ4Y5F6FCRBTSAK44GMZXVQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.983495528 (302h52m1.414575659s) [noise=true , address=104.36.82.49:4004 , piece_id=YL2V2PKAL2XLRYFHVQ7LPRX6X7IQQOK7FQW7UBWRWI6OYM3FYQKQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.986669832 (302h52m1.417749963s) [noise=true , address=77.90.31.17:4801 , piece_id=3ZTGA7LBXDOVFYJ3IS2NBV5ZDHIE63QIK4QPWLWZF35LVMXY5DFA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:07.002715884 (302h52m1.433796025s) [noise=true , address=104.36.82.50:4014 , piece_id=PM2BW5IKSZV4SFGCVTLI7XGXC2UFS7A4DIYXOSE3WORYXENILAUQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:07.006350449 (302h52m1.43743058s) [noise=true , address=45.91.116.12:4258 , piece_id=V7E7DYYSODA7GUBSSYBWBMVMOTPIHL2P6DWYWXX23PGOGZVZWYWA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:07.006367080 (302h52m1.437447211s) [seg_pos={0 0}, upload=315044]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:18:07.006463265 (302h52m1.437543396s) [noise=true , address=77.90.31.12:4614 , piece_id=WJBM7OCBPW6MHRS3WUPXCBWGZ6FTPIMK3GG44ZLFKH5VFZMDG62A, seg_pos={0 0}, upload=315044]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wKLBwTAdUVAQmQGcafdpUcjiDE89jxdptEwXoAvV6WXf2Xbc3): protocol: expected piece hash; context canceled; EOF
Aug 21 08:18:07.006521606 (302h52m1.437601737s) [noise=true , address=104.36.82.19:4423 , piece_id=HBRYY6ZK4NOTTFQKZY3TB2DDIZOWC7NLRKS6MSI3PYNP74NVPL7Q, seg_pos={0 0}, upload=315044]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rpox27kwUgBKkqhfexgNQPEomMivnFFy5bJAmNmbaFDhaaBSM): protocol: expected piece hash; context canceled; EOF
Aug 21 08:18:07.006570079 (302h52m1.43765021s) [noise=true , address=104.36.82.44:4889 , piece_id=QBABOM6MZ4Z7DTTXYURN53T4RAHCTBHRKXZV4U353MD3YZUT5VUQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PCtJRFHPHi1dHJNcRnGZg8HZPQDfo5L3aw6DgVnUzVUz92Kyv): protocol: expected piece hash; context canceled; EOF
Aug 21 08:18:07.006662947 (302h52m1.437743078s) [noise=true , address=45.91.116.8:4076 , piece_id=H2Z4IUQIOYHFHYWIJZVO5YBRN5BV3QAD2LOSB5ZQLDYHO33Q5RZA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WWDBuhCg17uYobyN1WCxT6TdHXjHg9NknseutbiCpKdGo1Nd1): protocol: write tcp 188.166.225.170:40308->45.91.116.8:4076: use of closed network connection; write tcp 188.166.225.170:40308->45.91.116.8:4076: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40308->45.91.116.8:4076: use of closed network connection
Aug 21 08:18:07.006697072 (302h52m1.437777203s) [seg_pos={0 0}, upload=315044]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:18:07.006774871 (302h52m1.437855002s) [upload=315044]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:18:07.006778858 (302h52m1.437858979s) [upload=315044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:18:07.297592168 (302h52m1.728672299s) [upload=315044]: Done uploading segments...
Aug 21 08:18:07.297609962 (302h52m1.728690093s) [upload=315044]: Upload finished. err: <nil>
Duration: 5.476665691s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
9 out of 60 is failed (threshold=3) [.XX......X...................X.X....X......X...X..X.........] duration:
1.824138013s
FAIL (2025-08-21 08:18:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.824172497s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...............................X..................X.....X..X] duration:
3.874984988s
FAIL (2025-08-21 08:18:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 08:18:04.515966506 (302h51m58.947046637s) [upload=315044]: Starting upload
Aug 21 08:18:04.516012584 (302h51m58.947092715s) [upload=315044]: Done starting upload
Aug 21 08:18:04.516115160 (302h51m58.947195291s) [upload=315044]: Uploading segments...
Aug 21 08:18:04.516253375 (302h51m58.947333506s) [upload=315044]: Got next segment. Inline: false
Aug 21 08:18:04.516287581 (302h51m58.947367712s) [upload=315044]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:18:04.516313911 (302h51m58.947394042s) [upload=315044]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:18:04.970219931 (302h51m59.401300062s) [seg_pos={0 0}, upload=315044]: Begin upload segment...
Aug 21 08:18:04.970277491 (302h51m59.401357622s) [seg_pos={0 0}, upload=315044]: Done begin upload segment.
Aug 21 08:18:04.970297490 (302h51m59.401377621s) [noise=true , address=104.36.82.49:4004 , piece_id=YL2V2PKAL2XLRYFHVQ7LPRX6X7IQQOK7FQW7UBWRWI6OYM3FYQKQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.970687837 (302h51m59.401767968s) [noise=true , address=77.90.31.16:4749 , piece_id=Z2I4PDUTHJGPINQHVS2ISWINT6KU4EETH7EWDS2XKSIX7KTLRKRQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.970881487 (302h51m59.401961618s) [noise=true , address=45.91.116.7:4033 , piece_id=7QVB2SEVSEF3RSGRO3WYI6C4NM4RXLRG6HG4U3P5T37MSQOHMF5Q, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.971047965 (302h51m59.402128087s) [noise=true , address=45.91.116.12:4258 , piece_id=V7E7DYYSODA7GUBSSYBWBMVMOTPIHL2P6DWYWXX23PGOGZVZWYWA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.971252127 (302h51m59.402332258s) [noise=true , address=79.127.219.47:4068 , piece_id=6TB6ITF3TFIX26EOVI7AQ7CZHZFTHXKGXJWEFVOCK4BXMZ3R2IJQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.971450997 (302h51m59.402531128s) [noise=true , address=77.90.31.13:4647 , piece_id=7EHZB4EHH266IF5GNYPMXCI5PVI6LBFOICOI6BJJN4HAVLHZI5YA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.971485583 (302h51m59.402565704s) [noise=true , address=45.91.116.8:4076 , piece_id=H2Z4IUQIOYHFHYWIJZVO5YBRN5BV3QAD2LOSB5ZQLDYHO33Q5RZA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.971734930 (302h51m59.402815051s) [noise=true , address=77.90.31.15:4712 , piece_id=KPYSCPYS43EK5ZTN7WAKMNSQ44LLFWCA7BLXITZI2CUCLI23G4SQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972003183 (302h51m59.403083314s) [noise=true , address=77.90.31.18:4831 , piece_id=D7LDSIZUSKBTEUZ3GAFCA7XUAAYF3PK4OWOUDSBK7KFRIMGBUK5Q, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972130077 (302h51m59.403210198s) [noise=true , address=104.36.82.44:4889 , piece_id=QBABOM6MZ4Z7DTTXYURN53T4RAHCTBHRKXZV4U353MD3YZUT5VUQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972285133 (302h51m59.403365264s) [noise=true , address=77.90.31.12:4614 , piece_id=WJBM7OCBPW6MHRS3WUPXCBWGZ6FTPIMK3GG44ZLFKH5VFZMDG62A, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972402969 (302h51m59.4034831s) [noise=true , address=104.36.82.5:4861 , piece_id=SGEKIBE24KNBBMVXGKO6TPCYL42UKQFQOLTXOLZLUYDKJGDNZYUA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972614052 (302h51m59.403694173s) [noise=true , address=104.36.82.19:4423 , piece_id=HBRYY6ZK4NOTTFQKZY3TB2DDIZOWC7NLRKS6MSI3PYNP74NVPL7Q, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.972819245 (302h51m59.403899376s) [noise=true , address=104.36.82.50:4014 , piece_id=PM2BW5IKSZV4SFGCVTLI7XGXC2UFS7A4DIYXOSE3WORYXENILAUQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.973020730 (302h51m59.404100861s) [noise=true , address=77.90.31.21:4902 , piece_id=ORFR3KKQHQW4GKFIMXRWE7JZ2LAGJZCJP5NSXHHNH7LJ2LCA3LJQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.973259788 (302h51m59.404339919s) [noise=true , address=77.90.31.10:4529 , piece_id=DA4VMANHJ7BKZWDCO7SSSRJCWGGWPFKRHBQFYG2LOENDUZMHNVFA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.973466223 (302h51m59.404546354s) [noise=true , address=104.36.82.44:4894 , piece_id=5YMQEQDIDOZWDU63UQN32V3AHBCSJGJ4Y5F6FCRBTSAK44GMZXVQ, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:04.973658471 (302h51m59.404738602s) [noise=true , address=77.90.31.17:4801 , piece_id=3ZTGA7LBXDOVFYJ3IS2NBV5ZDHIE63QIK4QPWLWZF35LVMXY5DFA, seg_pos={0 0}, upload=315044]: Uploading piece...
Aug 21 08:18:06.482745246 (302h52m0.913825377s) [upload=315044]: Next returned nil segment
Aug 21 08:18:06.482758753 (302h52m0.913838884s) [upload=315044]: Waiting for error group managing segments...
Aug 21 08:18:06.864337522 (302h52m1.295417653s) [noise=true , address=77.90.31.18:4831 , piece_id=D7LDSIZUSKBTEUZ3GAFCA7XUAAYF3PK4OWOUDSBK7KFRIMGBUK5Q, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.868586702 (302h52m1.299666833s) [noise=true , address=45.91.116.7:4033 , piece_id=7QVB2SEVSEF3RSGRO3WYI6C4NM4RXLRG6HG4U3P5T37MSQOHMF5Q, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.869304476 (302h52m1.300384597s) [noise=true , address=77.90.31.16:4749 , piece_id=Z2I4PDUTHJGPINQHVS2ISWINT6KU4EETH7EWDS2XKSIX7KTLRKRQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.869697237 (302h52m1.300777369s) [noise=true , address=79.127.219.47:4068 , piece_id=6TB6ITF3TFIX26EOVI7AQ7CZHZFTHXKGXJWEFVOCK4BXMZ3R2IJQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.909771515 (302h52m1.340851646s) [noise=true , address=77.90.31.15:4712 , piece_id=KPYSCPYS43EK5ZTN7WAKMNSQ44LLFWCA7BLXITZI2CUCLI23G4SQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.938883568 (302h52m1.369963699s) [noise=true , address=77.90.31.21:4902 , piece_id=ORFR3KKQHQW4GKFIMXRWE7JZ2LAGJZCJP5NSXHHNH7LJ2LCA3LJQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.940118662 (302h52m1.371198793s) [noise=true , address=104.36.82.5:4861 , piece_id=SGEKIBE24KNBBMVXGKO6TPCYL42UKQFQOLTXOLZLUYDKJGDNZYUA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.964532936 (302h52m1.395613067s) [noise=true , address=77.90.31.13:4647 , piece_id=7EHZB4EHH266IF5GNYPMXCI5PVI6LBFOICOI6BJJN4HAVLHZI5YA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.965028253 (302h52m1.396108384s) [noise=true , address=77.90.31.10:4529 , piece_id=DA4VMANHJ7BKZWDCO7SSSRJCWGGWPFKRHBQFYG2LOENDUZMHNVFA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.967305881 (302h52m1.398386012s) [noise=true , address=104.36.82.44:4894 , piece_id=5YMQEQDIDOZWDU63UQN32V3AHBCSJGJ4Y5F6FCRBTSAK44GMZXVQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.983495528 (302h52m1.414575659s) [noise=true , address=104.36.82.49:4004 , piece_id=YL2V2PKAL2XLRYFHVQ7LPRX6X7IQQOK7FQW7UBWRWI6OYM3FYQKQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:06.986669832 (302h52m1.417749963s) [noise=true , address=77.90.31.17:4801 , piece_id=3ZTGA7LBXDOVFYJ3IS2NBV5ZDHIE63QIK4QPWLWZF35LVMXY5DFA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:07.002715884 (302h52m1.433796025s) [noise=true , address=104.36.82.50:4014 , piece_id=PM2BW5IKSZV4SFGCVTLI7XGXC2UFS7A4DIYXOSE3WORYXENILAUQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:07.006350449 (302h52m1.43743058s) [noise=true , address=45.91.116.12:4258 , piece_id=V7E7DYYSODA7GUBSSYBWBMVMOTPIHL2P6DWYWXX23PGOGZVZWYWA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: <nil>
Aug 21 08:18:07.006367080 (302h52m1.437447211s) [seg_pos={0 0}, upload=315044]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:18:07.006463265 (302h52m1.437543396s) [noise=true , address=77.90.31.12:4614 , piece_id=WJBM7OCBPW6MHRS3WUPXCBWGZ6FTPIMK3GG44ZLFKH5VFZMDG62A, seg_pos={0 0}, upload=315044]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wKLBwTAdUVAQmQGcafdpUcjiDE89jxdptEwXoAvV6WXf2Xbc3): protocol: expected piece hash; context canceled; EOF
Aug 21 08:18:07.006521606 (302h52m1.437601737s) [noise=true , address=104.36.82.19:4423 , piece_id=HBRYY6ZK4NOTTFQKZY3TB2DDIZOWC7NLRKS6MSI3PYNP74NVPL7Q, seg_pos={0 0}, upload=315044]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Rpox27kwUgBKkqhfexgNQPEomMivnFFy5bJAmNmbaFDhaaBSM): protocol: expected piece hash; context canceled; EOF
Aug 21 08:18:07.006570079 (302h52m1.43765021s) [noise=true , address=104.36.82.44:4889 , piece_id=QBABOM6MZ4Z7DTTXYURN53T4RAHCTBHRKXZV4U353MD3YZUT5VUQ, seg_pos={0 0}, upload=315044]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PCtJRFHPHi1dHJNcRnGZg8HZPQDfo5L3aw6DgVnUzVUz92Kyv): protocol: expected piece hash; context canceled; EOF
Aug 21 08:18:07.006662947 (302h52m1.437743078s) [noise=true , address=45.91.116.8:4076 , piece_id=H2Z4IUQIOYHFHYWIJZVO5YBRN5BV3QAD2LOSB5ZQLDYHO33Q5RZA, seg_pos={0 0}, upload=315044]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WWDBuhCg17uYobyN1WCxT6TdHXjHg9NknseutbiCpKdGo1Nd1): protocol: write tcp 188.166.225.170:40308->45.91.116.8:4076: use of closed network connection; write tcp 188.166.225.170:40308->45.91.116.8:4076: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40308->45.91.116.8:4076: use of closed network connection
Aug 21 08:18:07.006697072 (302h52m1.437777203s) [seg_pos={0 0}, upload=315044]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:18:07.006774871 (302h52m1.437855002s) [upload=315044]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:18:07.006778858 (302h52m1.437858979s) [upload=315044]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:18:07.297592168 (302h52m1.728672299s) [upload=315044]: Done uploading segments...
Aug 21 08:18:07.297609962 (302h52m1.728690093s) [upload=315044]: Upload finished. err: <nil>
Duration: 3.875011259s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
9 out of 60 is failed (threshold=3) [..XX......X...................X.X....X......X...X..X........] duration:
1.978766394s
FAIL (2025-08-21 08:17:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.978787935s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................................X..................X.....X..] duration:
5.615175632s
FAIL (2025-08-21 08:17:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 08:16:34.226416430 (302h50m28.657496561s) [upload=315020]: Starting upload
Aug 21 08:16:34.226455214 (302h50m28.657535335s) [upload=315020]: Done starting upload
Aug 21 08:16:34.226639106 (302h50m28.657719237s) [upload=315020]: Uploading segments...
Aug 21 08:16:34.226719440 (302h50m28.657799571s) [upload=315020]: Got next segment. Inline: false
Aug 21 08:16:34.226775227 (302h50m28.657855358s) [upload=315020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:16:34.226779765 (302h50m28.657859886s) [upload=315020]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:16:34.675337592 (302h50m29.106417733s) [seg_pos={0 0}, upload=315020]: Begin upload segment...
Aug 21 08:16:34.675412356 (302h50m29.106492487s) [seg_pos={0 0}, upload=315020]: Done begin upload segment.
Aug 21 08:16:34.675450909 (302h50m29.10653104s) [noise=true , address=45.91.116.8:4058 , piece_id=CSZO74IX4QIEVUQFFACFMDICSF6BXE5ECW4VUD4U6B46CRYWSCNQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.675456931 (302h50m29.106537062s) [noise=true , address=77.90.31.15:4718 , piece_id=KZCQZH6FUMJGZYQQDB4E7GZB47J2FBJ43W4IRVYEP6A7RUIT5RIA, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.676102145 (302h50m29.107182286s) [noise=true , address=104.36.82.5:4867 , piece_id=UCAW76GRIQ7DP2CZEFDLV5L4CBWIMR4QAHKKF42YZD6MUQPMEJBA, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.676509615 (302h50m29.107589746s) [noise=true , address=45.91.116.9:4289 , piece_id=CZ4QKSO2JZC7C2WOV2UMLTLWKJDJRU3SIC7UDC7NSJDI234SDSBQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.676650845 (302h50m29.107730976s) [noise=true , address=79.127.219.48:4108 , piece_id=KIMXZFNMJKZ7O6UZI5GJ6IKGI4MS43HFKNYV6W2IXXPMHFGF7GLQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.676795782 (302h50m29.107875913s) [noise=true , address=104.36.82.60:4361 , piece_id=5O74GHRYHHIQJAMLZBSJUIEKOY4DXJVYXO4DKJOSJ7ACOLVYN4ZA, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.677033227 (302h50m29.108113358s) [noise=true , address=45.91.116.14:4222 , piece_id=MXI4QG4CJ5GOLEDL5INHYRAZ4QKCPOAFA76EF6PGCSMURVGFJNYQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.677183164 (302h50m29.108263305s) [noise=true , address=77.90.31.10:4521 , piece_id=TLNDB56FXS7VSH7EU3CWEAMMKVGZV562X2ZIAJERVCCOEF23GNTA, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.677262656 (302h50m29.108342777s) [noise=true , address=104.36.82.44:4890 , piece_id=CMZ4H6DZKNA5SSFSW577HZSCEV335GJ7XNSGQ3GE4UZKAHB3YBUA, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.677492947 (302h50m29.108573078s) [noise=true , address=104.36.82.11:4134 , piece_id=R4SBW5HXACAVW5L3OYCQ5NYZU2M2KXY5QDE553SBBRSL4JJQTSIQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.677683351 (302h50m29.108763482s) [noise=true , address=45.91.116.7:4033 , piece_id=B7Y56YZECPD6BJ2WO2KAVIKLV5X7DU3JSIAIJEQ3X3VPFSQ5QQFQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.677720732 (302h50m29.108800863s) [noise=true , address=104.36.82.17:4360 , piece_id=RKIHTOBHGVIR7XAGKDV73Q76FBLSLCXC6DLAD47TLEXWLGZ7IHWQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.677985690 (302h50m29.109065821s) [noise=true , address=77.90.31.19:4852 , piece_id=K2QAO6IB3QIWD5VODE73S2WCFQXW2W7CQ4FIM56Y466WAOJO4GIQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.678169131 (302h50m29.109249262s) [noise=true , address=104.36.82.49:4979 , piece_id=JUM2VGMGCAXLYWTPFKON5WYR44CYN5UT3KM6JHRJUV5BT4V5OM6A, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.678187115 (302h50m29.109267246s) [noise=true , address=104.36.82.10:4085 , piece_id=TLYPTZYRQIOIS4AZUWGZ32JJLWEWEYDWHNGEA5Q5LI3M62H7TOTQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.678392408 (302h50m29.109472529s) [noise=true , address=79.127.201.215:4344 , piece_id=YEO4ERZKJSXWRKZYUGPPPJ5BFZ2Y2PTSZGKC4V4767UIHO2ZMTTA, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.678600115 (302h50m29.109680246s) [noise=true , address=104.36.82.23:4450 , piece_id=IPUZYLSTL64XNRXWQJCW73WWNA7IRTSROXIWXU36PF4MZGY5VH4A, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.678812171 (302h50m29.109892292s) [noise=true , address=77.90.31.21:4912 , piece_id=C6JCWULXE5IUQAWQSYOF7KTMBT7DTPFQAYNLHFTHJQJSD2APSJEA, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:36.182671875 (302h50m30.613752006s) [upload=315020]: Next returned nil segment
Aug 21 08:16:36.182709587 (302h50m30.613789718s) [upload=315020]: Waiting for error group managing segments...
Aug 21 08:16:36.560943958 (302h50m30.992024089s) [noise=true , address=77.90.31.19:4852 , piece_id=K2QAO6IB3QIWD5VODE73S2WCFQXW2W7CQ4FIM56Y466WAOJO4GIQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.569697466 (302h50m31.000777648s) [noise=true , address=45.91.116.14:4222 , piece_id=MXI4QG4CJ5GOLEDL5INHYRAZ4QKCPOAFA76EF6PGCSMURVGFJNYQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.591562212 (302h50m31.022642343s) [noise=true , address=104.36.82.23:4450 , piece_id=IPUZYLSTL64XNRXWQJCW73WWNA7IRTSROXIWXU36PF4MZGY5VH4A, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.591596818 (302h50m31.022676939s) [noise=true , address=79.127.219.48:4108 , piece_id=KIMXZFNMJKZ7O6UZI5GJ6IKGI4MS43HFKNYV6W2IXXPMHFGF7GLQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.593203312 (302h50m31.024283473s) [noise=true , address=45.91.116.8:4058 , piece_id=CSZO74IX4QIEVUQFFACFMDICSF6BXE5ECW4VUD4U6B46CRYWSCNQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.604982701 (302h50m31.036062832s) [noise=true , address=45.91.116.7:4033 , piece_id=B7Y56YZECPD6BJ2WO2KAVIKLV5X7DU3JSIAIJEQ3X3VPFSQ5QQFQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.618956528 (302h50m31.050036659s) [noise=true , address=77.90.31.21:4912 , piece_id=C6JCWULXE5IUQAWQSYOF7KTMBT7DTPFQAYNLHFTHJQJSD2APSJEA, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.652975299 (302h50m31.08405542s) [noise=true , address=77.90.31.10:4521 , piece_id=TLNDB56FXS7VSH7EU3CWEAMMKVGZV562X2ZIAJERVCCOEF23GNTA, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.658646651 (302h50m31.089726782s) [noise=true , address=104.36.82.49:4979 , piece_id=JUM2VGMGCAXLYWTPFKON5WYR44CYN5UT3KM6JHRJUV5BT4V5OM6A, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.660594247 (302h50m31.091674378s) [noise=true , address=45.91.116.9:4289 , piece_id=CZ4QKSO2JZC7C2WOV2UMLTLWKJDJRU3SIC7UDC7NSJDI234SDSBQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.669633503 (302h50m31.100713624s) [noise=true , address=104.36.82.44:4890 , piece_id=CMZ4H6DZKNA5SSFSW577HZSCEV335GJ7XNSGQ3GE4UZKAHB3YBUA, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.674366519 (302h50m31.10544664s) [noise=true , address=104.36.82.5:4867 , piece_id=UCAW76GRIQ7DP2CZEFDLV5L4CBWIMR4QAHKKF42YZD6MUQPMEJBA, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.680081183 (302h50m31.111161304s) [noise=true , address=77.90.31.15:4718 , piece_id=KZCQZH6FUMJGZYQQDB4E7GZB47J2FBJ43W4IRVYEP6A7RUIT5RIA, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.702030712 (302h50m31.133110843s) [noise=true , address=104.36.82.17:4360 , piece_id=RKIHTOBHGVIR7XAGKDV73Q76FBLSLCXC6DLAD47TLEXWLGZ7IHWQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.702058385 (302h50m31.133138506s) [seg_pos={0 0}, upload=315020]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:16:36.702162023 (302h50m31.133242154s) [noise=true , address=79.127.201.215:4344 , piece_id=YEO4ERZKJSXWRKZYUGPPPJ5BFZ2Y2PTSZGKC4V4767UIHO2ZMTTA, seg_pos={0 0}, upload=315020]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 21 08:16:36.702227218 (302h50m31.133307349s) [noise=true , address=104.36.82.10:4085 , piece_id=TLYPTZYRQIOIS4AZUWGZ32JJLWEWEYDWHNGEA5Q5LI3M62H7TOTQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18ifvnz4vwaopBJQbF88B1N6DGFmEtfH4jhD3YcneLXCPj7KVu): protocol: expected piece hash; context canceled; EOF
Aug 21 08:16:36.702278766 (302h50m31.133358897s) [noise=true , address=104.36.82.11:4134 , piece_id=R4SBW5HXACAVW5L3OYCQ5NYZU2M2KXY5QDE553SBBRSL4JJQTSIQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12R3Z5AgkBmWXMv5XgRyfcyqkG2gmyJs9ogT24kcLy6nuB9bzUG): protocol: expected piece hash; context canceled; EOF
Aug 21 08:16:36.702316239 (302h50m31.13339636s) [noise=true , address=104.36.82.60:4361 , piece_id=5O74GHRYHHIQJAMLZBSJUIEKOY4DXJVYXO4DKJOSJ7ACOLVYN4ZA, seg_pos={0 0}, upload=315020]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: expected piece hash; context canceled; EOF
Aug 21 08:16:36.702366915 (302h50m31.133447046s) [seg_pos={0 0}, upload=315020]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:16:36.702441598 (302h50m31.133521729s) [upload=315020]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:16:36.702446036 (302h50m31.133526167s) [upload=315020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:16:36.993169695 (302h50m31.424249826s) [upload=315020]: Done uploading segments...
Aug 21 08:16:36.993186697 (302h50m31.424266829s) [upload=315020]: Upload finished. err: <nil>
Duration: 5.615200408s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................................X..................X.....X.] duration:
5.640190038s
FAIL (2025-08-21 08:16:57 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 08:16:34.226416430 (302h50m28.657496561s) [upload=315020]: Starting upload
Aug 21 08:16:34.226455214 (302h50m28.657535335s) [upload=315020]: Done starting upload
Aug 21 08:16:34.226639106 (302h50m28.657719237s) [upload=315020]: Uploading segments...
Aug 21 08:16:34.226719440 (302h50m28.657799571s) [upload=315020]: Got next segment. Inline: false
Aug 21 08:16:34.226775227 (302h50m28.657855358s) [upload=315020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:16:34.226779765 (302h50m28.657859886s) [upload=315020]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:16:34.675337592 (302h50m29.106417733s) [seg_pos={0 0}, upload=315020]: Begin upload segment...
Aug 21 08:16:34.675412356 (302h50m29.106492487s) [seg_pos={0 0}, upload=315020]: Done begin upload segment.
Aug 21 08:16:34.675450909 (302h50m29.10653104s) [noise=true , address=45.91.116.8:4058 , piece_id=CSZO74IX4QIEVUQFFACFMDICSF6BXE5ECW4VUD4U6B46CRYWSCNQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.675456931 (302h50m29.106537062s) [noise=true , address=77.90.31.15:4718 , piece_id=KZCQZH6FUMJGZYQQDB4E7GZB47J2FBJ43W4IRVYEP6A7RUIT5RIA, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.676102145 (302h50m29.107182286s) [noise=true , address=104.36.82.5:4867 , piece_id=UCAW76GRIQ7DP2CZEFDLV5L4CBWIMR4QAHKKF42YZD6MUQPMEJBA, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.676509615 (302h50m29.107589746s) [noise=true , address=45.91.116.9:4289 , piece_id=CZ4QKSO2JZC7C2WOV2UMLTLWKJDJRU3SIC7UDC7NSJDI234SDSBQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.676650845 (302h50m29.107730976s) [noise=true , address=79.127.219.48:4108 , piece_id=KIMXZFNMJKZ7O6UZI5GJ6IKGI4MS43HFKNYV6W2IXXPMHFGF7GLQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.676795782 (302h50m29.107875913s) [noise=true , address=104.36.82.60:4361 , piece_id=5O74GHRYHHIQJAMLZBSJUIEKOY4DXJVYXO4DKJOSJ7ACOLVYN4ZA, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.677033227 (302h50m29.108113358s) [noise=true , address=45.91.116.14:4222 , piece_id=MXI4QG4CJ5GOLEDL5INHYRAZ4QKCPOAFA76EF6PGCSMURVGFJNYQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.677183164 (302h50m29.108263305s) [noise=true , address=77.90.31.10:4521 , piece_id=TLNDB56FXS7VSH7EU3CWEAMMKVGZV562X2ZIAJERVCCOEF23GNTA, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.677262656 (302h50m29.108342777s) [noise=true , address=104.36.82.44:4890 , piece_id=CMZ4H6DZKNA5SSFSW577HZSCEV335GJ7XNSGQ3GE4UZKAHB3YBUA, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.677492947 (302h50m29.108573078s) [noise=true , address=104.36.82.11:4134 , piece_id=R4SBW5HXACAVW5L3OYCQ5NYZU2M2KXY5QDE553SBBRSL4JJQTSIQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.677683351 (302h50m29.108763482s) [noise=true , address=45.91.116.7:4033 , piece_id=B7Y56YZECPD6BJ2WO2KAVIKLV5X7DU3JSIAIJEQ3X3VPFSQ5QQFQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.677720732 (302h50m29.108800863s) [noise=true , address=104.36.82.17:4360 , piece_id=RKIHTOBHGVIR7XAGKDV73Q76FBLSLCXC6DLAD47TLEXWLGZ7IHWQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.677985690 (302h50m29.109065821s) [noise=true , address=77.90.31.19:4852 , piece_id=K2QAO6IB3QIWD5VODE73S2WCFQXW2W7CQ4FIM56Y466WAOJO4GIQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.678169131 (302h50m29.109249262s) [noise=true , address=104.36.82.49:4979 , piece_id=JUM2VGMGCAXLYWTPFKON5WYR44CYN5UT3KM6JHRJUV5BT4V5OM6A, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.678187115 (302h50m29.109267246s) [noise=true , address=104.36.82.10:4085 , piece_id=TLYPTZYRQIOIS4AZUWGZ32JJLWEWEYDWHNGEA5Q5LI3M62H7TOTQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.678392408 (302h50m29.109472529s) [noise=true , address=79.127.201.215:4344 , piece_id=YEO4ERZKJSXWRKZYUGPPPJ5BFZ2Y2PTSZGKC4V4767UIHO2ZMTTA, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.678600115 (302h50m29.109680246s) [noise=true , address=104.36.82.23:4450 , piece_id=IPUZYLSTL64XNRXWQJCW73WWNA7IRTSROXIWXU36PF4MZGY5VH4A, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.678812171 (302h50m29.109892292s) [noise=true , address=77.90.31.21:4912 , piece_id=C6JCWULXE5IUQAWQSYOF7KTMBT7DTPFQAYNLHFTHJQJSD2APSJEA, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:36.182671875 (302h50m30.613752006s) [upload=315020]: Next returned nil segment
Aug 21 08:16:36.182709587 (302h50m30.613789718s) [upload=315020]: Waiting for error group managing segments...
Aug 21 08:16:36.560943958 (302h50m30.992024089s) [noise=true , address=77.90.31.19:4852 , piece_id=K2QAO6IB3QIWD5VODE73S2WCFQXW2W7CQ4FIM56Y466WAOJO4GIQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.569697466 (302h50m31.000777648s) [noise=true , address=45.91.116.14:4222 , piece_id=MXI4QG4CJ5GOLEDL5INHYRAZ4QKCPOAFA76EF6PGCSMURVGFJNYQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.591562212 (302h50m31.022642343s) [noise=true , address=104.36.82.23:4450 , piece_id=IPUZYLSTL64XNRXWQJCW73WWNA7IRTSROXIWXU36PF4MZGY5VH4A, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.591596818 (302h50m31.022676939s) [noise=true , address=79.127.219.48:4108 , piece_id=KIMXZFNMJKZ7O6UZI5GJ6IKGI4MS43HFKNYV6W2IXXPMHFGF7GLQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.593203312 (302h50m31.024283473s) [noise=true , address=45.91.116.8:4058 , piece_id=CSZO74IX4QIEVUQFFACFMDICSF6BXE5ECW4VUD4U6B46CRYWSCNQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.604982701 (302h50m31.036062832s) [noise=true , address=45.91.116.7:4033 , piece_id=B7Y56YZECPD6BJ2WO2KAVIKLV5X7DU3JSIAIJEQ3X3VPFSQ5QQFQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.618956528 (302h50m31.050036659s) [noise=true , address=77.90.31.21:4912 , piece_id=C6JCWULXE5IUQAWQSYOF7KTMBT7DTPFQAYNLHFTHJQJSD2APSJEA, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.652975299 (302h50m31.08405542s) [noise=true , address=77.90.31.10:4521 , piece_id=TLNDB56FXS7VSH7EU3CWEAMMKVGZV562X2ZIAJERVCCOEF23GNTA, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.658646651 (302h50m31.089726782s) [noise=true , address=104.36.82.49:4979 , piece_id=JUM2VGMGCAXLYWTPFKON5WYR44CYN5UT3KM6JHRJUV5BT4V5OM6A, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.660594247 (302h50m31.091674378s) [noise=true , address=45.91.116.9:4289 , piece_id=CZ4QKSO2JZC7C2WOV2UMLTLWKJDJRU3SIC7UDC7NSJDI234SDSBQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.669633503 (302h50m31.100713624s) [noise=true , address=104.36.82.44:4890 , piece_id=CMZ4H6DZKNA5SSFSW577HZSCEV335GJ7XNSGQ3GE4UZKAHB3YBUA, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.674366519 (302h50m31.10544664s) [noise=true , address=104.36.82.5:4867 , piece_id=UCAW76GRIQ7DP2CZEFDLV5L4CBWIMR4QAHKKF42YZD6MUQPMEJBA, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.680081183 (302h50m31.111161304s) [noise=true , address=77.90.31.15:4718 , piece_id=KZCQZH6FUMJGZYQQDB4E7GZB47J2FBJ43W4IRVYEP6A7RUIT5RIA, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.702030712 (302h50m31.133110843s) [noise=true , address=104.36.82.17:4360 , piece_id=RKIHTOBHGVIR7XAGKDV73Q76FBLSLCXC6DLAD47TLEXWLGZ7IHWQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.702058385 (302h50m31.133138506s) [seg_pos={0 0}, upload=315020]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:16:36.702162023 (302h50m31.133242154s) [noise=true , address=79.127.201.215:4344 , piece_id=YEO4ERZKJSXWRKZYUGPPPJ5BFZ2Y2PTSZGKC4V4767UIHO2ZMTTA, seg_pos={0 0}, upload=315020]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 21 08:16:36.702227218 (302h50m31.133307349s) [noise=true , address=104.36.82.10:4085 , piece_id=TLYPTZYRQIOIS4AZUWGZ32JJLWEWEYDWHNGEA5Q5LI3M62H7TOTQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18ifvnz4vwaopBJQbF88B1N6DGFmEtfH4jhD3YcneLXCPj7KVu): protocol: expected piece hash; context canceled; EOF
Aug 21 08:16:36.702278766 (302h50m31.133358897s) [noise=true , address=104.36.82.11:4134 , piece_id=R4SBW5HXACAVW5L3OYCQ5NYZU2M2KXY5QDE553SBBRSL4JJQTSIQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12R3Z5AgkBmWXMv5XgRyfcyqkG2gmyJs9ogT24kcLy6nuB9bzUG): protocol: expected piece hash; context canceled; EOF
Aug 21 08:16:36.702316239 (302h50m31.13339636s) [noise=true , address=104.36.82.60:4361 , piece_id=5O74GHRYHHIQJAMLZBSJUIEKOY4DXJVYXO4DKJOSJ7ACOLVYN4ZA, seg_pos={0 0}, upload=315020]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: expected piece hash; context canceled; EOF
Aug 21 08:16:36.702366915 (302h50m31.133447046s) [seg_pos={0 0}, upload=315020]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:16:36.702441598 (302h50m31.133521729s) [upload=315020]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:16:36.702446036 (302h50m31.133526167s) [upload=315020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:16:36.993169695 (302h50m31.424249826s) [upload=315020]: Done uploading segments...
Aug 21 08:16:36.993186697 (302h50m31.424266829s) [upload=315020]: Upload finished. err: <nil>
Duration: 5.640219334s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................................X..................X.....X] duration:
3.870531628s
FAIL (2025-08-21 08:16:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 08:16:34.226416430 (302h50m28.657496561s) [upload=315020]: Starting upload
Aug 21 08:16:34.226455214 (302h50m28.657535335s) [upload=315020]: Done starting upload
Aug 21 08:16:34.226639106 (302h50m28.657719237s) [upload=315020]: Uploading segments...
Aug 21 08:16:34.226719440 (302h50m28.657799571s) [upload=315020]: Got next segment. Inline: false
Aug 21 08:16:34.226775227 (302h50m28.657855358s) [upload=315020]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:16:34.226779765 (302h50m28.657859886s) [upload=315020]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:16:34.675337592 (302h50m29.106417733s) [seg_pos={0 0}, upload=315020]: Begin upload segment...
Aug 21 08:16:34.675412356 (302h50m29.106492487s) [seg_pos={0 0}, upload=315020]: Done begin upload segment.
Aug 21 08:16:34.675450909 (302h50m29.10653104s) [noise=true , address=45.91.116.8:4058 , piece_id=CSZO74IX4QIEVUQFFACFMDICSF6BXE5ECW4VUD4U6B46CRYWSCNQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.675456931 (302h50m29.106537062s) [noise=true , address=77.90.31.15:4718 , piece_id=KZCQZH6FUMJGZYQQDB4E7GZB47J2FBJ43W4IRVYEP6A7RUIT5RIA, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.676102145 (302h50m29.107182286s) [noise=true , address=104.36.82.5:4867 , piece_id=UCAW76GRIQ7DP2CZEFDLV5L4CBWIMR4QAHKKF42YZD6MUQPMEJBA, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.676509615 (302h50m29.107589746s) [noise=true , address=45.91.116.9:4289 , piece_id=CZ4QKSO2JZC7C2WOV2UMLTLWKJDJRU3SIC7UDC7NSJDI234SDSBQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.676650845 (302h50m29.107730976s) [noise=true , address=79.127.219.48:4108 , piece_id=KIMXZFNMJKZ7O6UZI5GJ6IKGI4MS43HFKNYV6W2IXXPMHFGF7GLQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.676795782 (302h50m29.107875913s) [noise=true , address=104.36.82.60:4361 , piece_id=5O74GHRYHHIQJAMLZBSJUIEKOY4DXJVYXO4DKJOSJ7ACOLVYN4ZA, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.677033227 (302h50m29.108113358s) [noise=true , address=45.91.116.14:4222 , piece_id=MXI4QG4CJ5GOLEDL5INHYRAZ4QKCPOAFA76EF6PGCSMURVGFJNYQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.677183164 (302h50m29.108263305s) [noise=true , address=77.90.31.10:4521 , piece_id=TLNDB56FXS7VSH7EU3CWEAMMKVGZV562X2ZIAJERVCCOEF23GNTA, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.677262656 (302h50m29.108342777s) [noise=true , address=104.36.82.44:4890 , piece_id=CMZ4H6DZKNA5SSFSW577HZSCEV335GJ7XNSGQ3GE4UZKAHB3YBUA, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.677492947 (302h50m29.108573078s) [noise=true , address=104.36.82.11:4134 , piece_id=R4SBW5HXACAVW5L3OYCQ5NYZU2M2KXY5QDE553SBBRSL4JJQTSIQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.677683351 (302h50m29.108763482s) [noise=true , address=45.91.116.7:4033 , piece_id=B7Y56YZECPD6BJ2WO2KAVIKLV5X7DU3JSIAIJEQ3X3VPFSQ5QQFQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.677720732 (302h50m29.108800863s) [noise=true , address=104.36.82.17:4360 , piece_id=RKIHTOBHGVIR7XAGKDV73Q76FBLSLCXC6DLAD47TLEXWLGZ7IHWQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.677985690 (302h50m29.109065821s) [noise=true , address=77.90.31.19:4852 , piece_id=K2QAO6IB3QIWD5VODE73S2WCFQXW2W7CQ4FIM56Y466WAOJO4GIQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.678169131 (302h50m29.109249262s) [noise=true , address=104.36.82.49:4979 , piece_id=JUM2VGMGCAXLYWTPFKON5WYR44CYN5UT3KM6JHRJUV5BT4V5OM6A, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.678187115 (302h50m29.109267246s) [noise=true , address=104.36.82.10:4085 , piece_id=TLYPTZYRQIOIS4AZUWGZ32JJLWEWEYDWHNGEA5Q5LI3M62H7TOTQ, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.678392408 (302h50m29.109472529s) [noise=true , address=79.127.201.215:4344 , piece_id=YEO4ERZKJSXWRKZYUGPPPJ5BFZ2Y2PTSZGKC4V4767UIHO2ZMTTA, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.678600115 (302h50m29.109680246s) [noise=true , address=104.36.82.23:4450 , piece_id=IPUZYLSTL64XNRXWQJCW73WWNA7IRTSROXIWXU36PF4MZGY5VH4A, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:34.678812171 (302h50m29.109892292s) [noise=true , address=77.90.31.21:4912 , piece_id=C6JCWULXE5IUQAWQSYOF7KTMBT7DTPFQAYNLHFTHJQJSD2APSJEA, seg_pos={0 0}, upload=315020]: Uploading piece...
Aug 21 08:16:36.182671875 (302h50m30.613752006s) [upload=315020]: Next returned nil segment
Aug 21 08:16:36.182709587 (302h50m30.613789718s) [upload=315020]: Waiting for error group managing segments...
Aug 21 08:16:36.560943958 (302h50m30.992024089s) [noise=true , address=77.90.31.19:4852 , piece_id=K2QAO6IB3QIWD5VODE73S2WCFQXW2W7CQ4FIM56Y466WAOJO4GIQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.569697466 (302h50m31.000777648s) [noise=true , address=45.91.116.14:4222 , piece_id=MXI4QG4CJ5GOLEDL5INHYRAZ4QKCPOAFA76EF6PGCSMURVGFJNYQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.591562212 (302h50m31.022642343s) [noise=true , address=104.36.82.23:4450 , piece_id=IPUZYLSTL64XNRXWQJCW73WWNA7IRTSROXIWXU36PF4MZGY5VH4A, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.591596818 (302h50m31.022676939s) [noise=true , address=79.127.219.48:4108 , piece_id=KIMXZFNMJKZ7O6UZI5GJ6IKGI4MS43HFKNYV6W2IXXPMHFGF7GLQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.593203312 (302h50m31.024283473s) [noise=true , address=45.91.116.8:4058 , piece_id=CSZO74IX4QIEVUQFFACFMDICSF6BXE5ECW4VUD4U6B46CRYWSCNQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.604982701 (302h50m31.036062832s) [noise=true , address=45.91.116.7:4033 , piece_id=B7Y56YZECPD6BJ2WO2KAVIKLV5X7DU3JSIAIJEQ3X3VPFSQ5QQFQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.618956528 (302h50m31.050036659s) [noise=true , address=77.90.31.21:4912 , piece_id=C6JCWULXE5IUQAWQSYOF7KTMBT7DTPFQAYNLHFTHJQJSD2APSJEA, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.652975299 (302h50m31.08405542s) [noise=true , address=77.90.31.10:4521 , piece_id=TLNDB56FXS7VSH7EU3CWEAMMKVGZV562X2ZIAJERVCCOEF23GNTA, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.658646651 (302h50m31.089726782s) [noise=true , address=104.36.82.49:4979 , piece_id=JUM2VGMGCAXLYWTPFKON5WYR44CYN5UT3KM6JHRJUV5BT4V5OM6A, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.660594247 (302h50m31.091674378s) [noise=true , address=45.91.116.9:4289 , piece_id=CZ4QKSO2JZC7C2WOV2UMLTLWKJDJRU3SIC7UDC7NSJDI234SDSBQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.669633503 (302h50m31.100713624s) [noise=true , address=104.36.82.44:4890 , piece_id=CMZ4H6DZKNA5SSFSW577HZSCEV335GJ7XNSGQ3GE4UZKAHB3YBUA, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.674366519 (302h50m31.10544664s) [noise=true , address=104.36.82.5:4867 , piece_id=UCAW76GRIQ7DP2CZEFDLV5L4CBWIMR4QAHKKF42YZD6MUQPMEJBA, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.680081183 (302h50m31.111161304s) [noise=true , address=77.90.31.15:4718 , piece_id=KZCQZH6FUMJGZYQQDB4E7GZB47J2FBJ43W4IRVYEP6A7RUIT5RIA, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.702030712 (302h50m31.133110843s) [noise=true , address=104.36.82.17:4360 , piece_id=RKIHTOBHGVIR7XAGKDV73Q76FBLSLCXC6DLAD47TLEXWLGZ7IHWQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: <nil>
Aug 21 08:16:36.702058385 (302h50m31.133138506s) [seg_pos={0 0}, upload=315020]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:16:36.702162023 (302h50m31.133242154s) [noise=true , address=79.127.201.215:4344 , piece_id=YEO4ERZKJSXWRKZYUGPPPJ5BFZ2Y2PTSZGKC4V4767UIHO2ZMTTA, seg_pos={0 0}, upload=315020]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 21 08:16:36.702227218 (302h50m31.133307349s) [noise=true , address=104.36.82.10:4085 , piece_id=TLYPTZYRQIOIS4AZUWGZ32JJLWEWEYDWHNGEA5Q5LI3M62H7TOTQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18ifvnz4vwaopBJQbF88B1N6DGFmEtfH4jhD3YcneLXCPj7KVu): protocol: expected piece hash; context canceled; EOF
Aug 21 08:16:36.702278766 (302h50m31.133358897s) [noise=true , address=104.36.82.11:4134 , piece_id=R4SBW5HXACAVW5L3OYCQ5NYZU2M2KXY5QDE553SBBRSL4JJQTSIQ, seg_pos={0 0}, upload=315020]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12R3Z5AgkBmWXMv5XgRyfcyqkG2gmyJs9ogT24kcLy6nuB9bzUG): protocol: expected piece hash; context canceled; EOF
Aug 21 08:16:36.702316239 (302h50m31.13339636s) [noise=true , address=104.36.82.60:4361 , piece_id=5O74GHRYHHIQJAMLZBSJUIEKOY4DXJVYXO4DKJOSJ7ACOLVYN4ZA, seg_pos={0 0}, upload=315020]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: expected piece hash; context canceled; EOF
Aug 21 08:16:36.702366915 (302h50m31.133447046s) [seg_pos={0 0}, upload=315020]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:16:36.702441598 (302h50m31.133521729s) [upload=315020]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:16:36.702446036 (302h50m31.133526167s) [upload=315020]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:16:36.993169695 (302h50m31.424249826s) [upload=315020]: Done uploading segments...
Aug 21 08:16:36.993186697 (302h50m31.424266829s) [upload=315020]: Upload finished. err: <nil>
Duration: 3.870560533s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
9 out of 60 is failed (threshold=3) [...XX......X...................X.X....X......X...X..X.......] duration:
1.838228602s
FAIL (2025-08-21 08:16:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.83826393s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................X..................X.....] duration:
5.782341847s
FAIL (2025-08-21 08:15:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 78776e19483792501368ce11a13d64168237fe76918a9cfe74655e907f86d30c != before cce00fa9311dbbda7d8404afb1aa77809aa5d15cd46cc1b278854a82517dcede
======LOGS======
Aug 21 08:11:55.178465811 (302h45m49.609545992s) [upload=314941]: Starting upload
Aug 21 08:11:55.178586061 (302h45m49.609666242s) [upload=314941]: Done starting upload
Aug 21 08:11:55.178726930 (302h45m49.609807091s) [upload=314941]: Uploading segments...
Aug 21 08:11:55.179128338 (302h45m49.61020851s) [upload=314941]: Got next segment. Inline: false
Aug 21 08:11:55.179195366 (302h45m49.610275497s) [upload=314941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:11:55.179200908 (302h45m49.610281039s) [upload=314941]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:11:55.623067328 (302h45m50.054147479s) [seg_pos={0 0}, upload=314941]: Begin upload segment...
Aug 21 08:11:55.623137623 (302h45m50.054217754s) [seg_pos={0 0}, upload=314941]: Done begin upload segment.
Aug 21 08:11:55.623154936 (302h45m50.054235057s) [noise=true , address=79.127.205.235:4662 , piece_id=235UI5ULTYCP66226NQJNWHO242OTZN5FT4FLJLOBCLYDQBXHENA, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.623177679 (302h45m50.054257811s) [noise=true , address=104.36.82.23:4480 , piece_id=V3PS4YDWDY7SDG3UGHK6PXODJFCCIML7K356DQVDZ7XTDRYLZ7OA, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.623600238 (302h45m50.054680369s) [noise=true , address=45.91.116.14:4203 , piece_id=6PL6MLRFABNBCX2P4HQRJGOZGJZETEMIC4YNUKKWGJG46ANYFRQQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.623699688 (302h45m50.05477997s) [noise=true , address=77.90.31.15:4725 , piece_id=HJ76KODVTWHXW4Z4MBMPLHTMUXYTJIEGU73XGGRXCAGGVOK7W3NQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.624213281 (302h45m50.055293412s) [noise=true , address=77.90.31.17:4782 , piece_id=6YCJU4RQNEP33R722IEECCERNENQZ355ZFQCFFLZ4GOPRYW4L37A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.624486825 (302h45m50.055566956s) [noise=true , address=45.91.116.6:4987 , piece_id=QDQFADB3UR6Y4EIAVLG7VEC36GRVRAXR6RKB3Y3M24J7P7NZRS5A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.624739127 (302h45m50.055819258s) [noise=true , address=79.127.201.215:4354 , piece_id=F3TTUHACYCAMV5TEFU7JN4ZAVQWNMPHMEVKPKFEYTKYOJ5JUZH5A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.625007451 (302h45m50.056087582s) [noise=true , address=104.36.82.19:4420 , piece_id=O2EWVX4F5H3Y2HGOZASASUO3C6C7LQJBNSVNTQGWBQN4TIZGZ4YQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.625275644 (302h45m50.056355765s) [noise=true , address=104.36.82.13:4217 , piece_id=ZF3CYGXF5YOEBQBAHRKW4WWZWWP4C3AYZB6IWPEOQ36DOTFHUMLQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.625512076 (302h45m50.056592207s) [noise=true , address=104.36.82.44:4877 , piece_id=2KF7NXJZ23DW35KIWPVINHWBSGJ5RO3SNUE3GNWJKSQGQ2B3RM3A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.625769219 (302h45m50.05684935s) [noise=true , address=77.90.31.11:4586 , piece_id=G5JA4LY5JGBHNXOISV6SN5ATM255VLLVNKH3JFJYM453WEJWIC7Q, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626022453 (302h45m50.057102584s) [noise=true , address=45.91.116.8:4060 , piece_id=JI3A4TSWDNDKVFIAOIQEUIOSYNWOCB7Z4XZVIMHZGWHLLYZ7G3GA, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626320323 (302h45m50.057400444s) [noise=true , address=79.127.219.47:4068 , piece_id=LASI244HE5KSAWCSXKBMTC6Q5RFEIAO67NCT6CVNZ4BVC4U4BEAQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626524022 (302h45m50.057604143s) [noise=true , address=77.90.31.10:4528 , piece_id=34RVQ7V2KG7LW4CPLQ3CNJEDCB6XEVONVLLT3EXGIUEFARDFGHLQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626713355 (302h45m50.057793476s) [noise=true , address=104.36.82.60:4342 , piece_id=BT5W4FFS5HT5WE2Z4PNKRM7W2UM5OZ6IE5YS6CDY6Q3VFBWEZBSQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626989844 (302h45m50.058069985s) [noise=true , address=77.90.31.18:4808 , piece_id=JKBBMGZZIJZYIQ3PY3ACBBF77H4Y4ZWSSDMPUROXMLZEAMTWC3GQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.627199836 (302h45m50.058279967s) [noise=true , address=79.127.205.233:4621 , piece_id=MCRLQA4XLZUFBTRSKRC4FYHFYQKB5WVJNWYT7DIBBCFYPTTI4SPA, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.627391713 (302h45m50.058471834s) [noise=true , address=79.127.219.51:4216 , piece_id=ECXFAFWW3QJG4DSFM3CM2QC5WESDMH4UN6X2XWW6MHVGT2RIXT6A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:56.760848848 (302h45m51.191928979s) [upload=314941]: Next returned nil segment
Aug 21 08:11:56.760867553 (302h45m51.191947684s) [upload=314941]: Waiting for error group managing segments...
Aug 21 08:11:57.046224006 (302h45m51.477304138s) [noise=true , address=79.127.205.233:4621 , piece_id=MCRLQA4XLZUFBTRSKRC4FYHFYQKB5WVJNWYT7DIBBCFYPTTI4SPA, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.069275282 (302h45m51.500355413s) [noise=true , address=79.127.205.235:4662 , piece_id=235UI5ULTYCP66226NQJNWHO242OTZN5FT4FLJLOBCLYDQBXHENA, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.525688852 (302h45m51.956768983s) [noise=true , address=77.90.31.15:4725 , piece_id=HJ76KODVTWHXW4Z4MBMPLHTMUXYTJIEGU73XGGRXCAGGVOK7W3NQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.531356345 (302h45m51.962436467s) [noise=true , address=77.90.31.18:4808 , piece_id=JKBBMGZZIJZYIQ3PY3ACBBF77H4Y4ZWSSDMPUROXMLZEAMTWC3GQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.541220099 (302h45m51.97230023s) [noise=true , address=77.90.31.10:4528 , piece_id=34RVQ7V2KG7LW4CPLQ3CNJEDCB6XEVONVLLT3EXGIUEFARDFGHLQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.552075008 (302h45m51.983155139s) [noise=true , address=79.127.219.51:4216 , piece_id=ECXFAFWW3QJG4DSFM3CM2QC5WESDMH4UN6X2XWW6MHVGT2RIXT6A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.554126984 (302h45m51.985207115s) [noise=true , address=45.91.116.14:4203 , piece_id=6PL6MLRFABNBCX2P4HQRJGOZGJZETEMIC4YNUKKWGJG46ANYFRQQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.611773464 (302h45m52.042853595s) [noise=true , address=45.91.116.6:4987 , piece_id=QDQFADB3UR6Y4EIAVLG7VEC36GRVRAXR6RKB3Y3M24J7P7NZRS5A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.613844145 (302h45m52.044924276s) [noise=true , address=77.90.31.11:4586 , piece_id=G5JA4LY5JGBHNXOISV6SN5ATM255VLLVNKH3JFJYM453WEJWIC7Q, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.615581309 (302h45m52.04666144s) [noise=true , address=79.127.219.47:4068 , piece_id=LASI244HE5KSAWCSXKBMTC6Q5RFEIAO67NCT6CVNZ4BVC4U4BEAQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.625495329 (302h45m52.05657546s) [noise=true , address=77.90.31.17:4782 , piece_id=6YCJU4RQNEP33R722IEECCERNENQZ355ZFQCFFLZ4GOPRYW4L37A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.637448009 (302h45m52.06852814s) [noise=true , address=104.36.82.19:4420 , piece_id=O2EWVX4F5H3Y2HGOZASASUO3C6C7LQJBNSVNTQGWBQN4TIZGZ4YQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.646508816 (302h45m52.077588947s) [noise=true , address=45.91.116.8:4060 , piece_id=JI3A4TSWDNDKVFIAOIQEUIOSYNWOCB7Z4XZVIMHZGWHLLYZ7G3GA, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.716278671 (302h45m52.147358802s) [noise=true , address=104.36.82.60:4342 , piece_id=BT5W4FFS5HT5WE2Z4PNKRM7W2UM5OZ6IE5YS6CDY6Q3VFBWEZBSQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.716303719 (302h45m52.14738384s) [seg_pos={0 0}, upload=314941]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:11:57.716408289 (302h45m52.14748842s) [noise=true , address=104.36.82.23:4480 , piece_id=V3PS4YDWDY7SDG3UGHK6PXODJFCCIML7K356DQVDZ7XTDRYLZ7OA, seg_pos={0 0}, upload=314941]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qQhWAdN83i1jMTYByNQ8SWGXQaXRgBGezkLTf1BTwLyKskjjU): protocol: expected piece hash; context canceled; EOF
Aug 21 08:11:57.716481049 (302h45m52.14756117s) [noise=true , address=104.36.82.13:4217 , piece_id=ZF3CYGXF5YOEBQBAHRKW4WWZWWP4C3AYZB6IWPEOQ36DOTFHUMLQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi): protocol: expected piece hash; context canceled; EOF
Aug 21 08:11:57.716510395 (302h45m52.147590526s) [noise=true , address=104.36.82.44:4877 , piece_id=2KF7NXJZ23DW35KIWPVINHWBSGJ5RO3SNUE3GNWJKSQGQ2B3RM3A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17TuauVrjKmehRpXqmK7bemU9V33GDZu9RGBs6fanXvJkV1gdH): protocol: expected piece hash; context canceled; EOF
Aug 21 08:11:57.716579707 (302h45m52.147659838s) [noise=true , address=79.127.201.215:4354 , piece_id=F3TTUHACYCAMV5TEFU7JN4ZAVQWNMPHMEVKPKFEYTKYOJ5JUZH5A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF
Aug 21 08:11:57.716624483 (302h45m52.147704614s) [seg_pos={0 0}, upload=314941]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:11:57.716706831 (302h45m52.147786952s) [upload=314941]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:11:57.716711820 (302h45m52.147791951s) [upload=314941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:11:58.015365586 (302h45m52.446445717s) [upload=314941]: Done uploading segments...
Aug 21 08:11:58.015394402 (302h45m52.446474533s) [upload=314941]: Upload finished. err: <nil>
Duration: 5.782371633s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
9 out of 60 is failed (threshold=3) [....XX......X...................X.X....X......X...X..X......] duration:
2.03508809s
FAIL (2025-08-21 08:15:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.035107346s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
9 out of 60 is failed (threshold=3) [.....XX......X...................X.X....X......X...X..X.....] duration:
1.858358633s
FAIL (2025-08-21 08:14:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.858384593s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X..................X....] duration:
5.636415896s
FAIL (2025-08-21 08:14:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 78776e19483792501368ce11a13d64168237fe76918a9cfe74655e907f86d30c != before cce00fa9311dbbda7d8404afb1aa77809aa5d15cd46cc1b278854a82517dcede
======LOGS======
Aug 21 08:11:55.178465811 (302h45m49.609545992s) [upload=314941]: Starting upload
Aug 21 08:11:55.178586061 (302h45m49.609666242s) [upload=314941]: Done starting upload
Aug 21 08:11:55.178726930 (302h45m49.609807091s) [upload=314941]: Uploading segments...
Aug 21 08:11:55.179128338 (302h45m49.61020851s) [upload=314941]: Got next segment. Inline: false
Aug 21 08:11:55.179195366 (302h45m49.610275497s) [upload=314941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:11:55.179200908 (302h45m49.610281039s) [upload=314941]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:11:55.623067328 (302h45m50.054147479s) [seg_pos={0 0}, upload=314941]: Begin upload segment...
Aug 21 08:11:55.623137623 (302h45m50.054217754s) [seg_pos={0 0}, upload=314941]: Done begin upload segment.
Aug 21 08:11:55.623154936 (302h45m50.054235057s) [noise=true , address=79.127.205.235:4662 , piece_id=235UI5ULTYCP66226NQJNWHO242OTZN5FT4FLJLOBCLYDQBXHENA, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.623177679 (302h45m50.054257811s) [noise=true , address=104.36.82.23:4480 , piece_id=V3PS4YDWDY7SDG3UGHK6PXODJFCCIML7K356DQVDZ7XTDRYLZ7OA, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.623600238 (302h45m50.054680369s) [noise=true , address=45.91.116.14:4203 , piece_id=6PL6MLRFABNBCX2P4HQRJGOZGJZETEMIC4YNUKKWGJG46ANYFRQQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.623699688 (302h45m50.05477997s) [noise=true , address=77.90.31.15:4725 , piece_id=HJ76KODVTWHXW4Z4MBMPLHTMUXYTJIEGU73XGGRXCAGGVOK7W3NQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.624213281 (302h45m50.055293412s) [noise=true , address=77.90.31.17:4782 , piece_id=6YCJU4RQNEP33R722IEECCERNENQZ355ZFQCFFLZ4GOPRYW4L37A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.624486825 (302h45m50.055566956s) [noise=true , address=45.91.116.6:4987 , piece_id=QDQFADB3UR6Y4EIAVLG7VEC36GRVRAXR6RKB3Y3M24J7P7NZRS5A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.624739127 (302h45m50.055819258s) [noise=true , address=79.127.201.215:4354 , piece_id=F3TTUHACYCAMV5TEFU7JN4ZAVQWNMPHMEVKPKFEYTKYOJ5JUZH5A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.625007451 (302h45m50.056087582s) [noise=true , address=104.36.82.19:4420 , piece_id=O2EWVX4F5H3Y2HGOZASASUO3C6C7LQJBNSVNTQGWBQN4TIZGZ4YQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.625275644 (302h45m50.056355765s) [noise=true , address=104.36.82.13:4217 , piece_id=ZF3CYGXF5YOEBQBAHRKW4WWZWWP4C3AYZB6IWPEOQ36DOTFHUMLQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.625512076 (302h45m50.056592207s) [noise=true , address=104.36.82.44:4877 , piece_id=2KF7NXJZ23DW35KIWPVINHWBSGJ5RO3SNUE3GNWJKSQGQ2B3RM3A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.625769219 (302h45m50.05684935s) [noise=true , address=77.90.31.11:4586 , piece_id=G5JA4LY5JGBHNXOISV6SN5ATM255VLLVNKH3JFJYM453WEJWIC7Q, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626022453 (302h45m50.057102584s) [noise=true , address=45.91.116.8:4060 , piece_id=JI3A4TSWDNDKVFIAOIQEUIOSYNWOCB7Z4XZVIMHZGWHLLYZ7G3GA, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626320323 (302h45m50.057400444s) [noise=true , address=79.127.219.47:4068 , piece_id=LASI244HE5KSAWCSXKBMTC6Q5RFEIAO67NCT6CVNZ4BVC4U4BEAQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626524022 (302h45m50.057604143s) [noise=true , address=77.90.31.10:4528 , piece_id=34RVQ7V2KG7LW4CPLQ3CNJEDCB6XEVONVLLT3EXGIUEFARDFGHLQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626713355 (302h45m50.057793476s) [noise=true , address=104.36.82.60:4342 , piece_id=BT5W4FFS5HT5WE2Z4PNKRM7W2UM5OZ6IE5YS6CDY6Q3VFBWEZBSQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626989844 (302h45m50.058069985s) [noise=true , address=77.90.31.18:4808 , piece_id=JKBBMGZZIJZYIQ3PY3ACBBF77H4Y4ZWSSDMPUROXMLZEAMTWC3GQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.627199836 (302h45m50.058279967s) [noise=true , address=79.127.205.233:4621 , piece_id=MCRLQA4XLZUFBTRSKRC4FYHFYQKB5WVJNWYT7DIBBCFYPTTI4SPA, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.627391713 (302h45m50.058471834s) [noise=true , address=79.127.219.51:4216 , piece_id=ECXFAFWW3QJG4DSFM3CM2QC5WESDMH4UN6X2XWW6MHVGT2RIXT6A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:56.760848848 (302h45m51.191928979s) [upload=314941]: Next returned nil segment
Aug 21 08:11:56.760867553 (302h45m51.191947684s) [upload=314941]: Waiting for error group managing segments...
Aug 21 08:11:57.046224006 (302h45m51.477304138s) [noise=true , address=79.127.205.233:4621 , piece_id=MCRLQA4XLZUFBTRSKRC4FYHFYQKB5WVJNWYT7DIBBCFYPTTI4SPA, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.069275282 (302h45m51.500355413s) [noise=true , address=79.127.205.235:4662 , piece_id=235UI5ULTYCP66226NQJNWHO242OTZN5FT4FLJLOBCLYDQBXHENA, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.525688852 (302h45m51.956768983s) [noise=true , address=77.90.31.15:4725 , piece_id=HJ76KODVTWHXW4Z4MBMPLHTMUXYTJIEGU73XGGRXCAGGVOK7W3NQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.531356345 (302h45m51.962436467s) [noise=true , address=77.90.31.18:4808 , piece_id=JKBBMGZZIJZYIQ3PY3ACBBF77H4Y4ZWSSDMPUROXMLZEAMTWC3GQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.541220099 (302h45m51.97230023s) [noise=true , address=77.90.31.10:4528 , piece_id=34RVQ7V2KG7LW4CPLQ3CNJEDCB6XEVONVLLT3EXGIUEFARDFGHLQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.552075008 (302h45m51.983155139s) [noise=true , address=79.127.219.51:4216 , piece_id=ECXFAFWW3QJG4DSFM3CM2QC5WESDMH4UN6X2XWW6MHVGT2RIXT6A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.554126984 (302h45m51.985207115s) [noise=true , address=45.91.116.14:4203 , piece_id=6PL6MLRFABNBCX2P4HQRJGOZGJZETEMIC4YNUKKWGJG46ANYFRQQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.611773464 (302h45m52.042853595s) [noise=true , address=45.91.116.6:4987 , piece_id=QDQFADB3UR6Y4EIAVLG7VEC36GRVRAXR6RKB3Y3M24J7P7NZRS5A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.613844145 (302h45m52.044924276s) [noise=true , address=77.90.31.11:4586 , piece_id=G5JA4LY5JGBHNXOISV6SN5ATM255VLLVNKH3JFJYM453WEJWIC7Q, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.615581309 (302h45m52.04666144s) [noise=true , address=79.127.219.47:4068 , piece_id=LASI244HE5KSAWCSXKBMTC6Q5RFEIAO67NCT6CVNZ4BVC4U4BEAQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.625495329 (302h45m52.05657546s) [noise=true , address=77.90.31.17:4782 , piece_id=6YCJU4RQNEP33R722IEECCERNENQZ355ZFQCFFLZ4GOPRYW4L37A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.637448009 (302h45m52.06852814s) [noise=true , address=104.36.82.19:4420 , piece_id=O2EWVX4F5H3Y2HGOZASASUO3C6C7LQJBNSVNTQGWBQN4TIZGZ4YQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.646508816 (302h45m52.077588947s) [noise=true , address=45.91.116.8:4060 , piece_id=JI3A4TSWDNDKVFIAOIQEUIOSYNWOCB7Z4XZVIMHZGWHLLYZ7G3GA, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.716278671 (302h45m52.147358802s) [noise=true , address=104.36.82.60:4342 , piece_id=BT5W4FFS5HT5WE2Z4PNKRM7W2UM5OZ6IE5YS6CDY6Q3VFBWEZBSQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.716303719 (302h45m52.14738384s) [seg_pos={0 0}, upload=314941]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:11:57.716408289 (302h45m52.14748842s) [noise=true , address=104.36.82.23:4480 , piece_id=V3PS4YDWDY7SDG3UGHK6PXODJFCCIML7K356DQVDZ7XTDRYLZ7OA, seg_pos={0 0}, upload=314941]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qQhWAdN83i1jMTYByNQ8SWGXQaXRgBGezkLTf1BTwLyKskjjU): protocol: expected piece hash; context canceled; EOF
Aug 21 08:11:57.716481049 (302h45m52.14756117s) [noise=true , address=104.36.82.13:4217 , piece_id=ZF3CYGXF5YOEBQBAHRKW4WWZWWP4C3AYZB6IWPEOQ36DOTFHUMLQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi): protocol: expected piece hash; context canceled; EOF
Aug 21 08:11:57.716510395 (302h45m52.147590526s) [noise=true , address=104.36.82.44:4877 , piece_id=2KF7NXJZ23DW35KIWPVINHWBSGJ5RO3SNUE3GNWJKSQGQ2B3RM3A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17TuauVrjKmehRpXqmK7bemU9V33GDZu9RGBs6fanXvJkV1gdH): protocol: expected piece hash; context canceled; EOF
Aug 21 08:11:57.716579707 (302h45m52.147659838s) [noise=true , address=79.127.201.215:4354 , piece_id=F3TTUHACYCAMV5TEFU7JN4ZAVQWNMPHMEVKPKFEYTKYOJ5JUZH5A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF
Aug 21 08:11:57.716624483 (302h45m52.147704614s) [seg_pos={0 0}, upload=314941]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:11:57.716706831 (302h45m52.147786952s) [upload=314941]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:11:57.716711820 (302h45m52.147791951s) [upload=314941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:11:58.015365586 (302h45m52.446445717s) [upload=314941]: Done uploading segments...
Aug 21 08:11:58.015394402 (302h45m52.446474533s) [upload=314941]: Upload finished. err: <nil>
Duration: 5.636440732s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X..................X...] duration:
5.669106877s
FAIL (2025-08-21 08:14:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 78776e19483792501368ce11a13d64168237fe76918a9cfe74655e907f86d30c != before cce00fa9311dbbda7d8404afb1aa77809aa5d15cd46cc1b278854a82517dcede
======LOGS======
Aug 21 08:11:55.178465811 (302h45m49.609545992s) [upload=314941]: Starting upload
Aug 21 08:11:55.178586061 (302h45m49.609666242s) [upload=314941]: Done starting upload
Aug 21 08:11:55.178726930 (302h45m49.609807091s) [upload=314941]: Uploading segments...
Aug 21 08:11:55.179128338 (302h45m49.61020851s) [upload=314941]: Got next segment. Inline: false
Aug 21 08:11:55.179195366 (302h45m49.610275497s) [upload=314941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:11:55.179200908 (302h45m49.610281039s) [upload=314941]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:11:55.623067328 (302h45m50.054147479s) [seg_pos={0 0}, upload=314941]: Begin upload segment...
Aug 21 08:11:55.623137623 (302h45m50.054217754s) [seg_pos={0 0}, upload=314941]: Done begin upload segment.
Aug 21 08:11:55.623154936 (302h45m50.054235057s) [noise=true , address=79.127.205.235:4662 , piece_id=235UI5ULTYCP66226NQJNWHO242OTZN5FT4FLJLOBCLYDQBXHENA, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.623177679 (302h45m50.054257811s) [noise=true , address=104.36.82.23:4480 , piece_id=V3PS4YDWDY7SDG3UGHK6PXODJFCCIML7K356DQVDZ7XTDRYLZ7OA, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.623600238 (302h45m50.054680369s) [noise=true , address=45.91.116.14:4203 , piece_id=6PL6MLRFABNBCX2P4HQRJGOZGJZETEMIC4YNUKKWGJG46ANYFRQQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.623699688 (302h45m50.05477997s) [noise=true , address=77.90.31.15:4725 , piece_id=HJ76KODVTWHXW4Z4MBMPLHTMUXYTJIEGU73XGGRXCAGGVOK7W3NQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.624213281 (302h45m50.055293412s) [noise=true , address=77.90.31.17:4782 , piece_id=6YCJU4RQNEP33R722IEECCERNENQZ355ZFQCFFLZ4GOPRYW4L37A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.624486825 (302h45m50.055566956s) [noise=true , address=45.91.116.6:4987 , piece_id=QDQFADB3UR6Y4EIAVLG7VEC36GRVRAXR6RKB3Y3M24J7P7NZRS5A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.624739127 (302h45m50.055819258s) [noise=true , address=79.127.201.215:4354 , piece_id=F3TTUHACYCAMV5TEFU7JN4ZAVQWNMPHMEVKPKFEYTKYOJ5JUZH5A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.625007451 (302h45m50.056087582s) [noise=true , address=104.36.82.19:4420 , piece_id=O2EWVX4F5H3Y2HGOZASASUO3C6C7LQJBNSVNTQGWBQN4TIZGZ4YQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.625275644 (302h45m50.056355765s) [noise=true , address=104.36.82.13:4217 , piece_id=ZF3CYGXF5YOEBQBAHRKW4WWZWWP4C3AYZB6IWPEOQ36DOTFHUMLQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.625512076 (302h45m50.056592207s) [noise=true , address=104.36.82.44:4877 , piece_id=2KF7NXJZ23DW35KIWPVINHWBSGJ5RO3SNUE3GNWJKSQGQ2B3RM3A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.625769219 (302h45m50.05684935s) [noise=true , address=77.90.31.11:4586 , piece_id=G5JA4LY5JGBHNXOISV6SN5ATM255VLLVNKH3JFJYM453WEJWIC7Q, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626022453 (302h45m50.057102584s) [noise=true , address=45.91.116.8:4060 , piece_id=JI3A4TSWDNDKVFIAOIQEUIOSYNWOCB7Z4XZVIMHZGWHLLYZ7G3GA, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626320323 (302h45m50.057400444s) [noise=true , address=79.127.219.47:4068 , piece_id=LASI244HE5KSAWCSXKBMTC6Q5RFEIAO67NCT6CVNZ4BVC4U4BEAQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626524022 (302h45m50.057604143s) [noise=true , address=77.90.31.10:4528 , piece_id=34RVQ7V2KG7LW4CPLQ3CNJEDCB6XEVONVLLT3EXGIUEFARDFGHLQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626713355 (302h45m50.057793476s) [noise=true , address=104.36.82.60:4342 , piece_id=BT5W4FFS5HT5WE2Z4PNKRM7W2UM5OZ6IE5YS6CDY6Q3VFBWEZBSQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626989844 (302h45m50.058069985s) [noise=true , address=77.90.31.18:4808 , piece_id=JKBBMGZZIJZYIQ3PY3ACBBF77H4Y4ZWSSDMPUROXMLZEAMTWC3GQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.627199836 (302h45m50.058279967s) [noise=true , address=79.127.205.233:4621 , piece_id=MCRLQA4XLZUFBTRSKRC4FYHFYQKB5WVJNWYT7DIBBCFYPTTI4SPA, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.627391713 (302h45m50.058471834s) [noise=true , address=79.127.219.51:4216 , piece_id=ECXFAFWW3QJG4DSFM3CM2QC5WESDMH4UN6X2XWW6MHVGT2RIXT6A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:56.760848848 (302h45m51.191928979s) [upload=314941]: Next returned nil segment
Aug 21 08:11:56.760867553 (302h45m51.191947684s) [upload=314941]: Waiting for error group managing segments...
Aug 21 08:11:57.046224006 (302h45m51.477304138s) [noise=true , address=79.127.205.233:4621 , piece_id=MCRLQA4XLZUFBTRSKRC4FYHFYQKB5WVJNWYT7DIBBCFYPTTI4SPA, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.069275282 (302h45m51.500355413s) [noise=true , address=79.127.205.235:4662 , piece_id=235UI5ULTYCP66226NQJNWHO242OTZN5FT4FLJLOBCLYDQBXHENA, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.525688852 (302h45m51.956768983s) [noise=true , address=77.90.31.15:4725 , piece_id=HJ76KODVTWHXW4Z4MBMPLHTMUXYTJIEGU73XGGRXCAGGVOK7W3NQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.531356345 (302h45m51.962436467s) [noise=true , address=77.90.31.18:4808 , piece_id=JKBBMGZZIJZYIQ3PY3ACBBF77H4Y4ZWSSDMPUROXMLZEAMTWC3GQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.541220099 (302h45m51.97230023s) [noise=true , address=77.90.31.10:4528 , piece_id=34RVQ7V2KG7LW4CPLQ3CNJEDCB6XEVONVLLT3EXGIUEFARDFGHLQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.552075008 (302h45m51.983155139s) [noise=true , address=79.127.219.51:4216 , piece_id=ECXFAFWW3QJG4DSFM3CM2QC5WESDMH4UN6X2XWW6MHVGT2RIXT6A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.554126984 (302h45m51.985207115s) [noise=true , address=45.91.116.14:4203 , piece_id=6PL6MLRFABNBCX2P4HQRJGOZGJZETEMIC4YNUKKWGJG46ANYFRQQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.611773464 (302h45m52.042853595s) [noise=true , address=45.91.116.6:4987 , piece_id=QDQFADB3UR6Y4EIAVLG7VEC36GRVRAXR6RKB3Y3M24J7P7NZRS5A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.613844145 (302h45m52.044924276s) [noise=true , address=77.90.31.11:4586 , piece_id=G5JA4LY5JGBHNXOISV6SN5ATM255VLLVNKH3JFJYM453WEJWIC7Q, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.615581309 (302h45m52.04666144s) [noise=true , address=79.127.219.47:4068 , piece_id=LASI244HE5KSAWCSXKBMTC6Q5RFEIAO67NCT6CVNZ4BVC4U4BEAQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.625495329 (302h45m52.05657546s) [noise=true , address=77.90.31.17:4782 , piece_id=6YCJU4RQNEP33R722IEECCERNENQZ355ZFQCFFLZ4GOPRYW4L37A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.637448009 (302h45m52.06852814s) [noise=true , address=104.36.82.19:4420 , piece_id=O2EWVX4F5H3Y2HGOZASASUO3C6C7LQJBNSVNTQGWBQN4TIZGZ4YQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.646508816 (302h45m52.077588947s) [noise=true , address=45.91.116.8:4060 , piece_id=JI3A4TSWDNDKVFIAOIQEUIOSYNWOCB7Z4XZVIMHZGWHLLYZ7G3GA, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.716278671 (302h45m52.147358802s) [noise=true , address=104.36.82.60:4342 , piece_id=BT5W4FFS5HT5WE2Z4PNKRM7W2UM5OZ6IE5YS6CDY6Q3VFBWEZBSQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.716303719 (302h45m52.14738384s) [seg_pos={0 0}, upload=314941]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:11:57.716408289 (302h45m52.14748842s) [noise=true , address=104.36.82.23:4480 , piece_id=V3PS4YDWDY7SDG3UGHK6PXODJFCCIML7K356DQVDZ7XTDRYLZ7OA, seg_pos={0 0}, upload=314941]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qQhWAdN83i1jMTYByNQ8SWGXQaXRgBGezkLTf1BTwLyKskjjU): protocol: expected piece hash; context canceled; EOF
Aug 21 08:11:57.716481049 (302h45m52.14756117s) [noise=true , address=104.36.82.13:4217 , piece_id=ZF3CYGXF5YOEBQBAHRKW4WWZWWP4C3AYZB6IWPEOQ36DOTFHUMLQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi): protocol: expected piece hash; context canceled; EOF
Aug 21 08:11:57.716510395 (302h45m52.147590526s) [noise=true , address=104.36.82.44:4877 , piece_id=2KF7NXJZ23DW35KIWPVINHWBSGJ5RO3SNUE3GNWJKSQGQ2B3RM3A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17TuauVrjKmehRpXqmK7bemU9V33GDZu9RGBs6fanXvJkV1gdH): protocol: expected piece hash; context canceled; EOF
Aug 21 08:11:57.716579707 (302h45m52.147659838s) [noise=true , address=79.127.201.215:4354 , piece_id=F3TTUHACYCAMV5TEFU7JN4ZAVQWNMPHMEVKPKFEYTKYOJ5JUZH5A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF
Aug 21 08:11:57.716624483 (302h45m52.147704614s) [seg_pos={0 0}, upload=314941]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:11:57.716706831 (302h45m52.147786952s) [upload=314941]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:11:57.716711820 (302h45m52.147791951s) [upload=314941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:11:58.015365586 (302h45m52.446445717s) [upload=314941]: Done uploading segments...
Aug 21 08:11:58.015394402 (302h45m52.446474533s) [upload=314941]: Upload finished. err: <nil>
Duration: 5.669158778s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
9 out of 60 is failed (threshold=3) [......XX......X...................X.X....X......X...X..X....] duration:
1.823406247s
FAIL (2025-08-21 08:14:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.823428148s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
9 out of 60 is failed (threshold=3) [.......XX......X...................X.X....X......X...X..X...] duration:
1.829201905s
FAIL (2025-08-21 08:13:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.829225611s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................X..................X..] duration:
5.619223852s
FAIL (2025-08-21 08:13:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 78776e19483792501368ce11a13d64168237fe76918a9cfe74655e907f86d30c != before cce00fa9311dbbda7d8404afb1aa77809aa5d15cd46cc1b278854a82517dcede
======LOGS======
Aug 21 08:11:55.178465811 (302h45m49.609545992s) [upload=314941]: Starting upload
Aug 21 08:11:55.178586061 (302h45m49.609666242s) [upload=314941]: Done starting upload
Aug 21 08:11:55.178726930 (302h45m49.609807091s) [upload=314941]: Uploading segments...
Aug 21 08:11:55.179128338 (302h45m49.61020851s) [upload=314941]: Got next segment. Inline: false
Aug 21 08:11:55.179195366 (302h45m49.610275497s) [upload=314941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:11:55.179200908 (302h45m49.610281039s) [upload=314941]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:11:55.623067328 (302h45m50.054147479s) [seg_pos={0 0}, upload=314941]: Begin upload segment...
Aug 21 08:11:55.623137623 (302h45m50.054217754s) [seg_pos={0 0}, upload=314941]: Done begin upload segment.
Aug 21 08:11:55.623154936 (302h45m50.054235057s) [noise=true , address=79.127.205.235:4662 , piece_id=235UI5ULTYCP66226NQJNWHO242OTZN5FT4FLJLOBCLYDQBXHENA, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.623177679 (302h45m50.054257811s) [noise=true , address=104.36.82.23:4480 , piece_id=V3PS4YDWDY7SDG3UGHK6PXODJFCCIML7K356DQVDZ7XTDRYLZ7OA, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.623600238 (302h45m50.054680369s) [noise=true , address=45.91.116.14:4203 , piece_id=6PL6MLRFABNBCX2P4HQRJGOZGJZETEMIC4YNUKKWGJG46ANYFRQQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.623699688 (302h45m50.05477997s) [noise=true , address=77.90.31.15:4725 , piece_id=HJ76KODVTWHXW4Z4MBMPLHTMUXYTJIEGU73XGGRXCAGGVOK7W3NQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.624213281 (302h45m50.055293412s) [noise=true , address=77.90.31.17:4782 , piece_id=6YCJU4RQNEP33R722IEECCERNENQZ355ZFQCFFLZ4GOPRYW4L37A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.624486825 (302h45m50.055566956s) [noise=true , address=45.91.116.6:4987 , piece_id=QDQFADB3UR6Y4EIAVLG7VEC36GRVRAXR6RKB3Y3M24J7P7NZRS5A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.624739127 (302h45m50.055819258s) [noise=true , address=79.127.201.215:4354 , piece_id=F3TTUHACYCAMV5TEFU7JN4ZAVQWNMPHMEVKPKFEYTKYOJ5JUZH5A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.625007451 (302h45m50.056087582s) [noise=true , address=104.36.82.19:4420 , piece_id=O2EWVX4F5H3Y2HGOZASASUO3C6C7LQJBNSVNTQGWBQN4TIZGZ4YQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.625275644 (302h45m50.056355765s) [noise=true , address=104.36.82.13:4217 , piece_id=ZF3CYGXF5YOEBQBAHRKW4WWZWWP4C3AYZB6IWPEOQ36DOTFHUMLQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.625512076 (302h45m50.056592207s) [noise=true , address=104.36.82.44:4877 , piece_id=2KF7NXJZ23DW35KIWPVINHWBSGJ5RO3SNUE3GNWJKSQGQ2B3RM3A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.625769219 (302h45m50.05684935s) [noise=true , address=77.90.31.11:4586 , piece_id=G5JA4LY5JGBHNXOISV6SN5ATM255VLLVNKH3JFJYM453WEJWIC7Q, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626022453 (302h45m50.057102584s) [noise=true , address=45.91.116.8:4060 , piece_id=JI3A4TSWDNDKVFIAOIQEUIOSYNWOCB7Z4XZVIMHZGWHLLYZ7G3GA, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626320323 (302h45m50.057400444s) [noise=true , address=79.127.219.47:4068 , piece_id=LASI244HE5KSAWCSXKBMTC6Q5RFEIAO67NCT6CVNZ4BVC4U4BEAQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626524022 (302h45m50.057604143s) [noise=true , address=77.90.31.10:4528 , piece_id=34RVQ7V2KG7LW4CPLQ3CNJEDCB6XEVONVLLT3EXGIUEFARDFGHLQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626713355 (302h45m50.057793476s) [noise=true , address=104.36.82.60:4342 , piece_id=BT5W4FFS5HT5WE2Z4PNKRM7W2UM5OZ6IE5YS6CDY6Q3VFBWEZBSQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626989844 (302h45m50.058069985s) [noise=true , address=77.90.31.18:4808 , piece_id=JKBBMGZZIJZYIQ3PY3ACBBF77H4Y4ZWSSDMPUROXMLZEAMTWC3GQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.627199836 (302h45m50.058279967s) [noise=true , address=79.127.205.233:4621 , piece_id=MCRLQA4XLZUFBTRSKRC4FYHFYQKB5WVJNWYT7DIBBCFYPTTI4SPA, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.627391713 (302h45m50.058471834s) [noise=true , address=79.127.219.51:4216 , piece_id=ECXFAFWW3QJG4DSFM3CM2QC5WESDMH4UN6X2XWW6MHVGT2RIXT6A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:56.760848848 (302h45m51.191928979s) [upload=314941]: Next returned nil segment
Aug 21 08:11:56.760867553 (302h45m51.191947684s) [upload=314941]: Waiting for error group managing segments...
Aug 21 08:11:57.046224006 (302h45m51.477304138s) [noise=true , address=79.127.205.233:4621 , piece_id=MCRLQA4XLZUFBTRSKRC4FYHFYQKB5WVJNWYT7DIBBCFYPTTI4SPA, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.069275282 (302h45m51.500355413s) [noise=true , address=79.127.205.235:4662 , piece_id=235UI5ULTYCP66226NQJNWHO242OTZN5FT4FLJLOBCLYDQBXHENA, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.525688852 (302h45m51.956768983s) [noise=true , address=77.90.31.15:4725 , piece_id=HJ76KODVTWHXW4Z4MBMPLHTMUXYTJIEGU73XGGRXCAGGVOK7W3NQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.531356345 (302h45m51.962436467s) [noise=true , address=77.90.31.18:4808 , piece_id=JKBBMGZZIJZYIQ3PY3ACBBF77H4Y4ZWSSDMPUROXMLZEAMTWC3GQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.541220099 (302h45m51.97230023s) [noise=true , address=77.90.31.10:4528 , piece_id=34RVQ7V2KG7LW4CPLQ3CNJEDCB6XEVONVLLT3EXGIUEFARDFGHLQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.552075008 (302h45m51.983155139s) [noise=true , address=79.127.219.51:4216 , piece_id=ECXFAFWW3QJG4DSFM3CM2QC5WESDMH4UN6X2XWW6MHVGT2RIXT6A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.554126984 (302h45m51.985207115s) [noise=true , address=45.91.116.14:4203 , piece_id=6PL6MLRFABNBCX2P4HQRJGOZGJZETEMIC4YNUKKWGJG46ANYFRQQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.611773464 (302h45m52.042853595s) [noise=true , address=45.91.116.6:4987 , piece_id=QDQFADB3UR6Y4EIAVLG7VEC36GRVRAXR6RKB3Y3M24J7P7NZRS5A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.613844145 (302h45m52.044924276s) [noise=true , address=77.90.31.11:4586 , piece_id=G5JA4LY5JGBHNXOISV6SN5ATM255VLLVNKH3JFJYM453WEJWIC7Q, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.615581309 (302h45m52.04666144s) [noise=true , address=79.127.219.47:4068 , piece_id=LASI244HE5KSAWCSXKBMTC6Q5RFEIAO67NCT6CVNZ4BVC4U4BEAQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.625495329 (302h45m52.05657546s) [noise=true , address=77.90.31.17:4782 , piece_id=6YCJU4RQNEP33R722IEECCERNENQZ355ZFQCFFLZ4GOPRYW4L37A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.637448009 (302h45m52.06852814s) [noise=true , address=104.36.82.19:4420 , piece_id=O2EWVX4F5H3Y2HGOZASASUO3C6C7LQJBNSVNTQGWBQN4TIZGZ4YQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.646508816 (302h45m52.077588947s) [noise=true , address=45.91.116.8:4060 , piece_id=JI3A4TSWDNDKVFIAOIQEUIOSYNWOCB7Z4XZVIMHZGWHLLYZ7G3GA, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.716278671 (302h45m52.147358802s) [noise=true , address=104.36.82.60:4342 , piece_id=BT5W4FFS5HT5WE2Z4PNKRM7W2UM5OZ6IE5YS6CDY6Q3VFBWEZBSQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.716303719 (302h45m52.14738384s) [seg_pos={0 0}, upload=314941]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:11:57.716408289 (302h45m52.14748842s) [noise=true , address=104.36.82.23:4480 , piece_id=V3PS4YDWDY7SDG3UGHK6PXODJFCCIML7K356DQVDZ7XTDRYLZ7OA, seg_pos={0 0}, upload=314941]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qQhWAdN83i1jMTYByNQ8SWGXQaXRgBGezkLTf1BTwLyKskjjU): protocol: expected piece hash; context canceled; EOF
Aug 21 08:11:57.716481049 (302h45m52.14756117s) [noise=true , address=104.36.82.13:4217 , piece_id=ZF3CYGXF5YOEBQBAHRKW4WWZWWP4C3AYZB6IWPEOQ36DOTFHUMLQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi): protocol: expected piece hash; context canceled; EOF
Aug 21 08:11:57.716510395 (302h45m52.147590526s) [noise=true , address=104.36.82.44:4877 , piece_id=2KF7NXJZ23DW35KIWPVINHWBSGJ5RO3SNUE3GNWJKSQGQ2B3RM3A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17TuauVrjKmehRpXqmK7bemU9V33GDZu9RGBs6fanXvJkV1gdH): protocol: expected piece hash; context canceled; EOF
Aug 21 08:11:57.716579707 (302h45m52.147659838s) [noise=true , address=79.127.201.215:4354 , piece_id=F3TTUHACYCAMV5TEFU7JN4ZAVQWNMPHMEVKPKFEYTKYOJ5JUZH5A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF
Aug 21 08:11:57.716624483 (302h45m52.147704614s) [seg_pos={0 0}, upload=314941]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:11:57.716706831 (302h45m52.147786952s) [upload=314941]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:11:57.716711820 (302h45m52.147791951s) [upload=314941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:11:58.015365586 (302h45m52.446445717s) [upload=314941]: Done uploading segments...
Aug 21 08:11:58.015394402 (302h45m52.446474533s) [upload=314941]: Upload finished. err: <nil>
Duration: 5.619257376s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X..................X.] duration:
5.736235668s
FAIL (2025-08-21 08:12:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 78776e19483792501368ce11a13d64168237fe76918a9cfe74655e907f86d30c != before cce00fa9311dbbda7d8404afb1aa77809aa5d15cd46cc1b278854a82517dcede
======LOGS======
Aug 21 08:11:55.178465811 (302h45m49.609545992s) [upload=314941]: Starting upload
Aug 21 08:11:55.178586061 (302h45m49.609666242s) [upload=314941]: Done starting upload
Aug 21 08:11:55.178726930 (302h45m49.609807091s) [upload=314941]: Uploading segments...
Aug 21 08:11:55.179128338 (302h45m49.61020851s) [upload=314941]: Got next segment. Inline: false
Aug 21 08:11:55.179195366 (302h45m49.610275497s) [upload=314941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:11:55.179200908 (302h45m49.610281039s) [upload=314941]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:11:55.623067328 (302h45m50.054147479s) [seg_pos={0 0}, upload=314941]: Begin upload segment...
Aug 21 08:11:55.623137623 (302h45m50.054217754s) [seg_pos={0 0}, upload=314941]: Done begin upload segment.
Aug 21 08:11:55.623154936 (302h45m50.054235057s) [noise=true , address=79.127.205.235:4662 , piece_id=235UI5ULTYCP66226NQJNWHO242OTZN5FT4FLJLOBCLYDQBXHENA, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.623177679 (302h45m50.054257811s) [noise=true , address=104.36.82.23:4480 , piece_id=V3PS4YDWDY7SDG3UGHK6PXODJFCCIML7K356DQVDZ7XTDRYLZ7OA, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.623600238 (302h45m50.054680369s) [noise=true , address=45.91.116.14:4203 , piece_id=6PL6MLRFABNBCX2P4HQRJGOZGJZETEMIC4YNUKKWGJG46ANYFRQQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.623699688 (302h45m50.05477997s) [noise=true , address=77.90.31.15:4725 , piece_id=HJ76KODVTWHXW4Z4MBMPLHTMUXYTJIEGU73XGGRXCAGGVOK7W3NQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.624213281 (302h45m50.055293412s) [noise=true , address=77.90.31.17:4782 , piece_id=6YCJU4RQNEP33R722IEECCERNENQZ355ZFQCFFLZ4GOPRYW4L37A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.624486825 (302h45m50.055566956s) [noise=true , address=45.91.116.6:4987 , piece_id=QDQFADB3UR6Y4EIAVLG7VEC36GRVRAXR6RKB3Y3M24J7P7NZRS5A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.624739127 (302h45m50.055819258s) [noise=true , address=79.127.201.215:4354 , piece_id=F3TTUHACYCAMV5TEFU7JN4ZAVQWNMPHMEVKPKFEYTKYOJ5JUZH5A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.625007451 (302h45m50.056087582s) [noise=true , address=104.36.82.19:4420 , piece_id=O2EWVX4F5H3Y2HGOZASASUO3C6C7LQJBNSVNTQGWBQN4TIZGZ4YQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.625275644 (302h45m50.056355765s) [noise=true , address=104.36.82.13:4217 , piece_id=ZF3CYGXF5YOEBQBAHRKW4WWZWWP4C3AYZB6IWPEOQ36DOTFHUMLQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.625512076 (302h45m50.056592207s) [noise=true , address=104.36.82.44:4877 , piece_id=2KF7NXJZ23DW35KIWPVINHWBSGJ5RO3SNUE3GNWJKSQGQ2B3RM3A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.625769219 (302h45m50.05684935s) [noise=true , address=77.90.31.11:4586 , piece_id=G5JA4LY5JGBHNXOISV6SN5ATM255VLLVNKH3JFJYM453WEJWIC7Q, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626022453 (302h45m50.057102584s) [noise=true , address=45.91.116.8:4060 , piece_id=JI3A4TSWDNDKVFIAOIQEUIOSYNWOCB7Z4XZVIMHZGWHLLYZ7G3GA, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626320323 (302h45m50.057400444s) [noise=true , address=79.127.219.47:4068 , piece_id=LASI244HE5KSAWCSXKBMTC6Q5RFEIAO67NCT6CVNZ4BVC4U4BEAQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626524022 (302h45m50.057604143s) [noise=true , address=77.90.31.10:4528 , piece_id=34RVQ7V2KG7LW4CPLQ3CNJEDCB6XEVONVLLT3EXGIUEFARDFGHLQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626713355 (302h45m50.057793476s) [noise=true , address=104.36.82.60:4342 , piece_id=BT5W4FFS5HT5WE2Z4PNKRM7W2UM5OZ6IE5YS6CDY6Q3VFBWEZBSQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626989844 (302h45m50.058069985s) [noise=true , address=77.90.31.18:4808 , piece_id=JKBBMGZZIJZYIQ3PY3ACBBF77H4Y4ZWSSDMPUROXMLZEAMTWC3GQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.627199836 (302h45m50.058279967s) [noise=true , address=79.127.205.233:4621 , piece_id=MCRLQA4XLZUFBTRSKRC4FYHFYQKB5WVJNWYT7DIBBCFYPTTI4SPA, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.627391713 (302h45m50.058471834s) [noise=true , address=79.127.219.51:4216 , piece_id=ECXFAFWW3QJG4DSFM3CM2QC5WESDMH4UN6X2XWW6MHVGT2RIXT6A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:56.760848848 (302h45m51.191928979s) [upload=314941]: Next returned nil segment
Aug 21 08:11:56.760867553 (302h45m51.191947684s) [upload=314941]: Waiting for error group managing segments...
Aug 21 08:11:57.046224006 (302h45m51.477304138s) [noise=true , address=79.127.205.233:4621 , piece_id=MCRLQA4XLZUFBTRSKRC4FYHFYQKB5WVJNWYT7DIBBCFYPTTI4SPA, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.069275282 (302h45m51.500355413s) [noise=true , address=79.127.205.235:4662 , piece_id=235UI5ULTYCP66226NQJNWHO242OTZN5FT4FLJLOBCLYDQBXHENA, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.525688852 (302h45m51.956768983s) [noise=true , address=77.90.31.15:4725 , piece_id=HJ76KODVTWHXW4Z4MBMPLHTMUXYTJIEGU73XGGRXCAGGVOK7W3NQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.531356345 (302h45m51.962436467s) [noise=true , address=77.90.31.18:4808 , piece_id=JKBBMGZZIJZYIQ3PY3ACBBF77H4Y4ZWSSDMPUROXMLZEAMTWC3GQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.541220099 (302h45m51.97230023s) [noise=true , address=77.90.31.10:4528 , piece_id=34RVQ7V2KG7LW4CPLQ3CNJEDCB6XEVONVLLT3EXGIUEFARDFGHLQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.552075008 (302h45m51.983155139s) [noise=true , address=79.127.219.51:4216 , piece_id=ECXFAFWW3QJG4DSFM3CM2QC5WESDMH4UN6X2XWW6MHVGT2RIXT6A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.554126984 (302h45m51.985207115s) [noise=true , address=45.91.116.14:4203 , piece_id=6PL6MLRFABNBCX2P4HQRJGOZGJZETEMIC4YNUKKWGJG46ANYFRQQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.611773464 (302h45m52.042853595s) [noise=true , address=45.91.116.6:4987 , piece_id=QDQFADB3UR6Y4EIAVLG7VEC36GRVRAXR6RKB3Y3M24J7P7NZRS5A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.613844145 (302h45m52.044924276s) [noise=true , address=77.90.31.11:4586 , piece_id=G5JA4LY5JGBHNXOISV6SN5ATM255VLLVNKH3JFJYM453WEJWIC7Q, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.615581309 (302h45m52.04666144s) [noise=true , address=79.127.219.47:4068 , piece_id=LASI244HE5KSAWCSXKBMTC6Q5RFEIAO67NCT6CVNZ4BVC4U4BEAQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.625495329 (302h45m52.05657546s) [noise=true , address=77.90.31.17:4782 , piece_id=6YCJU4RQNEP33R722IEECCERNENQZ355ZFQCFFLZ4GOPRYW4L37A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.637448009 (302h45m52.06852814s) [noise=true , address=104.36.82.19:4420 , piece_id=O2EWVX4F5H3Y2HGOZASASUO3C6C7LQJBNSVNTQGWBQN4TIZGZ4YQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.646508816 (302h45m52.077588947s) [noise=true , address=45.91.116.8:4060 , piece_id=JI3A4TSWDNDKVFIAOIQEUIOSYNWOCB7Z4XZVIMHZGWHLLYZ7G3GA, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.716278671 (302h45m52.147358802s) [noise=true , address=104.36.82.60:4342 , piece_id=BT5W4FFS5HT5WE2Z4PNKRM7W2UM5OZ6IE5YS6CDY6Q3VFBWEZBSQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.716303719 (302h45m52.14738384s) [seg_pos={0 0}, upload=314941]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:11:57.716408289 (302h45m52.14748842s) [noise=true , address=104.36.82.23:4480 , piece_id=V3PS4YDWDY7SDG3UGHK6PXODJFCCIML7K356DQVDZ7XTDRYLZ7OA, seg_pos={0 0}, upload=314941]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qQhWAdN83i1jMTYByNQ8SWGXQaXRgBGezkLTf1BTwLyKskjjU): protocol: expected piece hash; context canceled; EOF
Aug 21 08:11:57.716481049 (302h45m52.14756117s) [noise=true , address=104.36.82.13:4217 , piece_id=ZF3CYGXF5YOEBQBAHRKW4WWZWWP4C3AYZB6IWPEOQ36DOTFHUMLQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi): protocol: expected piece hash; context canceled; EOF
Aug 21 08:11:57.716510395 (302h45m52.147590526s) [noise=true , address=104.36.82.44:4877 , piece_id=2KF7NXJZ23DW35KIWPVINHWBSGJ5RO3SNUE3GNWJKSQGQ2B3RM3A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17TuauVrjKmehRpXqmK7bemU9V33GDZu9RGBs6fanXvJkV1gdH): protocol: expected piece hash; context canceled; EOF
Aug 21 08:11:57.716579707 (302h45m52.147659838s) [noise=true , address=79.127.201.215:4354 , piece_id=F3TTUHACYCAMV5TEFU7JN4ZAVQWNMPHMEVKPKFEYTKYOJ5JUZH5A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF
Aug 21 08:11:57.716624483 (302h45m52.147704614s) [seg_pos={0 0}, upload=314941]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:11:57.716706831 (302h45m52.147786952s) [upload=314941]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:11:57.716711820 (302h45m52.147791951s) [upload=314941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:11:58.015365586 (302h45m52.446445717s) [upload=314941]: Done uploading segments...
Aug 21 08:11:58.015394402 (302h45m52.446474533s) [upload=314941]: Upload finished. err: <nil>
Duration: 5.736261085s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
9 out of 60 is failed (threshold=3) [........XX......X...................X.X....X......X...X..X..] duration:
2.04066351s
FAIL (2025-08-21 08:12:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.040694609s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................................X..................X] duration:
5.770066758s
FAIL (2025-08-21 08:12:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 78776e19483792501368ce11a13d64168237fe76918a9cfe74655e907f86d30c != before cce00fa9311dbbda7d8404afb1aa77809aa5d15cd46cc1b278854a82517dcede
======LOGS======
Aug 21 08:11:55.178465811 (302h45m49.609545992s) [upload=314941]: Starting upload
Aug 21 08:11:55.178586061 (302h45m49.609666242s) [upload=314941]: Done starting upload
Aug 21 08:11:55.178726930 (302h45m49.609807091s) [upload=314941]: Uploading segments...
Aug 21 08:11:55.179128338 (302h45m49.61020851s) [upload=314941]: Got next segment. Inline: false
Aug 21 08:11:55.179195366 (302h45m49.610275497s) [upload=314941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:11:55.179200908 (302h45m49.610281039s) [upload=314941]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 08:11:55.623067328 (302h45m50.054147479s) [seg_pos={0 0}, upload=314941]: Begin upload segment...
Aug 21 08:11:55.623137623 (302h45m50.054217754s) [seg_pos={0 0}, upload=314941]: Done begin upload segment.
Aug 21 08:11:55.623154936 (302h45m50.054235057s) [noise=true , address=79.127.205.235:4662 , piece_id=235UI5ULTYCP66226NQJNWHO242OTZN5FT4FLJLOBCLYDQBXHENA, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.623177679 (302h45m50.054257811s) [noise=true , address=104.36.82.23:4480 , piece_id=V3PS4YDWDY7SDG3UGHK6PXODJFCCIML7K356DQVDZ7XTDRYLZ7OA, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.623600238 (302h45m50.054680369s) [noise=true , address=45.91.116.14:4203 , piece_id=6PL6MLRFABNBCX2P4HQRJGOZGJZETEMIC4YNUKKWGJG46ANYFRQQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.623699688 (302h45m50.05477997s) [noise=true , address=77.90.31.15:4725 , piece_id=HJ76KODVTWHXW4Z4MBMPLHTMUXYTJIEGU73XGGRXCAGGVOK7W3NQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.624213281 (302h45m50.055293412s) [noise=true , address=77.90.31.17:4782 , piece_id=6YCJU4RQNEP33R722IEECCERNENQZ355ZFQCFFLZ4GOPRYW4L37A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.624486825 (302h45m50.055566956s) [noise=true , address=45.91.116.6:4987 , piece_id=QDQFADB3UR6Y4EIAVLG7VEC36GRVRAXR6RKB3Y3M24J7P7NZRS5A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.624739127 (302h45m50.055819258s) [noise=true , address=79.127.201.215:4354 , piece_id=F3TTUHACYCAMV5TEFU7JN4ZAVQWNMPHMEVKPKFEYTKYOJ5JUZH5A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.625007451 (302h45m50.056087582s) [noise=true , address=104.36.82.19:4420 , piece_id=O2EWVX4F5H3Y2HGOZASASUO3C6C7LQJBNSVNTQGWBQN4TIZGZ4YQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.625275644 (302h45m50.056355765s) [noise=true , address=104.36.82.13:4217 , piece_id=ZF3CYGXF5YOEBQBAHRKW4WWZWWP4C3AYZB6IWPEOQ36DOTFHUMLQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.625512076 (302h45m50.056592207s) [noise=true , address=104.36.82.44:4877 , piece_id=2KF7NXJZ23DW35KIWPVINHWBSGJ5RO3SNUE3GNWJKSQGQ2B3RM3A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.625769219 (302h45m50.05684935s) [noise=true , address=77.90.31.11:4586 , piece_id=G5JA4LY5JGBHNXOISV6SN5ATM255VLLVNKH3JFJYM453WEJWIC7Q, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626022453 (302h45m50.057102584s) [noise=true , address=45.91.116.8:4060 , piece_id=JI3A4TSWDNDKVFIAOIQEUIOSYNWOCB7Z4XZVIMHZGWHLLYZ7G3GA, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626320323 (302h45m50.057400444s) [noise=true , address=79.127.219.47:4068 , piece_id=LASI244HE5KSAWCSXKBMTC6Q5RFEIAO67NCT6CVNZ4BVC4U4BEAQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626524022 (302h45m50.057604143s) [noise=true , address=77.90.31.10:4528 , piece_id=34RVQ7V2KG7LW4CPLQ3CNJEDCB6XEVONVLLT3EXGIUEFARDFGHLQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626713355 (302h45m50.057793476s) [noise=true , address=104.36.82.60:4342 , piece_id=BT5W4FFS5HT5WE2Z4PNKRM7W2UM5OZ6IE5YS6CDY6Q3VFBWEZBSQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.626989844 (302h45m50.058069985s) [noise=true , address=77.90.31.18:4808 , piece_id=JKBBMGZZIJZYIQ3PY3ACBBF77H4Y4ZWSSDMPUROXMLZEAMTWC3GQ, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.627199836 (302h45m50.058279967s) [noise=true , address=79.127.205.233:4621 , piece_id=MCRLQA4XLZUFBTRSKRC4FYHFYQKB5WVJNWYT7DIBBCFYPTTI4SPA, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:55.627391713 (302h45m50.058471834s) [noise=true , address=79.127.219.51:4216 , piece_id=ECXFAFWW3QJG4DSFM3CM2QC5WESDMH4UN6X2XWW6MHVGT2RIXT6A, seg_pos={0 0}, upload=314941]: Uploading piece...
Aug 21 08:11:56.760848848 (302h45m51.191928979s) [upload=314941]: Next returned nil segment
Aug 21 08:11:56.760867553 (302h45m51.191947684s) [upload=314941]: Waiting for error group managing segments...
Aug 21 08:11:57.046224006 (302h45m51.477304138s) [noise=true , address=79.127.205.233:4621 , piece_id=MCRLQA4XLZUFBTRSKRC4FYHFYQKB5WVJNWYT7DIBBCFYPTTI4SPA, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.069275282 (302h45m51.500355413s) [noise=true , address=79.127.205.235:4662 , piece_id=235UI5ULTYCP66226NQJNWHO242OTZN5FT4FLJLOBCLYDQBXHENA, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.525688852 (302h45m51.956768983s) [noise=true , address=77.90.31.15:4725 , piece_id=HJ76KODVTWHXW4Z4MBMPLHTMUXYTJIEGU73XGGRXCAGGVOK7W3NQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.531356345 (302h45m51.962436467s) [noise=true , address=77.90.31.18:4808 , piece_id=JKBBMGZZIJZYIQ3PY3ACBBF77H4Y4ZWSSDMPUROXMLZEAMTWC3GQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.541220099 (302h45m51.97230023s) [noise=true , address=77.90.31.10:4528 , piece_id=34RVQ7V2KG7LW4CPLQ3CNJEDCB6XEVONVLLT3EXGIUEFARDFGHLQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.552075008 (302h45m51.983155139s) [noise=true , address=79.127.219.51:4216 , piece_id=ECXFAFWW3QJG4DSFM3CM2QC5WESDMH4UN6X2XWW6MHVGT2RIXT6A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.554126984 (302h45m51.985207115s) [noise=true , address=45.91.116.14:4203 , piece_id=6PL6MLRFABNBCX2P4HQRJGOZGJZETEMIC4YNUKKWGJG46ANYFRQQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.611773464 (302h45m52.042853595s) [noise=true , address=45.91.116.6:4987 , piece_id=QDQFADB3UR6Y4EIAVLG7VEC36GRVRAXR6RKB3Y3M24J7P7NZRS5A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.613844145 (302h45m52.044924276s) [noise=true , address=77.90.31.11:4586 , piece_id=G5JA4LY5JGBHNXOISV6SN5ATM255VLLVNKH3JFJYM453WEJWIC7Q, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.615581309 (302h45m52.04666144s) [noise=true , address=79.127.219.47:4068 , piece_id=LASI244HE5KSAWCSXKBMTC6Q5RFEIAO67NCT6CVNZ4BVC4U4BEAQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.625495329 (302h45m52.05657546s) [noise=true , address=77.90.31.17:4782 , piece_id=6YCJU4RQNEP33R722IEECCERNENQZ355ZFQCFFLZ4GOPRYW4L37A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.637448009 (302h45m52.06852814s) [noise=true , address=104.36.82.19:4420 , piece_id=O2EWVX4F5H3Y2HGOZASASUO3C6C7LQJBNSVNTQGWBQN4TIZGZ4YQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.646508816 (302h45m52.077588947s) [noise=true , address=45.91.116.8:4060 , piece_id=JI3A4TSWDNDKVFIAOIQEUIOSYNWOCB7Z4XZVIMHZGWHLLYZ7G3GA, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.716278671 (302h45m52.147358802s) [noise=true , address=104.36.82.60:4342 , piece_id=BT5W4FFS5HT5WE2Z4PNKRM7W2UM5OZ6IE5YS6CDY6Q3VFBWEZBSQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: <nil>
Aug 21 08:11:57.716303719 (302h45m52.14738384s) [seg_pos={0 0}, upload=314941]: Segment reached optimal threshold of 14 pieces.
Aug 21 08:11:57.716408289 (302h45m52.14748842s) [noise=true , address=104.36.82.23:4480 , piece_id=V3PS4YDWDY7SDG3UGHK6PXODJFCCIML7K356DQVDZ7XTDRYLZ7OA, seg_pos={0 0}, upload=314941]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qQhWAdN83i1jMTYByNQ8SWGXQaXRgBGezkLTf1BTwLyKskjjU): protocol: expected piece hash; context canceled; EOF
Aug 21 08:11:57.716481049 (302h45m52.14756117s) [noise=true , address=104.36.82.13:4217 , piece_id=ZF3CYGXF5YOEBQBAHRKW4WWZWWP4C3AYZB6IWPEOQ36DOTFHUMLQ, seg_pos={0 0}, upload=314941]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123KLtoTMCQ9DZUjJ8JJab4D5bc7UGTt7yjVV8wDgFTozdZ5gpi): protocol: expected piece hash; context canceled; EOF
Aug 21 08:11:57.716510395 (302h45m52.147590526s) [noise=true , address=104.36.82.44:4877 , piece_id=2KF7NXJZ23DW35KIWPVINHWBSGJ5RO3SNUE3GNWJKSQGQ2B3RM3A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17TuauVrjKmehRpXqmK7bemU9V33GDZu9RGBs6fanXvJkV1gdH): protocol: expected piece hash; context canceled; EOF
Aug 21 08:11:57.716579707 (302h45m52.147659838s) [noise=true , address=79.127.201.215:4354 , piece_id=F3TTUHACYCAMV5TEFU7JN4ZAVQWNMPHMEVKPKFEYTKYOJ5JUZH5A, seg_pos={0 0}, upload=314941]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF
Aug 21 08:11:57.716624483 (302h45m52.147704614s) [seg_pos={0 0}, upload=314941]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 08:11:57.716706831 (302h45m52.147786952s) [upload=314941]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 08:11:57.716711820 (302h45m52.147791951s) [upload=314941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:11:58.015365586 (302h45m52.446445717s) [upload=314941]: Done uploading segments...
Aug 21 08:11:58.015394402 (302h45m52.446474533s) [upload=314941]: Upload finished. err: <nil>
Duration: 5.770147483s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
9 out of 60 is failed (threshold=3) [.........XX......X...................X.X....X......X...X..X.] duration:
2.02742984s
FAIL (2025-08-21 08:11:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.02746614s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
9 out of 60 is failed (threshold=3) [..........XX......X...................X.X....X......X...X..X] duration:
862.684147ms
FAIL (2025-08-21 08:11:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:11:33.505738690 (302h45m27.936818821s) [upload=314934]: Starting upload Aug 21 08:11:33.505783264 (302h45m27.936863385s) [upload=314934]: Done starting upload Aug 21 08:11:33.505870010 (302h45m27.936950131s) [upload=314934]: Uploading segments... Aug 21 08:11:33.505911891 (302h45m27.936992022s) [upload=314934]: Got next segment. Inline: true Aug 21 08:11:33.505915537 (302h45m27.936995669s) [upload=314934]: Waiting for error group managing segments... Aug 21 08:11:33.505946186 (302h45m27.937026317s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:11:33.505950374 (302h45m27.937030495s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:11:33.505952909 (302h45m27.93703304s) [upload=314934]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:11:33.719991897 (302h45m28.151072028s) [upload=314934]: Done uploading segments... Aug 21 08:11:33.720010933 (302h45m28.151091064s) [upload=314934]: Upload finished. err: metaclient: Too Many Requests
Duration: 862.704796ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
8 out of 60 is failed (threshold=3) [...........XX......X...................X.X....X......X...X..] duration:
1.814577235s
FAIL (2025-08-21 08:10:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:09:38.191673932 (302h43m32.622754063s) [upload=314901]: Starting upload Aug 21 08:09:38.191782870 (302h43m32.622863021s) [upload=314901]: Done starting upload Aug 21 08:09:38.191928359 (302h43m32.62300852s) [upload=314901]: Uploading segments... Aug 21 08:09:38.191984977 (302h43m32.623065138s) [upload=314901]: Got next segment. Inline: true Aug 21 08:09:38.191992712 (302h43m32.623072883s) [upload=314901]: Waiting for error group managing segments... Aug 21 08:09:38.192047557 (302h43m32.623127688s) [upload=314901]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:09:38.192054660 (302h43m32.623134831s) [upload=314901]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:09:38.192060432 (302h43m32.623140593s) [upload=314901]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:09:38.405201390 (302h43m32.836281521s) [upload=314901]: Done uploading segments... Aug 21 08:09:38.405219836 (302h43m32.836299967s) [upload=314901]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.814604826s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
5.528251317s
FAIL (2025-08-21 08:10:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 07:55:57.306461659 (302h29m51.73754179s) [upload=314666]: Starting upload Aug 21 07:55:57.306537884 (302h29m51.737618045s) [upload=314666]: Done starting upload Aug 21 07:55:57.306647554 (302h29m51.737727685s) [upload=314666]: Uploading segments... Aug 21 07:55:57.306909415 (302h29m51.737989547s) [upload=314666]: Got next segment. Inline: false Aug 21 07:55:57.306958049 (302h29m51.73803822s) [upload=314666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 07:55:57.306963699 (302h29m51.73804383s) [upload=314666]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 07:55:57.569201483 (302h29m52.000281614s) [upload=314666]: Next segment err: metaclient: Too Many Requests Aug 21 07:55:57.569220017 (302h29m52.000300148s) [upload=314666]: Done uploading segments... Aug 21 07:55:57.569236469 (302h29m52.00031666s) [upload=314666]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.52828498s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
8 out of 60 is failed (threshold=3) [............XX......X...................X.X....X......X...X.] duration:
1.919765486s
FAIL (2025-08-21 08:09:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:09:38.191673932 (302h43m32.622754063s) [upload=314901]: Starting upload Aug 21 08:09:38.191782870 (302h43m32.622863021s) [upload=314901]: Done starting upload Aug 21 08:09:38.191928359 (302h43m32.62300852s) [upload=314901]: Uploading segments... Aug 21 08:09:38.191984977 (302h43m32.623065138s) [upload=314901]: Got next segment. Inline: true Aug 21 08:09:38.191992712 (302h43m32.623072883s) [upload=314901]: Waiting for error group managing segments... Aug 21 08:09:38.192047557 (302h43m32.623127688s) [upload=314901]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:09:38.192054660 (302h43m32.623134831s) [upload=314901]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:09:38.192060432 (302h43m32.623140593s) [upload=314901]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:09:38.405201390 (302h43m32.836281521s) [upload=314901]: Done uploading segments... Aug 21 08:09:38.405219836 (302h43m32.836299967s) [upload=314901]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.919805883s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
8 out of 60 is failed (threshold=3) [.............XX......X...................X.X....X......X...X] duration:
857.816061ms
FAIL (2025-08-21 08:09:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 08:09:38.191673932 (302h43m32.622754063s) [upload=314901]: Starting upload Aug 21 08:09:38.191782870 (302h43m32.622863021s) [upload=314901]: Done starting upload Aug 21 08:09:38.191928359 (302h43m32.62300852s) [upload=314901]: Uploading segments... Aug 21 08:09:38.191984977 (302h43m32.623065138s) [upload=314901]: Got next segment. Inline: true Aug 21 08:09:38.191992712 (302h43m32.623072883s) [upload=314901]: Waiting for error group managing segments... Aug 21 08:09:38.192047557 (302h43m32.623127688s) [upload=314901]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:09:38.192054660 (302h43m32.623134831s) [upload=314901]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:09:38.192060432 (302h43m32.623140593s) [upload=314901]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:09:38.405201390 (302h43m32.836281521s) [upload=314901]: Done uploading segments... Aug 21 08:09:38.405219836 (302h43m32.836299967s) [upload=314901]: Upload finished. err: metaclient: Too Many Requests
Duration: 857.834589ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.950185985s
FAIL (2025-08-21 08:09:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 07:55:57.306461659 (302h29m51.73754179s) [upload=314666]: Starting upload Aug 21 07:55:57.306537884 (302h29m51.737618045s) [upload=314666]: Done starting upload Aug 21 07:55:57.306647554 (302h29m51.737727685s) [upload=314666]: Uploading segments... Aug 21 07:55:57.306909415 (302h29m51.737989547s) [upload=314666]: Got next segment. Inline: false Aug 21 07:55:57.306958049 (302h29m51.73803822s) [upload=314666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 07:55:57.306963699 (302h29m51.73804383s) [upload=314666]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 07:55:57.569201483 (302h29m52.000281614s) [upload=314666]: Next segment err: metaclient: Too Many Requests Aug 21 07:55:57.569220017 (302h29m52.000300148s) [upload=314666]: Done uploading segments... Aug 21 07:55:57.569236469 (302h29m52.00031666s) [upload=314666]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.950272609s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [..............XX......X...................X.X....X......X...] duration:
2.174334393s
FAIL (2025-08-21 08:09:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after f8c7b184d0189eac798985801cc530c99e265d4a58dc0021369ef616686fae80 != before b5c45e07111c6c5f68891638109f2bb7a79c69684b0fc393bd9baa0ef672ce57 ======LOGS====== Aug 21 08:06:56.126947186 (302h40m50.558027317s) [upload=314850]: Starting upload Aug 21 08:06:56.127005599 (302h40m50.55808572s) [upload=314850]: Done starting upload Aug 21 08:06:56.127059221 (302h40m50.558139352s) [upload=314850]: Uploading segments... Aug 21 08:06:56.127112533 (302h40m50.558192664s) [upload=314850]: Got next segment. Inline: true Aug 21 08:06:56.127118665 (302h40m50.558198796s) [upload=314850]: Waiting for error group managing segments... Aug 21 08:06:56.127152620 (302h40m50.558232751s) [upload=314850]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:06:56.127156718 (302h40m50.558236849s) [upload=314850]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:06:56.127161557 (302h40m50.558241688s) [upload=314850]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:06:56.432958901 (302h40m50.864039022s) [upload=314850]: Done uploading segments... Aug 21 08:06:56.432974681 (302h40m50.864054812s) [upload=314850]: Upload finished. err: <nil>
Duration: 2.174359782s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.719859204s
FAIL (2025-08-21 08:09:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 07:55:57.306461659 (302h29m51.73754179s) [upload=314666]: Starting upload Aug 21 07:55:57.306537884 (302h29m51.737618045s) [upload=314666]: Done starting upload Aug 21 07:55:57.306647554 (302h29m51.737727685s) [upload=314666]: Uploading segments... Aug 21 07:55:57.306909415 (302h29m51.737989547s) [upload=314666]: Got next segment. Inline: false Aug 21 07:55:57.306958049 (302h29m51.73803822s) [upload=314666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 07:55:57.306963699 (302h29m51.73804383s) [upload=314666]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 07:55:57.569201483 (302h29m52.000281614s) [upload=314666]: Next segment err: metaclient: Too Many Requests Aug 21 07:55:57.569220017 (302h29m52.000300148s) [upload=314666]: Done uploading segments... Aug 21 07:55:57.569236469 (302h29m52.00031666s) [upload=314666]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.719879963s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [...............XX......X...................X.X....X......X..] duration:
2.009300351s
FAIL (2025-08-21 08:08:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after f8c7b184d0189eac798985801cc530c99e265d4a58dc0021369ef616686fae80 != before b5c45e07111c6c5f68891638109f2bb7a79c69684b0fc393bd9baa0ef672ce57 ======LOGS====== Aug 21 08:06:56.126947186 (302h40m50.558027317s) [upload=314850]: Starting upload Aug 21 08:06:56.127005599 (302h40m50.55808572s) [upload=314850]: Done starting upload Aug 21 08:06:56.127059221 (302h40m50.558139352s) [upload=314850]: Uploading segments... Aug 21 08:06:56.127112533 (302h40m50.558192664s) [upload=314850]: Got next segment. Inline: true Aug 21 08:06:56.127118665 (302h40m50.558198796s) [upload=314850]: Waiting for error group managing segments... Aug 21 08:06:56.127152620 (302h40m50.558232751s) [upload=314850]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:06:56.127156718 (302h40m50.558236849s) [upload=314850]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:06:56.127161557 (302h40m50.558241688s) [upload=314850]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:06:56.432958901 (302h40m50.864039022s) [upload=314850]: Done uploading segments... Aug 21 08:06:56.432974681 (302h40m50.864054812s) [upload=314850]: Upload finished. err: <nil>
Duration: 2.009325328s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
5.585072263s
FAIL (2025-08-21 08:08:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 07:55:57.306461659 (302h29m51.73754179s) [upload=314666]: Starting upload Aug 21 07:55:57.306537884 (302h29m51.737618045s) [upload=314666]: Done starting upload Aug 21 07:55:57.306647554 (302h29m51.737727685s) [upload=314666]: Uploading segments... Aug 21 07:55:57.306909415 (302h29m51.737989547s) [upload=314666]: Got next segment. Inline: false Aug 21 07:55:57.306958049 (302h29m51.73803822s) [upload=314666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 07:55:57.306963699 (302h29m51.73804383s) [upload=314666]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 07:55:57.569201483 (302h29m52.000281614s) [upload=314666]: Next segment err: metaclient: Too Many Requests Aug 21 07:55:57.569220017 (302h29m52.000300148s) [upload=314666]: Done uploading segments... Aug 21 07:55:57.569236469 (302h29m52.00031666s) [upload=314666]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.585136777s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [................XX......X...................X.X....X......X.] duration:
1.89725148s
FAIL (2025-08-21 08:07:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after f8c7b184d0189eac798985801cc530c99e265d4a58dc0021369ef616686fae80 != before b5c45e07111c6c5f68891638109f2bb7a79c69684b0fc393bd9baa0ef672ce57 ======LOGS====== Aug 21 08:06:56.126947186 (302h40m50.558027317s) [upload=314850]: Starting upload Aug 21 08:06:56.127005599 (302h40m50.55808572s) [upload=314850]: Done starting upload Aug 21 08:06:56.127059221 (302h40m50.558139352s) [upload=314850]: Uploading segments... Aug 21 08:06:56.127112533 (302h40m50.558192664s) [upload=314850]: Got next segment. Inline: true Aug 21 08:06:56.127118665 (302h40m50.558198796s) [upload=314850]: Waiting for error group managing segments... Aug 21 08:06:56.127152620 (302h40m50.558232751s) [upload=314850]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:06:56.127156718 (302h40m50.558236849s) [upload=314850]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:06:56.127161557 (302h40m50.558241688s) [upload=314850]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:06:56.432958901 (302h40m50.864039022s) [upload=314850]: Done uploading segments... Aug 21 08:06:56.432974681 (302h40m50.864054812s) [upload=314850]: Upload finished. err: <nil>
Duration: 1.897271957s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
6.02100263s
FAIL (2025-08-21 08:07:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 07:55:57.306461659 (302h29m51.73754179s) [upload=314666]: Starting upload Aug 21 07:55:57.306537884 (302h29m51.737618045s) [upload=314666]: Done starting upload Aug 21 07:55:57.306647554 (302h29m51.737727685s) [upload=314666]: Uploading segments... Aug 21 07:55:57.306909415 (302h29m51.737989547s) [upload=314666]: Got next segment. Inline: false Aug 21 07:55:57.306958049 (302h29m51.73803822s) [upload=314666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 07:55:57.306963699 (302h29m51.73804383s) [upload=314666]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 07:55:57.569201483 (302h29m52.000281614s) [upload=314666]: Next segment err: metaclient: Too Many Requests Aug 21 07:55:57.569220017 (302h29m52.000300148s) [upload=314666]: Done uploading segments... Aug 21 07:55:57.569236469 (302h29m52.00031666s) [upload=314666]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.02102284s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.................XX......X...................X.X....X......X] duration:
1.631269848s
FAIL (2025-08-21 08:06:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after f8c7b184d0189eac798985801cc530c99e265d4a58dc0021369ef616686fae80 != before b5c45e07111c6c5f68891638109f2bb7a79c69684b0fc393bd9baa0ef672ce57 ======LOGS====== Aug 21 08:06:56.126947186 (302h40m50.558027317s) [upload=314850]: Starting upload Aug 21 08:06:56.127005599 (302h40m50.55808572s) [upload=314850]: Done starting upload Aug 21 08:06:56.127059221 (302h40m50.558139352s) [upload=314850]: Uploading segments... Aug 21 08:06:56.127112533 (302h40m50.558192664s) [upload=314850]: Got next segment. Inline: true Aug 21 08:06:56.127118665 (302h40m50.558198796s) [upload=314850]: Waiting for error group managing segments... Aug 21 08:06:56.127152620 (302h40m50.558232751s) [upload=314850]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 08:06:56.127156718 (302h40m50.558236849s) [upload=314850]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 08:06:56.127161557 (302h40m50.558241688s) [upload=314850]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 08:06:56.432958901 (302h40m50.864039022s) [upload=314850]: Done uploading segments... Aug 21 08:06:56.432974681 (302h40m50.864054812s) [upload=314850]: Upload finished. err: <nil>
Duration: 1.631289336s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
5.694085697s
FAIL (2025-08-21 08:06:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 07:55:57.306461659 (302h29m51.73754179s) [upload=314666]: Starting upload Aug 21 07:55:57.306537884 (302h29m51.737618045s) [upload=314666]: Done starting upload Aug 21 07:55:57.306647554 (302h29m51.737727685s) [upload=314666]: Uploading segments... Aug 21 07:55:57.306909415 (302h29m51.737989547s) [upload=314666]: Got next segment. Inline: false Aug 21 07:55:57.306958049 (302h29m51.73803822s) [upload=314666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 07:55:57.306963699 (302h29m51.73804383s) [upload=314666]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 07:55:57.569201483 (302h29m52.000281614s) [upload=314666]: Next segment err: metaclient: Too Many Requests Aug 21 07:55:57.569220017 (302h29m52.000300148s) [upload=314666]: Done uploading segments... Aug 21 07:55:57.569236469 (302h29m52.00031666s) [upload=314666]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.694119942s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..................XX......X...................X.X....X......] duration:
1.82523199s
FAIL (2025-08-21 08:06:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 21 08:01:31.122516687 (302h35m25.553596818s) [upload=314757]: Starting upload
Aug 21 08:01:31.122563126 (302h35m25.553643257s) [upload=314757]: Done starting upload
Aug 21 08:01:31.122613463 (302h35m25.553693594s) [upload=314757]: Uploading segments...
Aug 21 08:01:31.122661354 (302h35m25.553741475s) [upload=314757]: Got next segment. Inline: true
Aug 21 08:01:31.122665613 (302h35m25.553745734s) [upload=314757]: Waiting for error group managing segments...
Aug 21 08:01:31.122697914 (302h35m25.553778045s) [upload=314757]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:01:31.122701741 (302h35m25.553781872s) [upload=314757]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 08:01:31.122704597 (302h35m25.553784728s) [upload=314757]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:01:31.533955604 (302h35m25.965035745s) [upload=314757]: Done uploading segments...
Aug 21 08:01:31.533977725 (302h35m25.965057856s) [upload=314757]: Upload finished. err: <nil>
Duration: 1.825264743s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...................XX......X...................X.X....X.....] duration:
2.206684701s
FAIL (2025-08-21 08:05:52 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 21 08:01:31.122516687 (302h35m25.553596818s) [upload=314757]: Starting upload
Aug 21 08:01:31.122563126 (302h35m25.553643257s) [upload=314757]: Done starting upload
Aug 21 08:01:31.122613463 (302h35m25.553693594s) [upload=314757]: Uploading segments...
Aug 21 08:01:31.122661354 (302h35m25.553741475s) [upload=314757]: Got next segment. Inline: true
Aug 21 08:01:31.122665613 (302h35m25.553745734s) [upload=314757]: Waiting for error group managing segments...
Aug 21 08:01:31.122697914 (302h35m25.553778045s) [upload=314757]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:01:31.122701741 (302h35m25.553781872s) [upload=314757]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 08:01:31.122704597 (302h35m25.553784728s) [upload=314757]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:01:31.533955604 (302h35m25.965035745s) [upload=314757]: Done uploading segments...
Aug 21 08:01:31.533977725 (302h35m25.965057856s) [upload=314757]: Upload finished. err: <nil>
Duration: 2.206714217s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
5.885378947s
FAIL (2025-08-21 08:05:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 07:55:57.306461659 (302h29m51.73754179s) [upload=314666]: Starting upload Aug 21 07:55:57.306537884 (302h29m51.737618045s) [upload=314666]: Done starting upload Aug 21 07:55:57.306647554 (302h29m51.737727685s) [upload=314666]: Uploading segments... Aug 21 07:55:57.306909415 (302h29m51.737989547s) [upload=314666]: Got next segment. Inline: false Aug 21 07:55:57.306958049 (302h29m51.73803822s) [upload=314666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 07:55:57.306963699 (302h29m51.73804383s) [upload=314666]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 07:55:57.569201483 (302h29m52.000281614s) [upload=314666]: Next segment err: metaclient: Too Many Requests Aug 21 07:55:57.569220017 (302h29m52.000300148s) [upload=314666]: Done uploading segments... Aug 21 07:55:57.569236469 (302h29m52.00031666s) [upload=314666]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.8854069s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
5.949706628s
FAIL (2025-08-21 08:05:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 07:55:57.306461659 (302h29m51.73754179s) [upload=314666]: Starting upload Aug 21 07:55:57.306537884 (302h29m51.737618045s) [upload=314666]: Done starting upload Aug 21 07:55:57.306647554 (302h29m51.737727685s) [upload=314666]: Uploading segments... Aug 21 07:55:57.306909415 (302h29m51.737989547s) [upload=314666]: Got next segment. Inline: false Aug 21 07:55:57.306958049 (302h29m51.73803822s) [upload=314666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 07:55:57.306963699 (302h29m51.73804383s) [upload=314666]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 07:55:57.569201483 (302h29m52.000281614s) [upload=314666]: Next segment err: metaclient: Too Many Requests Aug 21 07:55:57.569220017 (302h29m52.000300148s) [upload=314666]: Done uploading segments... Aug 21 07:55:57.569236469 (302h29m52.00031666s) [upload=314666]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.949733932s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X................................................X..........] duration:
5.59882063s
FAIL (2025-08-21 08:04:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 07:55:57.306461659 (302h29m51.73754179s) [upload=314666]: Starting upload Aug 21 07:55:57.306537884 (302h29m51.737618045s) [upload=314666]: Done starting upload Aug 21 07:55:57.306647554 (302h29m51.737727685s) [upload=314666]: Uploading segments... Aug 21 07:55:57.306909415 (302h29m51.737989547s) [upload=314666]: Got next segment. Inline: false Aug 21 07:55:57.306958049 (302h29m51.73803822s) [upload=314666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 07:55:57.306963699 (302h29m51.73804383s) [upload=314666]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 07:55:57.569201483 (302h29m52.000281614s) [upload=314666]: Next segment err: metaclient: Too Many Requests Aug 21 07:55:57.569220017 (302h29m52.000300148s) [upload=314666]: Done uploading segments... Aug 21 07:55:57.569236469 (302h29m52.00031666s) [upload=314666]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.598855597s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [....................XX......X...................X.X....X....] duration:
1.807042254s
FAIL (2025-08-21 08:04:39 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 21 08:01:31.122516687 (302h35m25.553596818s) [upload=314757]: Starting upload
Aug 21 08:01:31.122563126 (302h35m25.553643257s) [upload=314757]: Done starting upload
Aug 21 08:01:31.122613463 (302h35m25.553693594s) [upload=314757]: Uploading segments...
Aug 21 08:01:31.122661354 (302h35m25.553741475s) [upload=314757]: Got next segment. Inline: true
Aug 21 08:01:31.122665613 (302h35m25.553745734s) [upload=314757]: Waiting for error group managing segments...
Aug 21 08:01:31.122697914 (302h35m25.553778045s) [upload=314757]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:01:31.122701741 (302h35m25.553781872s) [upload=314757]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 08:01:31.122704597 (302h35m25.553784728s) [upload=314757]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:01:31.533955604 (302h35m25.965035745s) [upload=314757]: Done uploading segments...
Aug 21 08:01:31.533977725 (302h35m25.965057856s) [upload=314757]: Upload finished. err: <nil>
Duration: 1.807069846s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.....................XX......X...................X.X....X...] duration:
1.868201225s
FAIL (2025-08-21 08:03:45 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 21 08:01:31.122516687 (302h35m25.553596818s) [upload=314757]: Starting upload
Aug 21 08:01:31.122563126 (302h35m25.553643257s) [upload=314757]: Done starting upload
Aug 21 08:01:31.122613463 (302h35m25.553693594s) [upload=314757]: Uploading segments...
Aug 21 08:01:31.122661354 (302h35m25.553741475s) [upload=314757]: Got next segment. Inline: true
Aug 21 08:01:31.122665613 (302h35m25.553745734s) [upload=314757]: Waiting for error group managing segments...
Aug 21 08:01:31.122697914 (302h35m25.553778045s) [upload=314757]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:01:31.122701741 (302h35m25.553781872s) [upload=314757]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 08:01:31.122704597 (302h35m25.553784728s) [upload=314757]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:01:31.533955604 (302h35m25.965035745s) [upload=314757]: Done uploading segments...
Aug 21 08:01:31.533977725 (302h35m25.965057856s) [upload=314757]: Upload finished. err: <nil>
Duration: 1.868231703s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X................................................X.........] duration:
6.311176796s
FAIL (2025-08-21 08:03:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 07:55:57.306461659 (302h29m51.73754179s) [upload=314666]: Starting upload Aug 21 07:55:57.306537884 (302h29m51.737618045s) [upload=314666]: Done starting upload Aug 21 07:55:57.306647554 (302h29m51.737727685s) [upload=314666]: Uploading segments... Aug 21 07:55:57.306909415 (302h29m51.737989547s) [upload=314666]: Got next segment. Inline: false Aug 21 07:55:57.306958049 (302h29m51.73803822s) [upload=314666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 07:55:57.306963699 (302h29m51.73804383s) [upload=314666]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 07:55:57.569201483 (302h29m52.000281614s) [upload=314666]: Next segment err: metaclient: Too Many Requests Aug 21 07:55:57.569220017 (302h29m52.000300148s) [upload=314666]: Done uploading segments... Aug 21 07:55:57.569236469 (302h29m52.00031666s) [upload=314666]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.31120558s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [......................XX......X...................X.X....X..] duration:
2.143615986s
FAIL (2025-08-21 08:03:27 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 21 08:01:31.122516687 (302h35m25.553596818s) [upload=314757]: Starting upload
Aug 21 08:01:31.122563126 (302h35m25.553643257s) [upload=314757]: Done starting upload
Aug 21 08:01:31.122613463 (302h35m25.553693594s) [upload=314757]: Uploading segments...
Aug 21 08:01:31.122661354 (302h35m25.553741475s) [upload=314757]: Got next segment. Inline: true
Aug 21 08:01:31.122665613 (302h35m25.553745734s) [upload=314757]: Waiting for error group managing segments...
Aug 21 08:01:31.122697914 (302h35m25.553778045s) [upload=314757]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:01:31.122701741 (302h35m25.553781872s) [upload=314757]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 08:01:31.122704597 (302h35m25.553784728s) [upload=314757]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:01:31.533955604 (302h35m25.965035745s) [upload=314757]: Done uploading segments...
Aug 21 08:01:31.533977725 (302h35m25.965057856s) [upload=314757]: Upload finished. err: <nil>
Duration: 2.143661223s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.......................XX......X...................X.X....X.] duration:
2.191315868s
FAIL (2025-08-21 08:02:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 21 08:01:31.122516687 (302h35m25.553596818s) [upload=314757]: Starting upload
Aug 21 08:01:31.122563126 (302h35m25.553643257s) [upload=314757]: Done starting upload
Aug 21 08:01:31.122613463 (302h35m25.553693594s) [upload=314757]: Uploading segments...
Aug 21 08:01:31.122661354 (302h35m25.553741475s) [upload=314757]: Got next segment. Inline: true
Aug 21 08:01:31.122665613 (302h35m25.553745734s) [upload=314757]: Waiting for error group managing segments...
Aug 21 08:01:31.122697914 (302h35m25.553778045s) [upload=314757]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 08:01:31.122701741 (302h35m25.553781872s) [upload=314757]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 08:01:31.122704597 (302h35m25.553784728s) [upload=314757]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 08:01:31.533955604 (302h35m25.965035745s) [upload=314757]: Done uploading segments...
Aug 21 08:01:31.533977725 (302h35m25.965057856s) [upload=314757]: Upload finished. err: <nil>
Duration: 2.191338611s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|