Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.............X...............X.X.....X.....................X] duration: 2.345898661s FAIL (2025-08-09 03:19:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 2.345923337s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X..X........................X..................X..........] duration: 5.735458327s FAIL (2025-08-09 03:18:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12589740e5423c81986be625ae369ea3bb9a862667a4b68cdfbe3a5a8499fdf5 != before 231c3069e22dc8ec515cb4e010a2fd6354ce784228d42eb40dfc821871182e1d ======LOGS====== Aug 9 03:11:52.837206901 (9h45m47.268287032s) [upload=10189]: Starting upload Aug 9 03:11:52.837263078 (9h45m47.268343209s) [upload=10189]: Done starting upload Aug 9 03:11:52.837308224 (9h45m47.268388355s) [upload=10189]: Uploading segments... Aug 9 03:11:52.837446088 (9h45m47.268526209s) [upload=10189]: Got next segment. Inline: false Aug 9 03:11:52.837473300 (9h45m47.268553431s) [upload=10189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:11:52.837478210 (9h45m47.268558341s) [upload=10189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:11:53.290738263 (9h45m47.721818404s) [seg_pos={0 0}, upload=10189]: Begin upload segment... Aug 9 03:11:53.290778952 (9h45m47.721859093s) [seg_pos={0 0}, upload=10189]: Done begin upload segment. Aug 9 03:11:53.290805542 (9h45m47.721885674s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.290810211 (9h45m47.721890352s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.290908560 (9h45m47.721988681s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291184478 (9h45m47.722264609s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291199576 (9h45m47.722279717s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291446809 (9h45m47.72252694s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291514579 (9h45m47.72259471s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291707198 (9h45m47.722787329s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291818821 (9h45m47.722898952s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291970150 (9h45m47.723050281s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292130006 (9h45m47.723210137s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292230749 (9h45m47.723310871s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292498231 (9h45m47.723578352s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292508671 (9h45m47.723588802s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292721027 (9h45m47.723801168s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.293467175 (9h45m47.724547316s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.293836181 (9h45m47.724916312s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.294090587 (9h45m47.725170718s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:54.404493912 (9h45m48.835574033s) [upload=10189]: Next returned nil segment Aug 9 03:11:54.404515964 (9h45m48.835596096s) [upload=10189]: Waiting for error group managing segments... Aug 9 03:11:54.694436519 (9h45m49.12551665s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:54.751825061 (9h45m49.182905192s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:54.771989050 (9h45m49.203069171s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.198583263 (9h45m49.629663394s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.210947310 (9h45m49.642027441s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.212619739 (9h45m49.64369987s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.280232032 (9h45m49.711312214s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.282230024 (9h45m49.713310156s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.290774874 (9h45m49.721855025s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.297371445 (9h45m49.728451586s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.306000275 (9h45m49.737080416s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.309610462 (9h45m49.740690593s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.320720138 (9h45m49.751800259s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.342139279 (9h45m49.77321941s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.342166040 (9h45m49.773246171s) [seg_pos={0 0}, upload=10189]: Segment reached optimal threshold of 14 pieces. Aug 9 03:11:55.342273606 (9h45m49.773353737s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342324784 (9h45m49.773404915s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mjbYcXw9TCoRMkYNVzDYiT1VxMVnaQzdYxrRsBHD8ghy7GouC): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342375261 (9h45m49.773455392s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342386181 (9h45m49.773466312s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr): protocol: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection Aug 9 03:11:55.342401431 (9h45m49.773481562s) [seg_pos={0 0}, upload=10189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:11:55.342479059 (9h45m49.77355919s) [upload=10189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:11:55.342483448 (9h45m49.773563579s) [upload=10189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:11:55.637456399 (9h45m50.06853653s) [upload=10189]: Done uploading segments... Aug 9 03:11:55.637473051 (9h45m50.068553182s) [upload=10189]: Upload finished. err: <nil> Duration: 5.735486871s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..............X...............X.X.....X.....................] duration: 1.858227456s FAIL (2025-08-09 03:18:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil> Duration:* 1.858256341s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X..X........................X..................X.........] duration: 5.779383739s FAIL (2025-08-09 03:18:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12589740e5423c81986be625ae369ea3bb9a862667a4b68cdfbe3a5a8499fdf5 != before 231c3069e22dc8ec515cb4e010a2fd6354ce784228d42eb40dfc821871182e1d ======LOGS====== Aug 9 03:11:52.837206901 (9h45m47.268287032s) [upload=10189]: Starting upload Aug 9 03:11:52.837263078 (9h45m47.268343209s) [upload=10189]: Done starting upload Aug 9 03:11:52.837308224 (9h45m47.268388355s) [upload=10189]: Uploading segments... Aug 9 03:11:52.837446088 (9h45m47.268526209s) [upload=10189]: Got next segment. Inline: false Aug 9 03:11:52.837473300 (9h45m47.268553431s) [upload=10189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:11:52.837478210 (9h45m47.268558341s) [upload=10189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:11:53.290738263 (9h45m47.721818404s) [seg_pos={0 0}, upload=10189]: Begin upload segment... Aug 9 03:11:53.290778952 (9h45m47.721859093s) [seg_pos={0 0}, upload=10189]: Done begin upload segment. Aug 9 03:11:53.290805542 (9h45m47.721885674s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.290810211 (9h45m47.721890352s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.290908560 (9h45m47.721988681s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291184478 (9h45m47.722264609s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291199576 (9h45m47.722279717s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291446809 (9h45m47.72252694s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291514579 (9h45m47.72259471s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291707198 (9h45m47.722787329s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291818821 (9h45m47.722898952s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291970150 (9h45m47.723050281s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292130006 (9h45m47.723210137s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292230749 (9h45m47.723310871s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292498231 (9h45m47.723578352s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292508671 (9h45m47.723588802s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292721027 (9h45m47.723801168s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.293467175 (9h45m47.724547316s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.293836181 (9h45m47.724916312s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.294090587 (9h45m47.725170718s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:54.404493912 (9h45m48.835574033s) [upload=10189]: Next returned nil segment Aug 9 03:11:54.404515964 (9h45m48.835596096s) [upload=10189]: Waiting for error group managing segments... Aug 9 03:11:54.694436519 (9h45m49.12551665s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:54.751825061 (9h45m49.182905192s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:54.771989050 (9h45m49.203069171s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.198583263 (9h45m49.629663394s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.210947310 (9h45m49.642027441s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.212619739 (9h45m49.64369987s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.280232032 (9h45m49.711312214s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.282230024 (9h45m49.713310156s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.290774874 (9h45m49.721855025s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.297371445 (9h45m49.728451586s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.306000275 (9h45m49.737080416s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.309610462 (9h45m49.740690593s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.320720138 (9h45m49.751800259s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.342139279 (9h45m49.77321941s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.342166040 (9h45m49.773246171s) [seg_pos={0 0}, upload=10189]: Segment reached optimal threshold of 14 pieces. Aug 9 03:11:55.342273606 (9h45m49.773353737s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342324784 (9h45m49.773404915s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mjbYcXw9TCoRMkYNVzDYiT1VxMVnaQzdYxrRsBHD8ghy7GouC): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342375261 (9h45m49.773455392s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342386181 (9h45m49.773466312s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr): protocol: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection Aug 9 03:11:55.342401431 (9h45m49.773481562s) [seg_pos={0 0}, upload=10189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:11:55.342479059 (9h45m49.77355919s) [upload=10189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:11:55.342483448 (9h45m49.773563579s) [upload=10189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:11:55.637456399 (9h45m50.06853653s) [upload=10189]: Done uploading segments... Aug 9 03:11:55.637473051 (9h45m50.068553182s) [upload=10189]: Upload finished. err: <nil> Duration: 5.779410039s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...............X...............X.X.....X....................] duration: 1.881006542s FAIL (2025-08-09 03:18:10 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil> Duration:* 1.881036679s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X..X........................X..................X........] duration: 5.658077333s FAIL (2025-08-09 03:17:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12589740e5423c81986be625ae369ea3bb9a862667a4b68cdfbe3a5a8499fdf5 != before 231c3069e22dc8ec515cb4e010a2fd6354ce784228d42eb40dfc821871182e1d ======LOGS====== Aug 9 03:11:52.837206901 (9h45m47.268287032s) [upload=10189]: Starting upload Aug 9 03:11:52.837263078 (9h45m47.268343209s) [upload=10189]: Done starting upload Aug 9 03:11:52.837308224 (9h45m47.268388355s) [upload=10189]: Uploading segments... Aug 9 03:11:52.837446088 (9h45m47.268526209s) [upload=10189]: Got next segment. Inline: false Aug 9 03:11:52.837473300 (9h45m47.268553431s) [upload=10189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:11:52.837478210 (9h45m47.268558341s) [upload=10189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:11:53.290738263 (9h45m47.721818404s) [seg_pos={0 0}, upload=10189]: Begin upload segment... Aug 9 03:11:53.290778952 (9h45m47.721859093s) [seg_pos={0 0}, upload=10189]: Done begin upload segment. Aug 9 03:11:53.290805542 (9h45m47.721885674s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.290810211 (9h45m47.721890352s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.290908560 (9h45m47.721988681s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291184478 (9h45m47.722264609s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291199576 (9h45m47.722279717s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291446809 (9h45m47.72252694s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291514579 (9h45m47.72259471s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291707198 (9h45m47.722787329s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291818821 (9h45m47.722898952s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291970150 (9h45m47.723050281s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292130006 (9h45m47.723210137s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292230749 (9h45m47.723310871s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292498231 (9h45m47.723578352s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292508671 (9h45m47.723588802s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292721027 (9h45m47.723801168s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.293467175 (9h45m47.724547316s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.293836181 (9h45m47.724916312s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.294090587 (9h45m47.725170718s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:54.404493912 (9h45m48.835574033s) [upload=10189]: Next returned nil segment Aug 9 03:11:54.404515964 (9h45m48.835596096s) [upload=10189]: Waiting for error group managing segments... Aug 9 03:11:54.694436519 (9h45m49.12551665s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:54.751825061 (9h45m49.182905192s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:54.771989050 (9h45m49.203069171s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.198583263 (9h45m49.629663394s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.210947310 (9h45m49.642027441s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.212619739 (9h45m49.64369987s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.280232032 (9h45m49.711312214s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.282230024 (9h45m49.713310156s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.290774874 (9h45m49.721855025s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.297371445 (9h45m49.728451586s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.306000275 (9h45m49.737080416s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.309610462 (9h45m49.740690593s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.320720138 (9h45m49.751800259s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.342139279 (9h45m49.77321941s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.342166040 (9h45m49.773246171s) [seg_pos={0 0}, upload=10189]: Segment reached optimal threshold of 14 pieces. Aug 9 03:11:55.342273606 (9h45m49.773353737s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342324784 (9h45m49.773404915s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mjbYcXw9TCoRMkYNVzDYiT1VxMVnaQzdYxrRsBHD8ghy7GouC): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342375261 (9h45m49.773455392s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342386181 (9h45m49.773466312s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr): protocol: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection Aug 9 03:11:55.342401431 (9h45m49.773481562s) [seg_pos={0 0}, upload=10189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:11:55.342479059 (9h45m49.77355919s) [upload=10189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:11:55.342483448 (9h45m49.773563579s) [upload=10189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:11:55.637456399 (9h45m50.06853653s) [upload=10189]: Done uploading segments... Aug 9 03:11:55.637473051 (9h45m50.068553182s) [upload=10189]: Upload finished. err: <nil> Duration: 5.65810287s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X..X........................X..................X.......] duration: 5.875495509s FAIL (2025-08-09 03:17:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12589740e5423c81986be625ae369ea3bb9a862667a4b68cdfbe3a5a8499fdf5 != before 231c3069e22dc8ec515cb4e010a2fd6354ce784228d42eb40dfc821871182e1d ======LOGS====== Aug 9 03:11:52.837206901 (9h45m47.268287032s) [upload=10189]: Starting upload Aug 9 03:11:52.837263078 (9h45m47.268343209s) [upload=10189]: Done starting upload Aug 9 03:11:52.837308224 (9h45m47.268388355s) [upload=10189]: Uploading segments... Aug 9 03:11:52.837446088 (9h45m47.268526209s) [upload=10189]: Got next segment. Inline: false Aug 9 03:11:52.837473300 (9h45m47.268553431s) [upload=10189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:11:52.837478210 (9h45m47.268558341s) [upload=10189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:11:53.290738263 (9h45m47.721818404s) [seg_pos={0 0}, upload=10189]: Begin upload segment... Aug 9 03:11:53.290778952 (9h45m47.721859093s) [seg_pos={0 0}, upload=10189]: Done begin upload segment. Aug 9 03:11:53.290805542 (9h45m47.721885674s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.290810211 (9h45m47.721890352s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.290908560 (9h45m47.721988681s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291184478 (9h45m47.722264609s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291199576 (9h45m47.722279717s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291446809 (9h45m47.72252694s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291514579 (9h45m47.72259471s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291707198 (9h45m47.722787329s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291818821 (9h45m47.722898952s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291970150 (9h45m47.723050281s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292130006 (9h45m47.723210137s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292230749 (9h45m47.723310871s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292498231 (9h45m47.723578352s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292508671 (9h45m47.723588802s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292721027 (9h45m47.723801168s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.293467175 (9h45m47.724547316s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.293836181 (9h45m47.724916312s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.294090587 (9h45m47.725170718s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:54.404493912 (9h45m48.835574033s) [upload=10189]: Next returned nil segment Aug 9 03:11:54.404515964 (9h45m48.835596096s) [upload=10189]: Waiting for error group managing segments... Aug 9 03:11:54.694436519 (9h45m49.12551665s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:54.751825061 (9h45m49.182905192s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:54.771989050 (9h45m49.203069171s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.198583263 (9h45m49.629663394s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.210947310 (9h45m49.642027441s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.212619739 (9h45m49.64369987s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.280232032 (9h45m49.711312214s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.282230024 (9h45m49.713310156s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.290774874 (9h45m49.721855025s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.297371445 (9h45m49.728451586s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.306000275 (9h45m49.737080416s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.309610462 (9h45m49.740690593s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.320720138 (9h45m49.751800259s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.342139279 (9h45m49.77321941s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.342166040 (9h45m49.773246171s) [seg_pos={0 0}, upload=10189]: Segment reached optimal threshold of 14 pieces. Aug 9 03:11:55.342273606 (9h45m49.773353737s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342324784 (9h45m49.773404915s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mjbYcXw9TCoRMkYNVzDYiT1VxMVnaQzdYxrRsBHD8ghy7GouC): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342375261 (9h45m49.773455392s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342386181 (9h45m49.773466312s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr): protocol: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection Aug 9 03:11:55.342401431 (9h45m49.773481562s) [seg_pos={0 0}, upload=10189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:11:55.342479059 (9h45m49.77355919s) [upload=10189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:11:55.342483448 (9h45m49.773563579s) [upload=10189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:11:55.637456399 (9h45m50.06853653s) [upload=10189]: Done uploading segments... Aug 9 03:11:55.637473051 (9h45m50.068553182s) [upload=10189]: Upload finished. err: <nil> Duration: 5.875520697s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [................X...............X.X.....X...................] duration: 1.849481081s FAIL (2025-08-09 03:16:59 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil> Duration:* 1.849570312s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X..X........................X..................X......] duration: 5.934497146s FAIL (2025-08-09 03:16:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12589740e5423c81986be625ae369ea3bb9a862667a4b68cdfbe3a5a8499fdf5 != before 231c3069e22dc8ec515cb4e010a2fd6354ce784228d42eb40dfc821871182e1d ======LOGS====== Aug 9 03:11:52.837206901 (9h45m47.268287032s) [upload=10189]: Starting upload Aug 9 03:11:52.837263078 (9h45m47.268343209s) [upload=10189]: Done starting upload Aug 9 03:11:52.837308224 (9h45m47.268388355s) [upload=10189]: Uploading segments... Aug 9 03:11:52.837446088 (9h45m47.268526209s) [upload=10189]: Got next segment. Inline: false Aug 9 03:11:52.837473300 (9h45m47.268553431s) [upload=10189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:11:52.837478210 (9h45m47.268558341s) [upload=10189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:11:53.290738263 (9h45m47.721818404s) [seg_pos={0 0}, upload=10189]: Begin upload segment... Aug 9 03:11:53.290778952 (9h45m47.721859093s) [seg_pos={0 0}, upload=10189]: Done begin upload segment. Aug 9 03:11:53.290805542 (9h45m47.721885674s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.290810211 (9h45m47.721890352s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.290908560 (9h45m47.721988681s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291184478 (9h45m47.722264609s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291199576 (9h45m47.722279717s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291446809 (9h45m47.72252694s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291514579 (9h45m47.72259471s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291707198 (9h45m47.722787329s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291818821 (9h45m47.722898952s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291970150 (9h45m47.723050281s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292130006 (9h45m47.723210137s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292230749 (9h45m47.723310871s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292498231 (9h45m47.723578352s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292508671 (9h45m47.723588802s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292721027 (9h45m47.723801168s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.293467175 (9h45m47.724547316s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.293836181 (9h45m47.724916312s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.294090587 (9h45m47.725170718s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:54.404493912 (9h45m48.835574033s) [upload=10189]: Next returned nil segment Aug 9 03:11:54.404515964 (9h45m48.835596096s) [upload=10189]: Waiting for error group managing segments... Aug 9 03:11:54.694436519 (9h45m49.12551665s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:54.751825061 (9h45m49.182905192s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:54.771989050 (9h45m49.203069171s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.198583263 (9h45m49.629663394s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.210947310 (9h45m49.642027441s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.212619739 (9h45m49.64369987s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.280232032 (9h45m49.711312214s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.282230024 (9h45m49.713310156s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.290774874 (9h45m49.721855025s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.297371445 (9h45m49.728451586s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.306000275 (9h45m49.737080416s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.309610462 (9h45m49.740690593s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.320720138 (9h45m49.751800259s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.342139279 (9h45m49.77321941s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.342166040 (9h45m49.773246171s) [seg_pos={0 0}, upload=10189]: Segment reached optimal threshold of 14 pieces. Aug 9 03:11:55.342273606 (9h45m49.773353737s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342324784 (9h45m49.773404915s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mjbYcXw9TCoRMkYNVzDYiT1VxMVnaQzdYxrRsBHD8ghy7GouC): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342375261 (9h45m49.773455392s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342386181 (9h45m49.773466312s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr): protocol: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection Aug 9 03:11:55.342401431 (9h45m49.773481562s) [seg_pos={0 0}, upload=10189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:11:55.342479059 (9h45m49.77355919s) [upload=10189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:11:55.342483448 (9h45m49.773563579s) [upload=10189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:11:55.637456399 (9h45m50.06853653s) [upload=10189]: Done uploading segments... Aug 9 03:11:55.637473051 (9h45m50.068553182s) [upload=10189]: Upload finished. err: <nil> Duration: 5.934517105s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.................X...............X.X.....X..................] duration: 1.920229475s FAIL (2025-08-09 03:16:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil> Duration:* 1.92027826s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X..X........................X..................X.....] duration: 5.906100247s FAIL (2025-08-09 03:15:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12589740e5423c81986be625ae369ea3bb9a862667a4b68cdfbe3a5a8499fdf5 != before 231c3069e22dc8ec515cb4e010a2fd6354ce784228d42eb40dfc821871182e1d ======LOGS====== Aug 9 03:11:52.837206901 (9h45m47.268287032s) [upload=10189]: Starting upload Aug 9 03:11:52.837263078 (9h45m47.268343209s) [upload=10189]: Done starting upload Aug 9 03:11:52.837308224 (9h45m47.268388355s) [upload=10189]: Uploading segments... Aug 9 03:11:52.837446088 (9h45m47.268526209s) [upload=10189]: Got next segment. Inline: false Aug 9 03:11:52.837473300 (9h45m47.268553431s) [upload=10189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:11:52.837478210 (9h45m47.268558341s) [upload=10189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:11:53.290738263 (9h45m47.721818404s) [seg_pos={0 0}, upload=10189]: Begin upload segment... Aug 9 03:11:53.290778952 (9h45m47.721859093s) [seg_pos={0 0}, upload=10189]: Done begin upload segment. Aug 9 03:11:53.290805542 (9h45m47.721885674s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.290810211 (9h45m47.721890352s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.290908560 (9h45m47.721988681s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291184478 (9h45m47.722264609s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291199576 (9h45m47.722279717s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291446809 (9h45m47.72252694s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291514579 (9h45m47.72259471s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291707198 (9h45m47.722787329s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291818821 (9h45m47.722898952s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291970150 (9h45m47.723050281s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292130006 (9h45m47.723210137s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292230749 (9h45m47.723310871s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292498231 (9h45m47.723578352s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292508671 (9h45m47.723588802s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292721027 (9h45m47.723801168s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.293467175 (9h45m47.724547316s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.293836181 (9h45m47.724916312s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.294090587 (9h45m47.725170718s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:54.404493912 (9h45m48.835574033s) [upload=10189]: Next returned nil segment Aug 9 03:11:54.404515964 (9h45m48.835596096s) [upload=10189]: Waiting for error group managing segments... Aug 9 03:11:54.694436519 (9h45m49.12551665s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:54.751825061 (9h45m49.182905192s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:54.771989050 (9h45m49.203069171s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.198583263 (9h45m49.629663394s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.210947310 (9h45m49.642027441s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.212619739 (9h45m49.64369987s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.280232032 (9h45m49.711312214s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.282230024 (9h45m49.713310156s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.290774874 (9h45m49.721855025s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.297371445 (9h45m49.728451586s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.306000275 (9h45m49.737080416s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.309610462 (9h45m49.740690593s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.320720138 (9h45m49.751800259s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.342139279 (9h45m49.77321941s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.342166040 (9h45m49.773246171s) [seg_pos={0 0}, upload=10189]: Segment reached optimal threshold of 14 pieces. Aug 9 03:11:55.342273606 (9h45m49.773353737s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342324784 (9h45m49.773404915s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mjbYcXw9TCoRMkYNVzDYiT1VxMVnaQzdYxrRsBHD8ghy7GouC): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342375261 (9h45m49.773455392s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342386181 (9h45m49.773466312s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr): protocol: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection Aug 9 03:11:55.342401431 (9h45m49.773481562s) [seg_pos={0 0}, upload=10189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:11:55.342479059 (9h45m49.77355919s) [upload=10189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:11:55.342483448 (9h45m49.773563579s) [upload=10189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:11:55.637456399 (9h45m50.06853653s) [upload=10189]: Done uploading segments... Aug 9 03:11:55.637473051 (9h45m50.068553182s) [upload=10189]: Upload finished. err: <nil> Duration: 5.90612727s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X..X........................X..................X....] duration: 5.803872696s FAIL (2025-08-09 03:15:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12589740e5423c81986be625ae369ea3bb9a862667a4b68cdfbe3a5a8499fdf5 != before 231c3069e22dc8ec515cb4e010a2fd6354ce784228d42eb40dfc821871182e1d ======LOGS====== Aug 9 03:11:52.837206901 (9h45m47.268287032s) [upload=10189]: Starting upload Aug 9 03:11:52.837263078 (9h45m47.268343209s) [upload=10189]: Done starting upload Aug 9 03:11:52.837308224 (9h45m47.268388355s) [upload=10189]: Uploading segments... Aug 9 03:11:52.837446088 (9h45m47.268526209s) [upload=10189]: Got next segment. Inline: false Aug 9 03:11:52.837473300 (9h45m47.268553431s) [upload=10189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:11:52.837478210 (9h45m47.268558341s) [upload=10189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:11:53.290738263 (9h45m47.721818404s) [seg_pos={0 0}, upload=10189]: Begin upload segment... Aug 9 03:11:53.290778952 (9h45m47.721859093s) [seg_pos={0 0}, upload=10189]: Done begin upload segment. Aug 9 03:11:53.290805542 (9h45m47.721885674s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.290810211 (9h45m47.721890352s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.290908560 (9h45m47.721988681s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291184478 (9h45m47.722264609s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291199576 (9h45m47.722279717s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291446809 (9h45m47.72252694s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291514579 (9h45m47.72259471s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291707198 (9h45m47.722787329s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291818821 (9h45m47.722898952s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291970150 (9h45m47.723050281s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292130006 (9h45m47.723210137s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292230749 (9h45m47.723310871s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292498231 (9h45m47.723578352s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292508671 (9h45m47.723588802s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292721027 (9h45m47.723801168s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.293467175 (9h45m47.724547316s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.293836181 (9h45m47.724916312s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.294090587 (9h45m47.725170718s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:54.404493912 (9h45m48.835574033s) [upload=10189]: Next returned nil segment Aug 9 03:11:54.404515964 (9h45m48.835596096s) [upload=10189]: Waiting for error group managing segments... Aug 9 03:11:54.694436519 (9h45m49.12551665s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:54.751825061 (9h45m49.182905192s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:54.771989050 (9h45m49.203069171s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.198583263 (9h45m49.629663394s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.210947310 (9h45m49.642027441s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.212619739 (9h45m49.64369987s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.280232032 (9h45m49.711312214s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.282230024 (9h45m49.713310156s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.290774874 (9h45m49.721855025s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.297371445 (9h45m49.728451586s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.306000275 (9h45m49.737080416s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.309610462 (9h45m49.740690593s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.320720138 (9h45m49.751800259s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.342139279 (9h45m49.77321941s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.342166040 (9h45m49.773246171s) [seg_pos={0 0}, upload=10189]: Segment reached optimal threshold of 14 pieces. Aug 9 03:11:55.342273606 (9h45m49.773353737s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342324784 (9h45m49.773404915s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mjbYcXw9TCoRMkYNVzDYiT1VxMVnaQzdYxrRsBHD8ghy7GouC): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342375261 (9h45m49.773455392s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342386181 (9h45m49.773466312s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr): protocol: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection Aug 9 03:11:55.342401431 (9h45m49.773481562s) [seg_pos={0 0}, upload=10189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:11:55.342479059 (9h45m49.77355919s) [upload=10189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:11:55.342483448 (9h45m49.773563579s) [upload=10189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:11:55.637456399 (9h45m50.06853653s) [upload=10189]: Done uploading segments... Aug 9 03:11:55.637473051 (9h45m50.068553182s) [upload=10189]: Upload finished. err: <nil> Duration: 5.803892665s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..................X...............X.X.....X.................] duration: 2.077569893s FAIL (2025-08-09 03:14:57 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil> Duration:* 2.077592277s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X..X........................X..................X...] duration: 5.836167378s FAIL (2025-08-09 03:14:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12589740e5423c81986be625ae369ea3bb9a862667a4b68cdfbe3a5a8499fdf5 != before 231c3069e22dc8ec515cb4e010a2fd6354ce784228d42eb40dfc821871182e1d ======LOGS====== Aug 9 03:11:52.837206901 (9h45m47.268287032s) [upload=10189]: Starting upload Aug 9 03:11:52.837263078 (9h45m47.268343209s) [upload=10189]: Done starting upload Aug 9 03:11:52.837308224 (9h45m47.268388355s) [upload=10189]: Uploading segments... Aug 9 03:11:52.837446088 (9h45m47.268526209s) [upload=10189]: Got next segment. Inline: false Aug 9 03:11:52.837473300 (9h45m47.268553431s) [upload=10189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:11:52.837478210 (9h45m47.268558341s) [upload=10189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:11:53.290738263 (9h45m47.721818404s) [seg_pos={0 0}, upload=10189]: Begin upload segment... Aug 9 03:11:53.290778952 (9h45m47.721859093s) [seg_pos={0 0}, upload=10189]: Done begin upload segment. Aug 9 03:11:53.290805542 (9h45m47.721885674s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.290810211 (9h45m47.721890352s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.290908560 (9h45m47.721988681s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291184478 (9h45m47.722264609s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291199576 (9h45m47.722279717s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291446809 (9h45m47.72252694s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291514579 (9h45m47.72259471s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291707198 (9h45m47.722787329s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291818821 (9h45m47.722898952s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291970150 (9h45m47.723050281s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292130006 (9h45m47.723210137s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292230749 (9h45m47.723310871s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292498231 (9h45m47.723578352s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292508671 (9h45m47.723588802s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292721027 (9h45m47.723801168s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.293467175 (9h45m47.724547316s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.293836181 (9h45m47.724916312s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.294090587 (9h45m47.725170718s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:54.404493912 (9h45m48.835574033s) [upload=10189]: Next returned nil segment Aug 9 03:11:54.404515964 (9h45m48.835596096s) [upload=10189]: Waiting for error group managing segments... Aug 9 03:11:54.694436519 (9h45m49.12551665s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:54.751825061 (9h45m49.182905192s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:54.771989050 (9h45m49.203069171s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.198583263 (9h45m49.629663394s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.210947310 (9h45m49.642027441s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.212619739 (9h45m49.64369987s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.280232032 (9h45m49.711312214s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.282230024 (9h45m49.713310156s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.290774874 (9h45m49.721855025s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.297371445 (9h45m49.728451586s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.306000275 (9h45m49.737080416s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.309610462 (9h45m49.740690593s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.320720138 (9h45m49.751800259s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.342139279 (9h45m49.77321941s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.342166040 (9h45m49.773246171s) [seg_pos={0 0}, upload=10189]: Segment reached optimal threshold of 14 pieces. Aug 9 03:11:55.342273606 (9h45m49.773353737s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342324784 (9h45m49.773404915s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mjbYcXw9TCoRMkYNVzDYiT1VxMVnaQzdYxrRsBHD8ghy7GouC): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342375261 (9h45m49.773455392s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342386181 (9h45m49.773466312s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr): protocol: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection Aug 9 03:11:55.342401431 (9h45m49.773481562s) [seg_pos={0 0}, upload=10189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:11:55.342479059 (9h45m49.77355919s) [upload=10189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:11:55.342483448 (9h45m49.773563579s) [upload=10189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:11:55.637456399 (9h45m50.06853653s) [upload=10189]: Done uploading segments... Aug 9 03:11:55.637473051 (9h45m50.068553182s) [upload=10189]: Upload finished. err: <nil> Duration: 5.836204298s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...................X...............X.X.....X................] duration: 1.842968762s FAIL (2025-08-09 03:13:54 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil> Duration:* 1.842984614s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X..X........................X..................X..] duration: 5.654681795s FAIL (2025-08-09 03:13:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12589740e5423c81986be625ae369ea3bb9a862667a4b68cdfbe3a5a8499fdf5 != before 231c3069e22dc8ec515cb4e010a2fd6354ce784228d42eb40dfc821871182e1d ======LOGS====== Aug 9 03:11:52.837206901 (9h45m47.268287032s) [upload=10189]: Starting upload Aug 9 03:11:52.837263078 (9h45m47.268343209s) [upload=10189]: Done starting upload Aug 9 03:11:52.837308224 (9h45m47.268388355s) [upload=10189]: Uploading segments... Aug 9 03:11:52.837446088 (9h45m47.268526209s) [upload=10189]: Got next segment. Inline: false Aug 9 03:11:52.837473300 (9h45m47.268553431s) [upload=10189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:11:52.837478210 (9h45m47.268558341s) [upload=10189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:11:53.290738263 (9h45m47.721818404s) [seg_pos={0 0}, upload=10189]: Begin upload segment... Aug 9 03:11:53.290778952 (9h45m47.721859093s) [seg_pos={0 0}, upload=10189]: Done begin upload segment. Aug 9 03:11:53.290805542 (9h45m47.721885674s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.290810211 (9h45m47.721890352s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.290908560 (9h45m47.721988681s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291184478 (9h45m47.722264609s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291199576 (9h45m47.722279717s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291446809 (9h45m47.72252694s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291514579 (9h45m47.72259471s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291707198 (9h45m47.722787329s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291818821 (9h45m47.722898952s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291970150 (9h45m47.723050281s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292130006 (9h45m47.723210137s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292230749 (9h45m47.723310871s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292498231 (9h45m47.723578352s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292508671 (9h45m47.723588802s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292721027 (9h45m47.723801168s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.293467175 (9h45m47.724547316s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.293836181 (9h45m47.724916312s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.294090587 (9h45m47.725170718s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:54.404493912 (9h45m48.835574033s) [upload=10189]: Next returned nil segment Aug 9 03:11:54.404515964 (9h45m48.835596096s) [upload=10189]: Waiting for error group managing segments... Aug 9 03:11:54.694436519 (9h45m49.12551665s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:54.751825061 (9h45m49.182905192s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:54.771989050 (9h45m49.203069171s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.198583263 (9h45m49.629663394s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.210947310 (9h45m49.642027441s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.212619739 (9h45m49.64369987s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.280232032 (9h45m49.711312214s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.282230024 (9h45m49.713310156s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.290774874 (9h45m49.721855025s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.297371445 (9h45m49.728451586s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.306000275 (9h45m49.737080416s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.309610462 (9h45m49.740690593s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.320720138 (9h45m49.751800259s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.342139279 (9h45m49.77321941s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.342166040 (9h45m49.773246171s) [seg_pos={0 0}, upload=10189]: Segment reached optimal threshold of 14 pieces. Aug 9 03:11:55.342273606 (9h45m49.773353737s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342324784 (9h45m49.773404915s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mjbYcXw9TCoRMkYNVzDYiT1VxMVnaQzdYxrRsBHD8ghy7GouC): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342375261 (9h45m49.773455392s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342386181 (9h45m49.773466312s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr): protocol: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection Aug 9 03:11:55.342401431 (9h45m49.773481562s) [seg_pos={0 0}, upload=10189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:11:55.342479059 (9h45m49.77355919s) [upload=10189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:11:55.342483448 (9h45m49.773563579s) [upload=10189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:11:55.637456399 (9h45m50.06853653s) [upload=10189]: Done uploading segments... Aug 9 03:11:55.637473051 (9h45m50.068553182s) [upload=10189]: Upload finished. err: <nil> Duration: 5.654712535s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X..X........................X..................X.] duration: 5.779328603s FAIL (2025-08-09 03:13:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12589740e5423c81986be625ae369ea3bb9a862667a4b68cdfbe3a5a8499fdf5 != before 231c3069e22dc8ec515cb4e010a2fd6354ce784228d42eb40dfc821871182e1d ======LOGS====== Aug 9 03:11:52.837206901 (9h45m47.268287032s) [upload=10189]: Starting upload Aug 9 03:11:52.837263078 (9h45m47.268343209s) [upload=10189]: Done starting upload Aug 9 03:11:52.837308224 (9h45m47.268388355s) [upload=10189]: Uploading segments... Aug 9 03:11:52.837446088 (9h45m47.268526209s) [upload=10189]: Got next segment. Inline: false Aug 9 03:11:52.837473300 (9h45m47.268553431s) [upload=10189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:11:52.837478210 (9h45m47.268558341s) [upload=10189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:11:53.290738263 (9h45m47.721818404s) [seg_pos={0 0}, upload=10189]: Begin upload segment... Aug 9 03:11:53.290778952 (9h45m47.721859093s) [seg_pos={0 0}, upload=10189]: Done begin upload segment. Aug 9 03:11:53.290805542 (9h45m47.721885674s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.290810211 (9h45m47.721890352s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.290908560 (9h45m47.721988681s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291184478 (9h45m47.722264609s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291199576 (9h45m47.722279717s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291446809 (9h45m47.72252694s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291514579 (9h45m47.72259471s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291707198 (9h45m47.722787329s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291818821 (9h45m47.722898952s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291970150 (9h45m47.723050281s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292130006 (9h45m47.723210137s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292230749 (9h45m47.723310871s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292498231 (9h45m47.723578352s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292508671 (9h45m47.723588802s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292721027 (9h45m47.723801168s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.293467175 (9h45m47.724547316s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.293836181 (9h45m47.724916312s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.294090587 (9h45m47.725170718s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:54.404493912 (9h45m48.835574033s) [upload=10189]: Next returned nil segment Aug 9 03:11:54.404515964 (9h45m48.835596096s) [upload=10189]: Waiting for error group managing segments... Aug 9 03:11:54.694436519 (9h45m49.12551665s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:54.751825061 (9h45m49.182905192s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:54.771989050 (9h45m49.203069171s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.198583263 (9h45m49.629663394s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.210947310 (9h45m49.642027441s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.212619739 (9h45m49.64369987s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.280232032 (9h45m49.711312214s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.282230024 (9h45m49.713310156s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.290774874 (9h45m49.721855025s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.297371445 (9h45m49.728451586s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.306000275 (9h45m49.737080416s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.309610462 (9h45m49.740690593s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.320720138 (9h45m49.751800259s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.342139279 (9h45m49.77321941s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.342166040 (9h45m49.773246171s) [seg_pos={0 0}, upload=10189]: Segment reached optimal threshold of 14 pieces. Aug 9 03:11:55.342273606 (9h45m49.773353737s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342324784 (9h45m49.773404915s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mjbYcXw9TCoRMkYNVzDYiT1VxMVnaQzdYxrRsBHD8ghy7GouC): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342375261 (9h45m49.773455392s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342386181 (9h45m49.773466312s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr): protocol: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection Aug 9 03:11:55.342401431 (9h45m49.773481562s) [seg_pos={0 0}, upload=10189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:11:55.342479059 (9h45m49.77355919s) [upload=10189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:11:55.342483448 (9h45m49.773563579s) [upload=10189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:11:55.637456399 (9h45m50.06853653s) [upload=10189]: Done uploading segments... Aug 9 03:11:55.637473051 (9h45m50.068553182s) [upload=10189]: Upload finished. err: <nil> Duration: 5.779359191s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [....................X...............X.X.....X...............] duration: 1.896521604s FAIL (2025-08-09 03:12:59 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil> Duration:* 1.896552713s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.....................X...............X.X.....X..............] duration: 1.865419818s FAIL (2025-08-09 03:12:26 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil> Duration:* 1.865444195s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [......................X...............X.X.....X.............] duration: 1.96360536s FAIL (2025-08-09 03:12:06 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil> Duration:* 1.9636321s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [............X..X........................X..................X] duration: 5.90010207s FAIL (2025-08-09 03:11:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12589740e5423c81986be625ae369ea3bb9a862667a4b68cdfbe3a5a8499fdf5 != before 231c3069e22dc8ec515cb4e010a2fd6354ce784228d42eb40dfc821871182e1d ======LOGS====== Aug 9 03:11:52.837206901 (9h45m47.268287032s) [upload=10189]: Starting upload Aug 9 03:11:52.837263078 (9h45m47.268343209s) [upload=10189]: Done starting upload Aug 9 03:11:52.837308224 (9h45m47.268388355s) [upload=10189]: Uploading segments... Aug 9 03:11:52.837446088 (9h45m47.268526209s) [upload=10189]: Got next segment. Inline: false Aug 9 03:11:52.837473300 (9h45m47.268553431s) [upload=10189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:11:52.837478210 (9h45m47.268558341s) [upload=10189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:11:53.290738263 (9h45m47.721818404s) [seg_pos={0 0}, upload=10189]: Begin upload segment... Aug 9 03:11:53.290778952 (9h45m47.721859093s) [seg_pos={0 0}, upload=10189]: Done begin upload segment. Aug 9 03:11:53.290805542 (9h45m47.721885674s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.290810211 (9h45m47.721890352s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.290908560 (9h45m47.721988681s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291184478 (9h45m47.722264609s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291199576 (9h45m47.722279717s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291446809 (9h45m47.72252694s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291514579 (9h45m47.72259471s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291707198 (9h45m47.722787329s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291818821 (9h45m47.722898952s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.291970150 (9h45m47.723050281s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292130006 (9h45m47.723210137s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292230749 (9h45m47.723310871s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292498231 (9h45m47.723578352s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292508671 (9h45m47.723588802s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.292721027 (9h45m47.723801168s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.293467175 (9h45m47.724547316s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.293836181 (9h45m47.724916312s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:53.294090587 (9h45m47.725170718s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Uploading piece... Aug 9 03:11:54.404493912 (9h45m48.835574033s) [upload=10189]: Next returned nil segment Aug 9 03:11:54.404515964 (9h45m48.835596096s) [upload=10189]: Waiting for error group managing segments... Aug 9 03:11:54.694436519 (9h45m49.12551665s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:54.751825061 (9h45m49.182905192s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:54.771989050 (9h45m49.203069171s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.198583263 (9h45m49.629663394s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.210947310 (9h45m49.642027441s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.212619739 (9h45m49.64369987s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.280232032 (9h45m49.711312214s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.282230024 (9h45m49.713310156s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.290774874 (9h45m49.721855025s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.297371445 (9h45m49.728451586s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.306000275 (9h45m49.737080416s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.309610462 (9h45m49.740690593s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.320720138 (9h45m49.751800259s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.342139279 (9h45m49.77321941s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil> Aug 9 03:11:55.342166040 (9h45m49.773246171s) [seg_pos={0 0}, upload=10189]: Segment reached optimal threshold of 14 pieces. Aug 9 03:11:55.342273606 (9h45m49.773353737s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342324784 (9h45m49.773404915s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mjbYcXw9TCoRMkYNVzDYiT1VxMVnaQzdYxrRsBHD8ghy7GouC): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342375261 (9h45m49.773455392s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF Aug 9 03:11:55.342386181 (9h45m49.773466312s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr): protocol: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection Aug 9 03:11:55.342401431 (9h45m49.773481562s) [seg_pos={0 0}, upload=10189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:11:55.342479059 (9h45m49.77355919s) [upload=10189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:11:55.342483448 (9h45m49.773563579s) [upload=10189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:11:55.637456399 (9h45m50.06853653s) [upload=10189]: Done uploading segments... Aug 9 03:11:55.637473051 (9h45m50.068553182s) [upload=10189]: Upload finished. err: <nil> Duration: 5.900128541s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [X............X..X........................X..................] duration: 5.721421238s FAIL (2025-08-09 03:11:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests Duration: 5.721443771s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.......................X...............X.X.....X............] duration: 1.862073206s FAIL (2025-08-09 03:11:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil> Duration:* 1.862099095s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X............X..X........................X.................] duration: 5.82561299s FAIL (2025-08-09 03:10:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests Duration: 5.825637556s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X............X..X........................X................] duration: 5.966788031s FAIL (2025-08-09 03:10:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests Duration: 5.966816536s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [........................X...............X.X.....X...........] duration: 1.811912106s FAIL (2025-08-09 03:09:51 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil> Duration:* 1.811937624s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X............X..X........................X...............] duration: 5.88132837s FAIL (2025-08-09 03:09:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests Duration: 5.881350562s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.........................X...............X.X.....X..........] duration: 1.817737251s FAIL (2025-08-09 03:08:44 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil> Duration:* 1.817761146s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X............X..X........................X..............] duration: 5.852681759s FAIL (2025-08-09 03:08:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests Duration: 5.852710042s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..........................X...............X.X.....X.........] duration: 2.082116529s FAIL (2025-08-09 03:08:07 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil> Duration:* 2.082142619s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X............X..X........................X.............] duration: 5.609510558s FAIL (2025-08-09 03:08:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests Duration: 5.609530847s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X............X..X........................X............] duration: 5.757293795s FAIL (2025-08-09 03:07:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests Duration: 5.757321429s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X............X..X........................X...........] duration: 5.761404577s FAIL (2025-08-09 03:07:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests Duration: 5.761428283s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...........................X...............X.X.....X........] duration: 2.021434656s FAIL (2025-08-09 03:07:07 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil> Duration:* 2.021460656s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [............................X...............X.X.....X.......] duration: 1.92418657s FAIL (2025-08-09 03:06:47 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil> Duration:* 1.924216477s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X............X..X........................X..........] duration: 5.769174245s FAIL (2025-08-09 03:06:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests Duration: 5.769200606s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.............................X...............X.X.....X......] duration: 1.864604842s FAIL (2025-08-09 03:05:49 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil> Duration:* 1.864629378s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X............X..X........................X.........] duration: 5.555922436s FAIL (2025-08-09 03:05:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests Duration: 5.556004512s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X............X..X........................X........] duration: 5.630048103s FAIL (2025-08-09 03:05:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests Duration: 5.630074433s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..............................X...............X.X.....X.....] duration: 1.843332955s FAIL (2025-08-09 03:04:48 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil> Duration:* 1.843360828s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X............X..X........................X.......] duration: 5.810260786s FAIL (2025-08-09 03:04:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests Duration: 5.810281103s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...............................X...............X.X.....X....] duration: 2.033739069s FAIL (2025-08-09 03:04:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil> Duration:* 2.033762915s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [................................X...............X.X.....X...] duration: 2.1156297s FAIL (2025-08-09 03:03:37 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil> Duration:* 2.115653836s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [............X............X..X........................X......] duration: 5.879613217s FAIL (2025-08-09 03:03:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests Duration: 5.879643174s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [X................................X...............X.X.....X..] duration: 1.832235152s FAIL (2025-08-09 03:02:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil> Duration:* 1.832330754s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............X............X..X........................X.....] duration: 5.808743892s FAIL (2025-08-09 03:02:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests Duration: 5.808774531s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [X.............X............X..X........................X....] duration: 5.870920004s FAIL (2025-08-09 03:01:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests Duration: 5.870942737s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.X................................X...............X.X.....X.] duration: 1.881009018s FAIL (2025-08-09 03:01:51 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil> Duration:* 1.881053043s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [X.X................................X...............X.X.....X] duration: 1.445911583s FAIL (2025-08-09 03:01:36 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil> Duration:* 1.445932431s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.X.............X............X..X........................X...] duration: 5.985346471s FAIL (2025-08-09 03:01:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests Duration: 5.985368832s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)