Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...................X...............X.X.....X................] duration:
1.842968762s
FAIL (2025-08-09 03:13:54 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil>
Duration: 1.842984614s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..........X..X........................X..................X..] duration:
5.654681795s
FAIL (2025-08-09 03:13:26 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12589740e5423c81986be625ae369ea3bb9a862667a4b68cdfbe3a5a8499fdf5 != before 231c3069e22dc8ec515cb4e010a2fd6354ce784228d42eb40dfc821871182e1d
======LOGS======
Aug 9 03:11:52.837206901 (9h45m47.268287032s) [upload=10189]: Starting upload
Aug 9 03:11:52.837263078 (9h45m47.268343209s) [upload=10189]: Done starting upload
Aug 9 03:11:52.837308224 (9h45m47.268388355s) [upload=10189]: Uploading segments...
Aug 9 03:11:52.837446088 (9h45m47.268526209s) [upload=10189]: Got next segment. Inline: false
Aug 9 03:11:52.837473300 (9h45m47.268553431s) [upload=10189]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 03:11:52.837478210 (9h45m47.268558341s) [upload=10189]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 03:11:53.290738263 (9h45m47.721818404s) [seg_pos={0 0}, upload=10189]: Begin upload segment...
Aug 9 03:11:53.290778952 (9h45m47.721859093s) [seg_pos={0 0}, upload=10189]: Done begin upload segment.
Aug 9 03:11:53.290805542 (9h45m47.721885674s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.290810211 (9h45m47.721890352s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.290908560 (9h45m47.721988681s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.291184478 (9h45m47.722264609s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.291199576 (9h45m47.722279717s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.291446809 (9h45m47.72252694s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.291514579 (9h45m47.72259471s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.291707198 (9h45m47.722787329s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.291818821 (9h45m47.722898952s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.291970150 (9h45m47.723050281s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.292130006 (9h45m47.723210137s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.292230749 (9h45m47.723310871s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.292498231 (9h45m47.723578352s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.292508671 (9h45m47.723588802s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.292721027 (9h45m47.723801168s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.293467175 (9h45m47.724547316s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.293836181 (9h45m47.724916312s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.294090587 (9h45m47.725170718s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:54.404493912 (9h45m48.835574033s) [upload=10189]: Next returned nil segment
Aug 9 03:11:54.404515964 (9h45m48.835596096s) [upload=10189]: Waiting for error group managing segments...
Aug 9 03:11:54.694436519 (9h45m49.12551665s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:54.751825061 (9h45m49.182905192s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:54.771989050 (9h45m49.203069171s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.198583263 (9h45m49.629663394s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.210947310 (9h45m49.642027441s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.212619739 (9h45m49.64369987s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.280232032 (9h45m49.711312214s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.282230024 (9h45m49.713310156s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.290774874 (9h45m49.721855025s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.297371445 (9h45m49.728451586s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.306000275 (9h45m49.737080416s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.309610462 (9h45m49.740690593s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.320720138 (9h45m49.751800259s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.342139279 (9h45m49.77321941s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.342166040 (9h45m49.773246171s) [seg_pos={0 0}, upload=10189]: Segment reached optimal threshold of 14 pieces.
Aug 9 03:11:55.342273606 (9h45m49.773353737s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG): protocol: expected piece hash; context canceled; EOF
Aug 9 03:11:55.342324784 (9h45m49.773404915s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mjbYcXw9TCoRMkYNVzDYiT1VxMVnaQzdYxrRsBHD8ghy7GouC): protocol: expected piece hash; context canceled; EOF
Aug 9 03:11:55.342375261 (9h45m49.773455392s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF
Aug 9 03:11:55.342386181 (9h45m49.773466312s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr): protocol: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection
Aug 9 03:11:55.342401431 (9h45m49.773481562s) [seg_pos={0 0}, upload=10189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 03:11:55.342479059 (9h45m49.77355919s) [upload=10189]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 03:11:55.342483448 (9h45m49.773563579s) [upload=10189]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 03:11:55.637456399 (9h45m50.06853653s) [upload=10189]: Done uploading segments...
Aug 9 03:11:55.637473051 (9h45m50.068553182s) [upload=10189]: Upload finished. err: <nil>
Duration: 5.654712535s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...........X..X........................X..................X.] duration:
5.779328603s
FAIL (2025-08-09 03:13:06 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12589740e5423c81986be625ae369ea3bb9a862667a4b68cdfbe3a5a8499fdf5 != before 231c3069e22dc8ec515cb4e010a2fd6354ce784228d42eb40dfc821871182e1d
======LOGS======
Aug 9 03:11:52.837206901 (9h45m47.268287032s) [upload=10189]: Starting upload
Aug 9 03:11:52.837263078 (9h45m47.268343209s) [upload=10189]: Done starting upload
Aug 9 03:11:52.837308224 (9h45m47.268388355s) [upload=10189]: Uploading segments...
Aug 9 03:11:52.837446088 (9h45m47.268526209s) [upload=10189]: Got next segment. Inline: false
Aug 9 03:11:52.837473300 (9h45m47.268553431s) [upload=10189]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 03:11:52.837478210 (9h45m47.268558341s) [upload=10189]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 03:11:53.290738263 (9h45m47.721818404s) [seg_pos={0 0}, upload=10189]: Begin upload segment...
Aug 9 03:11:53.290778952 (9h45m47.721859093s) [seg_pos={0 0}, upload=10189]: Done begin upload segment.
Aug 9 03:11:53.290805542 (9h45m47.721885674s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.290810211 (9h45m47.721890352s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.290908560 (9h45m47.721988681s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.291184478 (9h45m47.722264609s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.291199576 (9h45m47.722279717s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.291446809 (9h45m47.72252694s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.291514579 (9h45m47.72259471s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.291707198 (9h45m47.722787329s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.291818821 (9h45m47.722898952s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.291970150 (9h45m47.723050281s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.292130006 (9h45m47.723210137s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.292230749 (9h45m47.723310871s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.292498231 (9h45m47.723578352s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.292508671 (9h45m47.723588802s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.292721027 (9h45m47.723801168s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.293467175 (9h45m47.724547316s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.293836181 (9h45m47.724916312s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.294090587 (9h45m47.725170718s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:54.404493912 (9h45m48.835574033s) [upload=10189]: Next returned nil segment
Aug 9 03:11:54.404515964 (9h45m48.835596096s) [upload=10189]: Waiting for error group managing segments...
Aug 9 03:11:54.694436519 (9h45m49.12551665s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:54.751825061 (9h45m49.182905192s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:54.771989050 (9h45m49.203069171s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.198583263 (9h45m49.629663394s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.210947310 (9h45m49.642027441s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.212619739 (9h45m49.64369987s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.280232032 (9h45m49.711312214s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.282230024 (9h45m49.713310156s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.290774874 (9h45m49.721855025s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.297371445 (9h45m49.728451586s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.306000275 (9h45m49.737080416s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.309610462 (9h45m49.740690593s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.320720138 (9h45m49.751800259s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.342139279 (9h45m49.77321941s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.342166040 (9h45m49.773246171s) [seg_pos={0 0}, upload=10189]: Segment reached optimal threshold of 14 pieces.
Aug 9 03:11:55.342273606 (9h45m49.773353737s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG): protocol: expected piece hash; context canceled; EOF
Aug 9 03:11:55.342324784 (9h45m49.773404915s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mjbYcXw9TCoRMkYNVzDYiT1VxMVnaQzdYxrRsBHD8ghy7GouC): protocol: expected piece hash; context canceled; EOF
Aug 9 03:11:55.342375261 (9h45m49.773455392s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF
Aug 9 03:11:55.342386181 (9h45m49.773466312s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr): protocol: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection
Aug 9 03:11:55.342401431 (9h45m49.773481562s) [seg_pos={0 0}, upload=10189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 03:11:55.342479059 (9h45m49.77355919s) [upload=10189]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 03:11:55.342483448 (9h45m49.773563579s) [upload=10189]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 03:11:55.637456399 (9h45m50.06853653s) [upload=10189]: Done uploading segments...
Aug 9 03:11:55.637473051 (9h45m50.068553182s) [upload=10189]: Upload finished. err: <nil>
Duration: 5.779359191s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....................X...............X.X.....X...............] duration:
1.896521604s
FAIL (2025-08-09 03:12:59 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil>
Duration: 1.896552713s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....................X...............X.X.....X..............] duration:
1.865419818s
FAIL (2025-08-09 03:12:26 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil>
Duration: 1.865444195s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......................X...............X.X.....X.............] duration:
1.96360536s
FAIL (2025-08-09 03:12:06 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil>
Duration: 1.9636321s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [............X..X........................X..................X] duration:
5.90010207s
FAIL (2025-08-09 03:11:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 12589740e5423c81986be625ae369ea3bb9a862667a4b68cdfbe3a5a8499fdf5 != before 231c3069e22dc8ec515cb4e010a2fd6354ce784228d42eb40dfc821871182e1d
======LOGS======
Aug 9 03:11:52.837206901 (9h45m47.268287032s) [upload=10189]: Starting upload
Aug 9 03:11:52.837263078 (9h45m47.268343209s) [upload=10189]: Done starting upload
Aug 9 03:11:52.837308224 (9h45m47.268388355s) [upload=10189]: Uploading segments...
Aug 9 03:11:52.837446088 (9h45m47.268526209s) [upload=10189]: Got next segment. Inline: false
Aug 9 03:11:52.837473300 (9h45m47.268553431s) [upload=10189]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 03:11:52.837478210 (9h45m47.268558341s) [upload=10189]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 03:11:53.290738263 (9h45m47.721818404s) [seg_pos={0 0}, upload=10189]: Begin upload segment...
Aug 9 03:11:53.290778952 (9h45m47.721859093s) [seg_pos={0 0}, upload=10189]: Done begin upload segment.
Aug 9 03:11:53.290805542 (9h45m47.721885674s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.290810211 (9h45m47.721890352s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.290908560 (9h45m47.721988681s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.291184478 (9h45m47.722264609s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.291199576 (9h45m47.722279717s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.291446809 (9h45m47.72252694s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.291514579 (9h45m47.72259471s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.291707198 (9h45m47.722787329s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.291818821 (9h45m47.722898952s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.291970150 (9h45m47.723050281s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.292130006 (9h45m47.723210137s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.292230749 (9h45m47.723310871s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.292498231 (9h45m47.723578352s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.292508671 (9h45m47.723588802s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.292721027 (9h45m47.723801168s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.293467175 (9h45m47.724547316s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.293836181 (9h45m47.724916312s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:53.294090587 (9h45m47.725170718s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Uploading piece...
Aug 9 03:11:54.404493912 (9h45m48.835574033s) [upload=10189]: Next returned nil segment
Aug 9 03:11:54.404515964 (9h45m48.835596096s) [upload=10189]: Waiting for error group managing segments...
Aug 9 03:11:54.694436519 (9h45m49.12551665s) [noise=true , address=64.49.13.26:4945 , piece_id=KPNIUPZELCSZPKM7IIGFZG5F26WX2S75WCYGLG5FDES4NEUPN6HQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:54.751825061 (9h45m49.182905192s) [noise=true , address=64.49.13.137:4504 , piece_id=Y7U7MPODTHVW4NGDIYTD4PBN6CXN5JKZAD7GASU3CNZMYYFVWJLA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:54.771989050 (9h45m49.203069171s) [noise=true , address=64.49.13.155:4923 , piece_id=IWGYQ4BANRHJXYPO2SVMYYVFQSYEZK4G6C4WEY7VBWN6YDNKEXDA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.198583263 (9h45m49.629663394s) [noise=true , address=104.36.82.9:4009 , piece_id=VL6J2VNRCZLYIT5I34WLYCJDD5RVCPP3IMW37NUHOU2YKIJAPNPA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.210947310 (9h45m49.642027441s) [noise=true , address=104.36.82.14:4236 , piece_id=AY35KRKIWP765S2J6Z6HV4RP5DD2U5DY5INKGZZ7YGI7SHSTW7UA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.212619739 (9h45m49.64369987s) [noise=true , address=104.36.82.45:4910 , piece_id=AMTJPB7N5H5Q5SITZ4GIAXINJ7ISTL7KV4Q24AZMCD2C2DSTEGDQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.280232032 (9h45m49.711312214s) [noise=true , address=45.91.116.14:4212 , piece_id=CLUWQ5OQFVX5CSSRCTQAYP6UXQWCDDWU54NFRCPLRF2WBQSODINQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.282230024 (9h45m49.713310156s) [noise=true , address=45.91.116.14:4200 , piece_id=AZGZSIR7FPJUCA2SVKP3OQ7XZZQLSS7SAAJH3UBLBHIZBGRJZIPQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.290774874 (9h45m49.721855025s) [noise=true , address=104.36.82.4:4812 , piece_id=DDDR22QWBFVKIVWW5UU6YXLD7YGBUQE4WHL5FY65OF6WRT3ZL24A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.297371445 (9h45m49.728451586s) [noise=true , address=104.36.82.62:4432 , piece_id=C2JFTYOWRRGIW2ANK5APAA5DZ7RPV6WXOKACUBNZWBKTKQEUD4GA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.306000275 (9h45m49.737080416s) [noise=true , address=104.36.82.44:4900 , piece_id=BQT5IOXRIF6S47GKAIGFC2MERHHM4IWYVLRFGA35PYYEO6TGUPLQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.309610462 (9h45m49.740690593s) [noise=true , address=104.36.82.52:4111 , piece_id=GWB5PQKBP5GFRV6TWQVSPQXYP325MP5PISSUXE4KMPDJP375DJ7A, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.320720138 (9h45m49.751800259s) [noise=true , address=104.36.82.60:4347 , piece_id=FY4DRAMIYISIOVW7FSUUQJL2VC6HVHJ5FYMR5A6ORJ57BH56F4BQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.342139279 (9h45m49.77321941s) [noise=true , address=104.36.82.46:4513 , piece_id=OTKCPMWQ7SYIQOJHJWQPTWAF43ENX3SXU3PJ6PJ424WUGW6KSLGQ, seg_pos={0 0}, upload=10189]: Done uploading piece. err: <nil>
Aug 9 03:11:55.342166040 (9h45m49.773246171s) [seg_pos={0 0}, upload=10189]: Segment reached optimal threshold of 14 pieces.
Aug 9 03:11:55.342273606 (9h45m49.773353737s) [noise=true , address=104.36.82.47:4544 , piece_id=GX6GUGDYYJX6PEP7MHB7DDUXC4KBGKVXGBGYQ72IPAT5GJFGGQHA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG): protocol: expected piece hash; context canceled; EOF
Aug 9 03:11:55.342324784 (9h45m49.773404915s) [noise=true , address=104.36.82.8:4979 , piece_id=7OZXHG5DHAYMHDHVLH6MI5DYBG3UD4LEXHK5GX72EZKSQ7GOLSNA, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mjbYcXw9TCoRMkYNVzDYiT1VxMVnaQzdYxrRsBHD8ghy7GouC): protocol: expected piece hash; context canceled; EOF
Aug 9 03:11:55.342375261 (9h45m49.773455392s) [noise=true , address=104.36.82.58:4288 , piece_id=5WOZCQTR2PWN64FM3VUGDW3CDDVMNBZVNA5BJ55C265BZMOUJH6Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF
Aug 9 03:11:55.342386181 (9h45m49.773466312s) [noise=true , address=104.36.82.5:4866 , piece_id=OYUBLB26NRSTZ67ZL6WCKQEUAGLEIY3HUGWRX3BS7IFSYPK75T7Q, seg_pos={0 0}, upload=10189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr): protocol: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53950->104.36.82.5:4866: use of closed network connection
Aug 9 03:11:55.342401431 (9h45m49.773481562s) [seg_pos={0 0}, upload=10189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 03:11:55.342479059 (9h45m49.77355919s) [upload=10189]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 03:11:55.342483448 (9h45m49.773563579s) [upload=10189]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 03:11:55.637456399 (9h45m50.06853653s) [upload=10189]: Done uploading segments...
Aug 9 03:11:55.637473051 (9h45m50.068553182s) [upload=10189]: Upload finished. err: <nil>
Duration: 5.900128541s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X............X..X........................X..................] duration:
5.721421238s
FAIL (2025-08-09 03:11:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.721443771s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......................X...............X.X.....X............] duration:
1.862073206s
FAIL (2025-08-09 03:11:03 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil>
Duration: 1.862099095s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X............X..X........................X.................] duration:
5.82561299s
FAIL (2025-08-09 03:10:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.825637556s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X............X..X........................X................] duration:
5.966788031s
FAIL (2025-08-09 03:10:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.966816536s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........................X...............X.X.....X...........] duration:
1.811912106s
FAIL (2025-08-09 03:09:51 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil>
Duration: 1.811937624s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X............X..X........................X...............] duration:
5.88132837s
FAIL (2025-08-09 03:09:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.881350562s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........................X...............X.X.....X..........] duration:
1.817737251s
FAIL (2025-08-09 03:08:44 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil>
Duration: 1.817761146s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X............X..X........................X..............] duration:
5.852681759s
FAIL (2025-08-09 03:08:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.852710042s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........................X...............X.X.....X.........] duration:
2.082116529s
FAIL (2025-08-09 03:08:07 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil>
Duration: 2.082142619s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X............X..X........................X.............] duration:
5.609510558s
FAIL (2025-08-09 03:08:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.609530847s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X............X..X........................X............] duration:
5.757293795s
FAIL (2025-08-09 03:07:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.757321429s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X............X..X........................X...........] duration:
5.761404577s
FAIL (2025-08-09 03:07:07 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.761428283s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........................X...............X.X.....X........] duration:
2.021434656s
FAIL (2025-08-09 03:07:07 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil>
Duration: 2.021460656s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............................X...............X.X.....X.......] duration:
1.92418657s
FAIL (2025-08-09 03:06:47 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil>
Duration: 1.924216477s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........X............X..X........................X..........] duration:
5.769174245s
FAIL (2025-08-09 03:06:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.769200606s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............................X...............X.X.....X......] duration:
1.864604842s
FAIL (2025-08-09 03:05:49 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil>
Duration: 1.864629378s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........X............X..X........................X.........] duration:
5.555922436s
FAIL (2025-08-09 03:05:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.556004512s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..........X............X..X........................X........] duration:
5.630048103s
FAIL (2025-08-09 03:05:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.630074433s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............................X...............X.X.....X.....] duration:
1.843332955s
FAIL (2025-08-09 03:04:48 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil>
Duration: 1.843360828s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...........X............X..X........................X.......] duration:
5.810260786s
FAIL (2025-08-09 03:04:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.810281103s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...............................X...............X.X.....X....] duration:
2.033739069s
FAIL (2025-08-09 03:04:12 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil>
Duration: 2.033762915s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [................................X...............X.X.....X...] duration:
2.1156297s
FAIL (2025-08-09 03:03:37 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil>
Duration: 2.115653836s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [............X............X..X........................X......] duration:
5.879613217s
FAIL (2025-08-09 03:03:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.879643174s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X................................X...............X.X.....X..] duration:
1.832235152s
FAIL (2025-08-09 03:02:55 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil>
Duration: 1.832330754s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.............X............X..X........................X.....] duration:
5.808743892s
FAIL (2025-08-09 03:02:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.808774531s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X.............X............X..X........................X....] duration:
5.870920004s
FAIL (2025-08-09 03:01:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.870942737s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X................................X...............X.X.....X.] duration:
1.881009018s
FAIL (2025-08-09 03:01:51 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil>
Duration: 1.881053043s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [X.X................................X...............X.X.....X] duration:
1.445911583s
FAIL (2025-08-09 03:01:36 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 03:01:35.385878074 (9h35m29.816958205s) [upload=10011]: Starting upload Aug 9 03:01:35.385913311 (9h35m29.816993432s) [upload=10011]: Done starting upload Aug 9 03:01:35.385957716 (9h35m29.817037847s) [upload=10011]: Uploading segments... Aug 9 03:01:35.385991310 (9h35m29.817071441s) [upload=10011]: Got next segment. Inline: true Aug 9 03:01:35.385995288 (9h35m29.817075429s) [upload=10011]: Waiting for error group managing segments... Aug 9 03:01:35.386029463 (9h35m29.817109584s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:01:35.386033380 (9h35m29.817113511s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:01:35.386036116 (9h35m29.817116237s) [upload=10011]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:01:35.718797731 (9h35m30.149877862s) [upload=10011]: Done uploading segments... Aug 9 03:01:35.718815284 (9h35m30.149895415s) [upload=10011]: Upload finished. err: <nil>
Duration: 1.445932431s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X.............X............X..X........................X...] duration:
5.985346471s
FAIL (2025-08-09 03:01:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.985368832s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X.X................................X...............X.X.....] duration:
1.858973549s
FAIL (2025-08-09 03:00:45 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 02:56:50.135818216 (9h30m44.566898348s) [upload=9930]: Starting upload
Aug 9 02:56:50.135858193 (9h30m44.566938314s) [upload=9930]: Done starting upload
Aug 9 02:56:50.135911825 (9h30m44.566991946s) [upload=9930]: Uploading segments...
Aug 9 02:56:50.135947934 (9h30m44.567028065s) [upload=9930]: Got next segment. Inline: true
Aug 9 02:56:50.135952033 (9h30m44.567032164s) [upload=9930]: Waiting for error group managing segments...
Aug 9 02:56:50.135988081 (9h30m44.567068212s) [upload=9930]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 02:56:50.135992109 (9h30m44.56707223s) [upload=9930]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 02:56:50.135994694 (9h30m44.567074825s) [upload=9930]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 02:56:50.648762896 (9h30m45.079843037s) [upload=9930]: Done uploading segments...
Aug 9 02:56:50.648782353 (9h30m45.079862484s) [upload=9930]: Upload finished. err: <nil>
Duration: 1.858994779s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X.............X............X..X........................X..] duration:
5.858135736s
FAIL (2025-08-09 03:00:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.858167565s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..X.X................................X...............X.X....] duration:
1.875554195s
FAIL (2025-08-09 03:00:28 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 02:56:50.135818216 (9h30m44.566898348s) [upload=9930]: Starting upload
Aug 9 02:56:50.135858193 (9h30m44.566938314s) [upload=9930]: Done starting upload
Aug 9 02:56:50.135911825 (9h30m44.566991946s) [upload=9930]: Uploading segments...
Aug 9 02:56:50.135947934 (9h30m44.567028065s) [upload=9930]: Got next segment. Inline: true
Aug 9 02:56:50.135952033 (9h30m44.567032164s) [upload=9930]: Waiting for error group managing segments...
Aug 9 02:56:50.135988081 (9h30m44.567068212s) [upload=9930]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 02:56:50.135992109 (9h30m44.56707223s) [upload=9930]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 02:56:50.135994694 (9h30m44.567074825s) [upload=9930]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 02:56:50.648762896 (9h30m45.079843037s) [upload=9930]: Done uploading segments...
Aug 9 02:56:50.648782353 (9h30m45.079862484s) [upload=9930]: Upload finished. err: <nil>
Duration: 1.875584091s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...X.X................................X...............X.X...] duration:
1.926492882s
FAIL (2025-08-09 02:59:42 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 02:56:50.135818216 (9h30m44.566898348s) [upload=9930]: Starting upload
Aug 9 02:56:50.135858193 (9h30m44.566938314s) [upload=9930]: Done starting upload
Aug 9 02:56:50.135911825 (9h30m44.566991946s) [upload=9930]: Uploading segments...
Aug 9 02:56:50.135947934 (9h30m44.567028065s) [upload=9930]: Got next segment. Inline: true
Aug 9 02:56:50.135952033 (9h30m44.567032164s) [upload=9930]: Waiting for error group managing segments...
Aug 9 02:56:50.135988081 (9h30m44.567068212s) [upload=9930]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 02:56:50.135992109 (9h30m44.56707223s) [upload=9930]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 02:56:50.135994694 (9h30m44.567074825s) [upload=9930]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 02:56:50.648762896 (9h30m45.079843037s) [upload=9930]: Done uploading segments...
Aug 9 02:56:50.648782353 (9h30m45.079862484s) [upload=9930]: Upload finished. err: <nil>
Duration: 1.926518782s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...X.............X............X..X........................X.] duration:
5.74605465s
FAIL (2025-08-09 02:59:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.74608097s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [....X.............X............X..X........................X] duration:
857.345265ms
FAIL (2025-08-09 02:58:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:58:48.999880605 (9h32m43.430960736s) [upload=9966]: Starting upload Aug 9 02:58:48.999927986 (9h32m43.431008117s) [upload=9966]: Done starting upload Aug 9 02:58:48.999961660 (9h32m43.431041802s) [upload=9966]: Uploading segments... Aug 9 02:58:49.000112078 (9h32m43.431192209s) [upload=9966]: Got next segment. Inline: false Aug 9 02:58:49.000140162 (9h32m43.431220293s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:58:49.000144630 (9h32m43.431224761s) [upload=9966]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 02:58:49.212687180 (9h32m43.643767331s) [upload=9966]: Next segment err: metaclient: Too Many Requests Aug 9 02:58:49.212741173 (9h32m43.643821334s) [upload=9966]: Done uploading segments... Aug 9 02:58:49.212758536 (9h32m43.643838667s) [upload=9966]: Upload finished. err: metaclient: Too Many Requests
Duration: 857.367166ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [X...X.X................................X...............X.X..] duration:
1.808699408s
FAIL (2025-08-09 02:58:34 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 02:56:50.135818216 (9h30m44.566898348s) [upload=9930]: Starting upload
Aug 9 02:56:50.135858193 (9h30m44.566938314s) [upload=9930]: Done starting upload
Aug 9 02:56:50.135911825 (9h30m44.566991946s) [upload=9930]: Uploading segments...
Aug 9 02:56:50.135947934 (9h30m44.567028065s) [upload=9930]: Got next segment. Inline: true
Aug 9 02:56:50.135952033 (9h30m44.567032164s) [upload=9930]: Waiting for error group managing segments...
Aug 9 02:56:50.135988081 (9h30m44.567068212s) [upload=9930]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 02:56:50.135992109 (9h30m44.56707223s) [upload=9930]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 02:56:50.135994694 (9h30m44.567074825s) [upload=9930]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 02:56:50.648762896 (9h30m45.079843037s) [upload=9930]: Done uploading segments...
Aug 9 02:56:50.648782353 (9h30m45.079862484s) [upload=9930]: Upload finished. err: <nil>
Duration: 1.808723865s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.X...X.X................................X...............X.X.] duration:
1.899833672s
FAIL (2025-08-09 02:57:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 02:56:50.135818216 (9h30m44.566898348s) [upload=9930]: Starting upload
Aug 9 02:56:50.135858193 (9h30m44.566938314s) [upload=9930]: Done starting upload
Aug 9 02:56:50.135911825 (9h30m44.566991946s) [upload=9930]: Uploading segments...
Aug 9 02:56:50.135947934 (9h30m44.567028065s) [upload=9930]: Got next segment. Inline: true
Aug 9 02:56:50.135952033 (9h30m44.567032164s) [upload=9930]: Waiting for error group managing segments...
Aug 9 02:56:50.135988081 (9h30m44.567068212s) [upload=9930]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 02:56:50.135992109 (9h30m44.56707223s) [upload=9930]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 02:56:50.135994694 (9h30m44.567074825s) [upload=9930]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 02:56:50.648762896 (9h30m45.079843037s) [upload=9930]: Done uploading segments...
Aug 9 02:56:50.648782353 (9h30m45.079862484s) [upload=9930]: Upload finished. err: <nil>
Duration: 1.899857588s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X.............X............X..X........................] duration:
5.899605478s
FAIL (2025-08-09 02:57:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 340c5199709d92db83cf73e25d6a6e8e9ef970b481e48af1b5c39871da1f25ea != before 72e144052a47b7d39b54867e4eb322afd23c418b3edd62d510e4eecd0b26d000
======LOGS======
Aug 9 02:38:26.662158849 (9h12m21.09323898s) [upload=9614]: Starting upload
Aug 9 02:38:26.662208755 (9h12m21.093288886s) [upload=9614]: Done starting upload
Aug 9 02:38:26.662288137 (9h12m21.093368268s) [upload=9614]: Uploading segments...
Aug 9 02:38:26.662380583 (9h12m21.093460744s) [upload=9614]: Got next segment. Inline: false
Aug 9 02:38:26.662428375 (9h12m21.093508506s) [upload=9614]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 02:38:26.662435809 (9h12m21.09351594s) [upload=9614]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 02:38:27.113929392 (9h12m21.545009523s) [seg_pos={0 0}, upload=9614]: Begin upload segment...
Aug 9 02:38:27.113976062 (9h12m21.545056203s) [seg_pos={0 0}, upload=9614]: Done begin upload segment.
Aug 9 02:38:27.114013573 (9h12m21.545093704s) [noise=true , address=104.36.82.3:4786 , piece_id=WJXQBELLMJYXHZAJ7TWOATFOZ2V46Y3WRGUP26XGUJVMS3NCSBIQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.114022961 (9h12m21.545103092s) [noise=true , address=77.90.31.15:4713 , piece_id=FFM2A46FP7KIT6NP5JACEROUHRM2TLMSIACREQZRQPYXMD4I7JLA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.114421965 (9h12m21.545502086s) [noise=true , address=104.36.82.16:4319 , piece_id=3WCDGSJXOBMO25TF2H7CMLJNCWEKKQHIIPUIU4TTLULWSUXVN7IQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.114443646 (9h12m21.545523778s) [noise=true , address=104.36.82.45:4918 , piece_id=D3E7Z4DWP27P6J654KARTJN35AGA4IPXTCWQEFHNG7DDJDQV2BNA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.115300766 (9h12m21.546380897s) [noise=true , address=79.127.201.215:4346 , piece_id=IIZHJJJV6ULFED4PLYRR2LHOE2USGO7TXHCZ34FG6UZIXACTZMXQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.115351023 (9h12m21.546431144s) [noise=true , address=79.127.201.215:4354 , piece_id=3HP3RSXYDGU5LJ5QA3NTSSA7IPYVT64DJV2DZWUJ2BX6WJDY7K3Q, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.115581403 (9h12m21.546661534s) [noise=true , address=104.36.82.52:4113 , piece_id=UXLP55AL3IBQJGTSCVGV45JWKB3CBC6KEP6APZHYYDZ4VA72BWQQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.116249511 (9h12m21.547329642s) [noise=true , address=104.36.82.15:4262 , piece_id=EX5LMAM3C2NFNYLXUFXZLEXAGDDGB2EO252HEUBUXQY2QWLAROOA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.117038491 (9h12m21.548118622s) [noise=true , address=104.36.82.36:4648 , piece_id=TDQ5RSPXGUVHCERTTTEHVXH6LJSFD7ARB6PVZLZCHGGW4OREEZ5Q, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.117530051 (9h12m21.548610183s) [noise=true , address=104.36.82.62:4421 , piece_id=LBZ2DNOECOVQP4EHNP4KUKRMLWB6SGY7RSNX3D2DZEN5G2DXZVNA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.117789077 (9h12m21.548869208s) [noise=true , address=64.49.13.155:4914 , piece_id=UO4VAS4AFSSOSRZHKCKZQ3SCB32ILZZRNWB5XPSLLPL6AXX5KP6A, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.118536547 (9h12m21.549616688s) [noise=true , address=104.36.82.59:4323 , piece_id=LQ3LNXUVPJU75X7FKNTK7LS6BJ55COCZO3M5HSGMNMHOLGMGDFHA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.119075438 (9h12m21.550155569s) [noise=true , address=104.36.82.5:4848 , piece_id=XOAZFGR3OIAO5HD6NO3H64DEP77P7QTQOFNSMU3UZZALN3CJ2KIA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.119528244 (9h12m21.550608375s) [noise=true , address=104.36.82.22:4521 , piece_id=PSVFD6W7SXTRXRQDRBJKBU6QAOQRWW3QEY2AQNBGWOSAL77ZO4OQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.120561171 (9h12m21.551641302s) [noise=true , address=104.36.82.34:4575 , piece_id=EFH2ME5XUNNEKOFQGNR4F437DRKLG7S7R63BY3EBTP2VN3UBRFKQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.121021792 (9h12m21.552101923s) [noise=true , address=104.36.82.46:4506 , piece_id=KFJQP6XAHR6A776DSUSFLSJYACLZEGC3JSO2ZZZG6H2VZXAGWCLQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.121535965 (9h12m21.552616096s) [noise=true , address=104.36.82.44:4897 , piece_id=GH57JACKAAEI3I47QGOXANT4YWHXTNLQDWJOZSVQTTOCM2W3ZNDA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.124820019 (9h12m21.55590015s) [noise=true , address=104.36.82.62:4420 , piece_id=DAI5U6V5KXGMF5DAZSANIAXGR25C2I46DSDUVEWNODCCMI6TTLQQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:28.299580377 (9h12m22.730660508s) [upload=9614]: Next returned nil segment
Aug 9 02:38:28.299620192 (9h12m22.730700334s) [upload=9614]: Waiting for error group managing segments...
Aug 9 02:38:28.597172920 (9h12m23.028253051s) [noise=true , address=64.49.13.155:4914 , piece_id=UO4VAS4AFSSOSRZHKCKZQ3SCB32ILZZRNWB5XPSLLPL6AXX5KP6A, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.012112184 (9h12m23.443192315s) [noise=true , address=104.36.82.3:4786 , piece_id=WJXQBELLMJYXHZAJ7TWOATFOZ2V46Y3WRGUP26XGUJVMS3NCSBIQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.023650971 (9h12m23.454731102s) [noise=true , address=104.36.82.34:4575 , piece_id=EFH2ME5XUNNEKOFQGNR4F437DRKLG7S7R63BY3EBTP2VN3UBRFKQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.038394009 (9h12m23.46947414s) [noise=true , address=104.36.82.46:4506 , piece_id=KFJQP6XAHR6A776DSUSFLSJYACLZEGC3JSO2ZZZG6H2VZXAGWCLQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.040117125 (9h12m23.471197256s) [noise=true , address=79.127.201.215:4354 , piece_id=3HP3RSXYDGU5LJ5QA3NTSSA7IPYVT64DJV2DZWUJ2BX6WJDY7K3Q, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.040374468 (9h12m23.471454599s) [noise=true , address=104.36.82.62:4421 , piece_id=LBZ2DNOECOVQP4EHNP4KUKRMLWB6SGY7RSNX3D2DZEN5G2DXZVNA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.045702944 (9h12m23.476783075s) [noise=true , address=79.127.201.215:4346 , piece_id=IIZHJJJV6ULFED4PLYRR2LHOE2USGO7TXHCZ34FG6UZIXACTZMXQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.051024234 (9h12m23.482104355s) [noise=true , address=77.90.31.15:4713 , piece_id=FFM2A46FP7KIT6NP5JACEROUHRM2TLMSIACREQZRQPYXMD4I7JLA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.070546296 (9h12m23.501626427s) [noise=true , address=104.36.82.62:4420 , piece_id=DAI5U6V5KXGMF5DAZSANIAXGR25C2I46DSDUVEWNODCCMI6TTLQQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.101569643 (9h12m23.532649794s) [noise=true , address=104.36.82.45:4918 , piece_id=D3E7Z4DWP27P6J654KARTJN35AGA4IPXTCWQEFHNG7DDJDQV2BNA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.113588949 (9h12m23.54466908s) [noise=true , address=104.36.82.16:4319 , piece_id=3WCDGSJXOBMO25TF2H7CMLJNCWEKKQHIIPUIU4TTLULWSUXVN7IQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.126651892 (9h12m23.557732023s) [noise=true , address=104.36.82.5:4848 , piece_id=XOAZFGR3OIAO5HD6NO3H64DEP77P7QTQOFNSMU3UZZALN3CJ2KIA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.177243659 (9h12m23.608323791s) [noise=true , address=104.36.82.36:4648 , piece_id=TDQ5RSPXGUVHCERTTTEHVXH6LJSFD7ARB6PVZLZCHGGW4OREEZ5Q, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.179742340 (9h12m23.610822471s) [noise=true , address=104.36.82.22:4521 , piece_id=PSVFD6W7SXTRXRQDRBJKBU6QAOQRWW3QEY2AQNBGWOSAL77ZO4OQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.179756607 (9h12m23.610836738s) [seg_pos={0 0}, upload=9614]: Segment reached optimal threshold of 14 pieces.
Aug 9 02:38:29.179895643 (9h12m23.610975764s) [noise=true , address=104.36.82.59:4323 , piece_id=LQ3LNXUVPJU75X7FKNTK7LS6BJ55COCZO3M5HSGMNMHOLGMGDFHA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLr6Ha1ysWYbUJ8He7RofMFCz8qVuJMBFkfJgnTUVw1kmXckz): protocol: expected piece hash; context canceled; EOF
Aug 9 02:38:29.180007006 (9h12m23.611087137s) [noise=true , address=104.36.82.15:4262 , piece_id=EX5LMAM3C2NFNYLXUFXZLEXAGDDGB2EO252HEUBUXQY2QWLAROOA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Aug 9 02:38:29.180020482 (9h12m23.611100613s) [noise=true , address=104.36.82.52:4113 , piece_id=UXLP55AL3IBQJGTSCVGV45JWKB3CBC6KEP6APZHYYDZ4VA72BWQQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1brZ4RtcK5J3xCPmnbsTccF9hrnj8tqhV1WyMqqrjuitgSGMou): protocol: expected piece hash; context canceled; EOF
Aug 9 02:38:29.180064297 (9h12m23.611144428s) [noise=true , address=104.36.82.44:4897 , piece_id=GH57JACKAAEI3I47QGOXANT4YWHXTNLQDWJOZSVQTTOCM2W3ZNDA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 9 02:38:29.180083663 (9h12m23.611163794s) [seg_pos={0 0}, upload=9614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 02:38:29.180316970 (9h12m23.611397101s) [upload=9614]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 02:38:29.180321368 (9h12m23.611401499s) [upload=9614]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 02:38:29.479901204 (9h12m23.910981335s) [upload=9614]: Done uploading segments...
Aug 9 02:38:29.479933285 (9h12m23.911013406s) [upload=9614]: Upload finished. err: <nil>
Duration: 5.899621549s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X.............X............X..X.......................] duration:
5.903101906s
FAIL (2025-08-09 02:57:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 340c5199709d92db83cf73e25d6a6e8e9ef970b481e48af1b5c39871da1f25ea != before 72e144052a47b7d39b54867e4eb322afd23c418b3edd62d510e4eecd0b26d000
======LOGS======
Aug 9 02:38:26.662158849 (9h12m21.09323898s) [upload=9614]: Starting upload
Aug 9 02:38:26.662208755 (9h12m21.093288886s) [upload=9614]: Done starting upload
Aug 9 02:38:26.662288137 (9h12m21.093368268s) [upload=9614]: Uploading segments...
Aug 9 02:38:26.662380583 (9h12m21.093460744s) [upload=9614]: Got next segment. Inline: false
Aug 9 02:38:26.662428375 (9h12m21.093508506s) [upload=9614]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 02:38:26.662435809 (9h12m21.09351594s) [upload=9614]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 02:38:27.113929392 (9h12m21.545009523s) [seg_pos={0 0}, upload=9614]: Begin upload segment...
Aug 9 02:38:27.113976062 (9h12m21.545056203s) [seg_pos={0 0}, upload=9614]: Done begin upload segment.
Aug 9 02:38:27.114013573 (9h12m21.545093704s) [noise=true , address=104.36.82.3:4786 , piece_id=WJXQBELLMJYXHZAJ7TWOATFOZ2V46Y3WRGUP26XGUJVMS3NCSBIQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.114022961 (9h12m21.545103092s) [noise=true , address=77.90.31.15:4713 , piece_id=FFM2A46FP7KIT6NP5JACEROUHRM2TLMSIACREQZRQPYXMD4I7JLA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.114421965 (9h12m21.545502086s) [noise=true , address=104.36.82.16:4319 , piece_id=3WCDGSJXOBMO25TF2H7CMLJNCWEKKQHIIPUIU4TTLULWSUXVN7IQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.114443646 (9h12m21.545523778s) [noise=true , address=104.36.82.45:4918 , piece_id=D3E7Z4DWP27P6J654KARTJN35AGA4IPXTCWQEFHNG7DDJDQV2BNA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.115300766 (9h12m21.546380897s) [noise=true , address=79.127.201.215:4346 , piece_id=IIZHJJJV6ULFED4PLYRR2LHOE2USGO7TXHCZ34FG6UZIXACTZMXQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.115351023 (9h12m21.546431144s) [noise=true , address=79.127.201.215:4354 , piece_id=3HP3RSXYDGU5LJ5QA3NTSSA7IPYVT64DJV2DZWUJ2BX6WJDY7K3Q, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.115581403 (9h12m21.546661534s) [noise=true , address=104.36.82.52:4113 , piece_id=UXLP55AL3IBQJGTSCVGV45JWKB3CBC6KEP6APZHYYDZ4VA72BWQQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.116249511 (9h12m21.547329642s) [noise=true , address=104.36.82.15:4262 , piece_id=EX5LMAM3C2NFNYLXUFXZLEXAGDDGB2EO252HEUBUXQY2QWLAROOA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.117038491 (9h12m21.548118622s) [noise=true , address=104.36.82.36:4648 , piece_id=TDQ5RSPXGUVHCERTTTEHVXH6LJSFD7ARB6PVZLZCHGGW4OREEZ5Q, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.117530051 (9h12m21.548610183s) [noise=true , address=104.36.82.62:4421 , piece_id=LBZ2DNOECOVQP4EHNP4KUKRMLWB6SGY7RSNX3D2DZEN5G2DXZVNA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.117789077 (9h12m21.548869208s) [noise=true , address=64.49.13.155:4914 , piece_id=UO4VAS4AFSSOSRZHKCKZQ3SCB32ILZZRNWB5XPSLLPL6AXX5KP6A, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.118536547 (9h12m21.549616688s) [noise=true , address=104.36.82.59:4323 , piece_id=LQ3LNXUVPJU75X7FKNTK7LS6BJ55COCZO3M5HSGMNMHOLGMGDFHA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.119075438 (9h12m21.550155569s) [noise=true , address=104.36.82.5:4848 , piece_id=XOAZFGR3OIAO5HD6NO3H64DEP77P7QTQOFNSMU3UZZALN3CJ2KIA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.119528244 (9h12m21.550608375s) [noise=true , address=104.36.82.22:4521 , piece_id=PSVFD6W7SXTRXRQDRBJKBU6QAOQRWW3QEY2AQNBGWOSAL77ZO4OQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.120561171 (9h12m21.551641302s) [noise=true , address=104.36.82.34:4575 , piece_id=EFH2ME5XUNNEKOFQGNR4F437DRKLG7S7R63BY3EBTP2VN3UBRFKQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.121021792 (9h12m21.552101923s) [noise=true , address=104.36.82.46:4506 , piece_id=KFJQP6XAHR6A776DSUSFLSJYACLZEGC3JSO2ZZZG6H2VZXAGWCLQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.121535965 (9h12m21.552616096s) [noise=true , address=104.36.82.44:4897 , piece_id=GH57JACKAAEI3I47QGOXANT4YWHXTNLQDWJOZSVQTTOCM2W3ZNDA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.124820019 (9h12m21.55590015s) [noise=true , address=104.36.82.62:4420 , piece_id=DAI5U6V5KXGMF5DAZSANIAXGR25C2I46DSDUVEWNODCCMI6TTLQQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:28.299580377 (9h12m22.730660508s) [upload=9614]: Next returned nil segment
Aug 9 02:38:28.299620192 (9h12m22.730700334s) [upload=9614]: Waiting for error group managing segments...
Aug 9 02:38:28.597172920 (9h12m23.028253051s) [noise=true , address=64.49.13.155:4914 , piece_id=UO4VAS4AFSSOSRZHKCKZQ3SCB32ILZZRNWB5XPSLLPL6AXX5KP6A, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.012112184 (9h12m23.443192315s) [noise=true , address=104.36.82.3:4786 , piece_id=WJXQBELLMJYXHZAJ7TWOATFOZ2V46Y3WRGUP26XGUJVMS3NCSBIQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.023650971 (9h12m23.454731102s) [noise=true , address=104.36.82.34:4575 , piece_id=EFH2ME5XUNNEKOFQGNR4F437DRKLG7S7R63BY3EBTP2VN3UBRFKQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.038394009 (9h12m23.46947414s) [noise=true , address=104.36.82.46:4506 , piece_id=KFJQP6XAHR6A776DSUSFLSJYACLZEGC3JSO2ZZZG6H2VZXAGWCLQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.040117125 (9h12m23.471197256s) [noise=true , address=79.127.201.215:4354 , piece_id=3HP3RSXYDGU5LJ5QA3NTSSA7IPYVT64DJV2DZWUJ2BX6WJDY7K3Q, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.040374468 (9h12m23.471454599s) [noise=true , address=104.36.82.62:4421 , piece_id=LBZ2DNOECOVQP4EHNP4KUKRMLWB6SGY7RSNX3D2DZEN5G2DXZVNA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.045702944 (9h12m23.476783075s) [noise=true , address=79.127.201.215:4346 , piece_id=IIZHJJJV6ULFED4PLYRR2LHOE2USGO7TXHCZ34FG6UZIXACTZMXQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.051024234 (9h12m23.482104355s) [noise=true , address=77.90.31.15:4713 , piece_id=FFM2A46FP7KIT6NP5JACEROUHRM2TLMSIACREQZRQPYXMD4I7JLA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.070546296 (9h12m23.501626427s) [noise=true , address=104.36.82.62:4420 , piece_id=DAI5U6V5KXGMF5DAZSANIAXGR25C2I46DSDUVEWNODCCMI6TTLQQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.101569643 (9h12m23.532649794s) [noise=true , address=104.36.82.45:4918 , piece_id=D3E7Z4DWP27P6J654KARTJN35AGA4IPXTCWQEFHNG7DDJDQV2BNA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.113588949 (9h12m23.54466908s) [noise=true , address=104.36.82.16:4319 , piece_id=3WCDGSJXOBMO25TF2H7CMLJNCWEKKQHIIPUIU4TTLULWSUXVN7IQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.126651892 (9h12m23.557732023s) [noise=true , address=104.36.82.5:4848 , piece_id=XOAZFGR3OIAO5HD6NO3H64DEP77P7QTQOFNSMU3UZZALN3CJ2KIA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.177243659 (9h12m23.608323791s) [noise=true , address=104.36.82.36:4648 , piece_id=TDQ5RSPXGUVHCERTTTEHVXH6LJSFD7ARB6PVZLZCHGGW4OREEZ5Q, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.179742340 (9h12m23.610822471s) [noise=true , address=104.36.82.22:4521 , piece_id=PSVFD6W7SXTRXRQDRBJKBU6QAOQRWW3QEY2AQNBGWOSAL77ZO4OQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.179756607 (9h12m23.610836738s) [seg_pos={0 0}, upload=9614]: Segment reached optimal threshold of 14 pieces.
Aug 9 02:38:29.179895643 (9h12m23.610975764s) [noise=true , address=104.36.82.59:4323 , piece_id=LQ3LNXUVPJU75X7FKNTK7LS6BJ55COCZO3M5HSGMNMHOLGMGDFHA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLr6Ha1ysWYbUJ8He7RofMFCz8qVuJMBFkfJgnTUVw1kmXckz): protocol: expected piece hash; context canceled; EOF
Aug 9 02:38:29.180007006 (9h12m23.611087137s) [noise=true , address=104.36.82.15:4262 , piece_id=EX5LMAM3C2NFNYLXUFXZLEXAGDDGB2EO252HEUBUXQY2QWLAROOA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Aug 9 02:38:29.180020482 (9h12m23.611100613s) [noise=true , address=104.36.82.52:4113 , piece_id=UXLP55AL3IBQJGTSCVGV45JWKB3CBC6KEP6APZHYYDZ4VA72BWQQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1brZ4RtcK5J3xCPmnbsTccF9hrnj8tqhV1WyMqqrjuitgSGMou): protocol: expected piece hash; context canceled; EOF
Aug 9 02:38:29.180064297 (9h12m23.611144428s) [noise=true , address=104.36.82.44:4897 , piece_id=GH57JACKAAEI3I47QGOXANT4YWHXTNLQDWJOZSVQTTOCM2W3ZNDA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 9 02:38:29.180083663 (9h12m23.611163794s) [seg_pos={0 0}, upload=9614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 02:38:29.180316970 (9h12m23.611397101s) [upload=9614]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 02:38:29.180321368 (9h12m23.611401499s) [upload=9614]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 02:38:29.479901204 (9h12m23.910981335s) [upload=9614]: Done uploading segments...
Aug 9 02:38:29.479933285 (9h12m23.911013406s) [upload=9614]: Upload finished. err: <nil>
Duration: 5.90312968s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X.............X............X..X......................] duration:
6.350607875s
FAIL (2025-08-09 02:56:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 340c5199709d92db83cf73e25d6a6e8e9ef970b481e48af1b5c39871da1f25ea != before 72e144052a47b7d39b54867e4eb322afd23c418b3edd62d510e4eecd0b26d000
======LOGS======
Aug 9 02:38:26.662158849 (9h12m21.09323898s) [upload=9614]: Starting upload
Aug 9 02:38:26.662208755 (9h12m21.093288886s) [upload=9614]: Done starting upload
Aug 9 02:38:26.662288137 (9h12m21.093368268s) [upload=9614]: Uploading segments...
Aug 9 02:38:26.662380583 (9h12m21.093460744s) [upload=9614]: Got next segment. Inline: false
Aug 9 02:38:26.662428375 (9h12m21.093508506s) [upload=9614]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 02:38:26.662435809 (9h12m21.09351594s) [upload=9614]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 02:38:27.113929392 (9h12m21.545009523s) [seg_pos={0 0}, upload=9614]: Begin upload segment...
Aug 9 02:38:27.113976062 (9h12m21.545056203s) [seg_pos={0 0}, upload=9614]: Done begin upload segment.
Aug 9 02:38:27.114013573 (9h12m21.545093704s) [noise=true , address=104.36.82.3:4786 , piece_id=WJXQBELLMJYXHZAJ7TWOATFOZ2V46Y3WRGUP26XGUJVMS3NCSBIQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.114022961 (9h12m21.545103092s) [noise=true , address=77.90.31.15:4713 , piece_id=FFM2A46FP7KIT6NP5JACEROUHRM2TLMSIACREQZRQPYXMD4I7JLA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.114421965 (9h12m21.545502086s) [noise=true , address=104.36.82.16:4319 , piece_id=3WCDGSJXOBMO25TF2H7CMLJNCWEKKQHIIPUIU4TTLULWSUXVN7IQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.114443646 (9h12m21.545523778s) [noise=true , address=104.36.82.45:4918 , piece_id=D3E7Z4DWP27P6J654KARTJN35AGA4IPXTCWQEFHNG7DDJDQV2BNA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.115300766 (9h12m21.546380897s) [noise=true , address=79.127.201.215:4346 , piece_id=IIZHJJJV6ULFED4PLYRR2LHOE2USGO7TXHCZ34FG6UZIXACTZMXQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.115351023 (9h12m21.546431144s) [noise=true , address=79.127.201.215:4354 , piece_id=3HP3RSXYDGU5LJ5QA3NTSSA7IPYVT64DJV2DZWUJ2BX6WJDY7K3Q, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.115581403 (9h12m21.546661534s) [noise=true , address=104.36.82.52:4113 , piece_id=UXLP55AL3IBQJGTSCVGV45JWKB3CBC6KEP6APZHYYDZ4VA72BWQQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.116249511 (9h12m21.547329642s) [noise=true , address=104.36.82.15:4262 , piece_id=EX5LMAM3C2NFNYLXUFXZLEXAGDDGB2EO252HEUBUXQY2QWLAROOA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.117038491 (9h12m21.548118622s) [noise=true , address=104.36.82.36:4648 , piece_id=TDQ5RSPXGUVHCERTTTEHVXH6LJSFD7ARB6PVZLZCHGGW4OREEZ5Q, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.117530051 (9h12m21.548610183s) [noise=true , address=104.36.82.62:4421 , piece_id=LBZ2DNOECOVQP4EHNP4KUKRMLWB6SGY7RSNX3D2DZEN5G2DXZVNA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.117789077 (9h12m21.548869208s) [noise=true , address=64.49.13.155:4914 , piece_id=UO4VAS4AFSSOSRZHKCKZQ3SCB32ILZZRNWB5XPSLLPL6AXX5KP6A, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.118536547 (9h12m21.549616688s) [noise=true , address=104.36.82.59:4323 , piece_id=LQ3LNXUVPJU75X7FKNTK7LS6BJ55COCZO3M5HSGMNMHOLGMGDFHA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.119075438 (9h12m21.550155569s) [noise=true , address=104.36.82.5:4848 , piece_id=XOAZFGR3OIAO5HD6NO3H64DEP77P7QTQOFNSMU3UZZALN3CJ2KIA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.119528244 (9h12m21.550608375s) [noise=true , address=104.36.82.22:4521 , piece_id=PSVFD6W7SXTRXRQDRBJKBU6QAOQRWW3QEY2AQNBGWOSAL77ZO4OQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.120561171 (9h12m21.551641302s) [noise=true , address=104.36.82.34:4575 , piece_id=EFH2ME5XUNNEKOFQGNR4F437DRKLG7S7R63BY3EBTP2VN3UBRFKQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.121021792 (9h12m21.552101923s) [noise=true , address=104.36.82.46:4506 , piece_id=KFJQP6XAHR6A776DSUSFLSJYACLZEGC3JSO2ZZZG6H2VZXAGWCLQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.121535965 (9h12m21.552616096s) [noise=true , address=104.36.82.44:4897 , piece_id=GH57JACKAAEI3I47QGOXANT4YWHXTNLQDWJOZSVQTTOCM2W3ZNDA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.124820019 (9h12m21.55590015s) [noise=true , address=104.36.82.62:4420 , piece_id=DAI5U6V5KXGMF5DAZSANIAXGR25C2I46DSDUVEWNODCCMI6TTLQQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:28.299580377 (9h12m22.730660508s) [upload=9614]: Next returned nil segment
Aug 9 02:38:28.299620192 (9h12m22.730700334s) [upload=9614]: Waiting for error group managing segments...
Aug 9 02:38:28.597172920 (9h12m23.028253051s) [noise=true , address=64.49.13.155:4914 , piece_id=UO4VAS4AFSSOSRZHKCKZQ3SCB32ILZZRNWB5XPSLLPL6AXX5KP6A, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.012112184 (9h12m23.443192315s) [noise=true , address=104.36.82.3:4786 , piece_id=WJXQBELLMJYXHZAJ7TWOATFOZ2V46Y3WRGUP26XGUJVMS3NCSBIQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.023650971 (9h12m23.454731102s) [noise=true , address=104.36.82.34:4575 , piece_id=EFH2ME5XUNNEKOFQGNR4F437DRKLG7S7R63BY3EBTP2VN3UBRFKQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.038394009 (9h12m23.46947414s) [noise=true , address=104.36.82.46:4506 , piece_id=KFJQP6XAHR6A776DSUSFLSJYACLZEGC3JSO2ZZZG6H2VZXAGWCLQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.040117125 (9h12m23.471197256s) [noise=true , address=79.127.201.215:4354 , piece_id=3HP3RSXYDGU5LJ5QA3NTSSA7IPYVT64DJV2DZWUJ2BX6WJDY7K3Q, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.040374468 (9h12m23.471454599s) [noise=true , address=104.36.82.62:4421 , piece_id=LBZ2DNOECOVQP4EHNP4KUKRMLWB6SGY7RSNX3D2DZEN5G2DXZVNA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.045702944 (9h12m23.476783075s) [noise=true , address=79.127.201.215:4346 , piece_id=IIZHJJJV6ULFED4PLYRR2LHOE2USGO7TXHCZ34FG6UZIXACTZMXQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.051024234 (9h12m23.482104355s) [noise=true , address=77.90.31.15:4713 , piece_id=FFM2A46FP7KIT6NP5JACEROUHRM2TLMSIACREQZRQPYXMD4I7JLA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.070546296 (9h12m23.501626427s) [noise=true , address=104.36.82.62:4420 , piece_id=DAI5U6V5KXGMF5DAZSANIAXGR25C2I46DSDUVEWNODCCMI6TTLQQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.101569643 (9h12m23.532649794s) [noise=true , address=104.36.82.45:4918 , piece_id=D3E7Z4DWP27P6J654KARTJN35AGA4IPXTCWQEFHNG7DDJDQV2BNA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.113588949 (9h12m23.54466908s) [noise=true , address=104.36.82.16:4319 , piece_id=3WCDGSJXOBMO25TF2H7CMLJNCWEKKQHIIPUIU4TTLULWSUXVN7IQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.126651892 (9h12m23.557732023s) [noise=true , address=104.36.82.5:4848 , piece_id=XOAZFGR3OIAO5HD6NO3H64DEP77P7QTQOFNSMU3UZZALN3CJ2KIA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.177243659 (9h12m23.608323791s) [noise=true , address=104.36.82.36:4648 , piece_id=TDQ5RSPXGUVHCERTTTEHVXH6LJSFD7ARB6PVZLZCHGGW4OREEZ5Q, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.179742340 (9h12m23.610822471s) [noise=true , address=104.36.82.22:4521 , piece_id=PSVFD6W7SXTRXRQDRBJKBU6QAOQRWW3QEY2AQNBGWOSAL77ZO4OQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.179756607 (9h12m23.610836738s) [seg_pos={0 0}, upload=9614]: Segment reached optimal threshold of 14 pieces.
Aug 9 02:38:29.179895643 (9h12m23.610975764s) [noise=true , address=104.36.82.59:4323 , piece_id=LQ3LNXUVPJU75X7FKNTK7LS6BJ55COCZO3M5HSGMNMHOLGMGDFHA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLr6Ha1ysWYbUJ8He7RofMFCz8qVuJMBFkfJgnTUVw1kmXckz): protocol: expected piece hash; context canceled; EOF
Aug 9 02:38:29.180007006 (9h12m23.611087137s) [noise=true , address=104.36.82.15:4262 , piece_id=EX5LMAM3C2NFNYLXUFXZLEXAGDDGB2EO252HEUBUXQY2QWLAROOA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Aug 9 02:38:29.180020482 (9h12m23.611100613s) [noise=true , address=104.36.82.52:4113 , piece_id=UXLP55AL3IBQJGTSCVGV45JWKB3CBC6KEP6APZHYYDZ4VA72BWQQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1brZ4RtcK5J3xCPmnbsTccF9hrnj8tqhV1WyMqqrjuitgSGMou): protocol: expected piece hash; context canceled; EOF
Aug 9 02:38:29.180064297 (9h12m23.611144428s) [noise=true , address=104.36.82.44:4897 , piece_id=GH57JACKAAEI3I47QGOXANT4YWHXTNLQDWJOZSVQTTOCM2W3ZNDA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 9 02:38:29.180083663 (9h12m23.611163794s) [seg_pos={0 0}, upload=9614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 02:38:29.180316970 (9h12m23.611397101s) [upload=9614]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 02:38:29.180321368 (9h12m23.611401499s) [upload=9614]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 02:38:29.479901204 (9h12m23.910981335s) [upload=9614]: Done uploading segments...
Aug 9 02:38:29.479933285 (9h12m23.911013406s) [upload=9614]: Upload finished. err: <nil>
Duration: 6.350627423s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..X...X.X................................X...............X.X] duration:
1.887733236s
FAIL (2025-08-09 02:56:51 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 02:56:50.135818216 (9h30m44.566898348s) [upload=9930]: Starting upload
Aug 9 02:56:50.135858193 (9h30m44.566938314s) [upload=9930]: Done starting upload
Aug 9 02:56:50.135911825 (9h30m44.566991946s) [upload=9930]: Uploading segments...
Aug 9 02:56:50.135947934 (9h30m44.567028065s) [upload=9930]: Got next segment. Inline: true
Aug 9 02:56:50.135952033 (9h30m44.567032164s) [upload=9930]: Waiting for error group managing segments...
Aug 9 02:56:50.135988081 (9h30m44.567068212s) [upload=9930]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 02:56:50.135992109 (9h30m44.56707223s) [upload=9930]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 02:56:50.135994694 (9h30m44.567074825s) [upload=9930]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 02:56:50.648762896 (9h30m45.079843037s) [upload=9930]: Done uploading segments...
Aug 9 02:56:50.648782353 (9h30m45.079862484s) [upload=9930]: Upload finished. err: <nil>
Duration: 1.887760176s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...X...X.X................................X...............X.] duration:
2.242045875s
FAIL (2025-08-09 02:55:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 02:55:16.747163743 (9h29m11.178243864s) [upload=9901]: Starting upload
Aug 9 02:55:16.747207848 (9h29m11.178287979s) [upload=9901]: Done starting upload
Aug 9 02:55:16.747265779 (9h29m11.17834591s) [upload=9901]: Uploading segments...
Aug 9 02:55:16.747315294 (9h29m11.178395415s) [upload=9901]: Got next segment. Inline: true
Aug 9 02:55:16.747318931 (9h29m11.178399062s) [upload=9901]: Waiting for error group managing segments...
Aug 9 02:55:16.747352505 (9h29m11.178432636s) [upload=9901]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 02:55:16.747359908 (9h29m11.17844004s) [upload=9901]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 02:55:16.747362814 (9h29m11.178442945s) [upload=9901]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 02:55:17.010590269 (9h29m11.4416704s) [upload=9901]: Done uploading segments...
Aug 9 02:55:17.010602041 (9h29m11.441682172s) [upload=9901]: Upload finished. err: <nil>
Duration: 2.242069219s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........X.............X............X..X.....................] duration:
5.653029472s
FAIL (2025-08-09 02:55:47 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 340c5199709d92db83cf73e25d6a6e8e9ef970b481e48af1b5c39871da1f25ea != before 72e144052a47b7d39b54867e4eb322afd23c418b3edd62d510e4eecd0b26d000
======LOGS======
Aug 9 02:38:26.662158849 (9h12m21.09323898s) [upload=9614]: Starting upload
Aug 9 02:38:26.662208755 (9h12m21.093288886s) [upload=9614]: Done starting upload
Aug 9 02:38:26.662288137 (9h12m21.093368268s) [upload=9614]: Uploading segments...
Aug 9 02:38:26.662380583 (9h12m21.093460744s) [upload=9614]: Got next segment. Inline: false
Aug 9 02:38:26.662428375 (9h12m21.093508506s) [upload=9614]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 02:38:26.662435809 (9h12m21.09351594s) [upload=9614]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 02:38:27.113929392 (9h12m21.545009523s) [seg_pos={0 0}, upload=9614]: Begin upload segment...
Aug 9 02:38:27.113976062 (9h12m21.545056203s) [seg_pos={0 0}, upload=9614]: Done begin upload segment.
Aug 9 02:38:27.114013573 (9h12m21.545093704s) [noise=true , address=104.36.82.3:4786 , piece_id=WJXQBELLMJYXHZAJ7TWOATFOZ2V46Y3WRGUP26XGUJVMS3NCSBIQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.114022961 (9h12m21.545103092s) [noise=true , address=77.90.31.15:4713 , piece_id=FFM2A46FP7KIT6NP5JACEROUHRM2TLMSIACREQZRQPYXMD4I7JLA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.114421965 (9h12m21.545502086s) [noise=true , address=104.36.82.16:4319 , piece_id=3WCDGSJXOBMO25TF2H7CMLJNCWEKKQHIIPUIU4TTLULWSUXVN7IQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.114443646 (9h12m21.545523778s) [noise=true , address=104.36.82.45:4918 , piece_id=D3E7Z4DWP27P6J654KARTJN35AGA4IPXTCWQEFHNG7DDJDQV2BNA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.115300766 (9h12m21.546380897s) [noise=true , address=79.127.201.215:4346 , piece_id=IIZHJJJV6ULFED4PLYRR2LHOE2USGO7TXHCZ34FG6UZIXACTZMXQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.115351023 (9h12m21.546431144s) [noise=true , address=79.127.201.215:4354 , piece_id=3HP3RSXYDGU5LJ5QA3NTSSA7IPYVT64DJV2DZWUJ2BX6WJDY7K3Q, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.115581403 (9h12m21.546661534s) [noise=true , address=104.36.82.52:4113 , piece_id=UXLP55AL3IBQJGTSCVGV45JWKB3CBC6KEP6APZHYYDZ4VA72BWQQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.116249511 (9h12m21.547329642s) [noise=true , address=104.36.82.15:4262 , piece_id=EX5LMAM3C2NFNYLXUFXZLEXAGDDGB2EO252HEUBUXQY2QWLAROOA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.117038491 (9h12m21.548118622s) [noise=true , address=104.36.82.36:4648 , piece_id=TDQ5RSPXGUVHCERTTTEHVXH6LJSFD7ARB6PVZLZCHGGW4OREEZ5Q, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.117530051 (9h12m21.548610183s) [noise=true , address=104.36.82.62:4421 , piece_id=LBZ2DNOECOVQP4EHNP4KUKRMLWB6SGY7RSNX3D2DZEN5G2DXZVNA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.117789077 (9h12m21.548869208s) [noise=true , address=64.49.13.155:4914 , piece_id=UO4VAS4AFSSOSRZHKCKZQ3SCB32ILZZRNWB5XPSLLPL6AXX5KP6A, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.118536547 (9h12m21.549616688s) [noise=true , address=104.36.82.59:4323 , piece_id=LQ3LNXUVPJU75X7FKNTK7LS6BJ55COCZO3M5HSGMNMHOLGMGDFHA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.119075438 (9h12m21.550155569s) [noise=true , address=104.36.82.5:4848 , piece_id=XOAZFGR3OIAO5HD6NO3H64DEP77P7QTQOFNSMU3UZZALN3CJ2KIA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.119528244 (9h12m21.550608375s) [noise=true , address=104.36.82.22:4521 , piece_id=PSVFD6W7SXTRXRQDRBJKBU6QAOQRWW3QEY2AQNBGWOSAL77ZO4OQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.120561171 (9h12m21.551641302s) [noise=true , address=104.36.82.34:4575 , piece_id=EFH2ME5XUNNEKOFQGNR4F437DRKLG7S7R63BY3EBTP2VN3UBRFKQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.121021792 (9h12m21.552101923s) [noise=true , address=104.36.82.46:4506 , piece_id=KFJQP6XAHR6A776DSUSFLSJYACLZEGC3JSO2ZZZG6H2VZXAGWCLQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.121535965 (9h12m21.552616096s) [noise=true , address=104.36.82.44:4897 , piece_id=GH57JACKAAEI3I47QGOXANT4YWHXTNLQDWJOZSVQTTOCM2W3ZNDA, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:27.124820019 (9h12m21.55590015s) [noise=true , address=104.36.82.62:4420 , piece_id=DAI5U6V5KXGMF5DAZSANIAXGR25C2I46DSDUVEWNODCCMI6TTLQQ, seg_pos={0 0}, upload=9614]: Uploading piece...
Aug 9 02:38:28.299580377 (9h12m22.730660508s) [upload=9614]: Next returned nil segment
Aug 9 02:38:28.299620192 (9h12m22.730700334s) [upload=9614]: Waiting for error group managing segments...
Aug 9 02:38:28.597172920 (9h12m23.028253051s) [noise=true , address=64.49.13.155:4914 , piece_id=UO4VAS4AFSSOSRZHKCKZQ3SCB32ILZZRNWB5XPSLLPL6AXX5KP6A, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.012112184 (9h12m23.443192315s) [noise=true , address=104.36.82.3:4786 , piece_id=WJXQBELLMJYXHZAJ7TWOATFOZ2V46Y3WRGUP26XGUJVMS3NCSBIQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.023650971 (9h12m23.454731102s) [noise=true , address=104.36.82.34:4575 , piece_id=EFH2ME5XUNNEKOFQGNR4F437DRKLG7S7R63BY3EBTP2VN3UBRFKQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.038394009 (9h12m23.46947414s) [noise=true , address=104.36.82.46:4506 , piece_id=KFJQP6XAHR6A776DSUSFLSJYACLZEGC3JSO2ZZZG6H2VZXAGWCLQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.040117125 (9h12m23.471197256s) [noise=true , address=79.127.201.215:4354 , piece_id=3HP3RSXYDGU5LJ5QA3NTSSA7IPYVT64DJV2DZWUJ2BX6WJDY7K3Q, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.040374468 (9h12m23.471454599s) [noise=true , address=104.36.82.62:4421 , piece_id=LBZ2DNOECOVQP4EHNP4KUKRMLWB6SGY7RSNX3D2DZEN5G2DXZVNA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.045702944 (9h12m23.476783075s) [noise=true , address=79.127.201.215:4346 , piece_id=IIZHJJJV6ULFED4PLYRR2LHOE2USGO7TXHCZ34FG6UZIXACTZMXQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.051024234 (9h12m23.482104355s) [noise=true , address=77.90.31.15:4713 , piece_id=FFM2A46FP7KIT6NP5JACEROUHRM2TLMSIACREQZRQPYXMD4I7JLA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.070546296 (9h12m23.501626427s) [noise=true , address=104.36.82.62:4420 , piece_id=DAI5U6V5KXGMF5DAZSANIAXGR25C2I46DSDUVEWNODCCMI6TTLQQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.101569643 (9h12m23.532649794s) [noise=true , address=104.36.82.45:4918 , piece_id=D3E7Z4DWP27P6J654KARTJN35AGA4IPXTCWQEFHNG7DDJDQV2BNA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.113588949 (9h12m23.54466908s) [noise=true , address=104.36.82.16:4319 , piece_id=3WCDGSJXOBMO25TF2H7CMLJNCWEKKQHIIPUIU4TTLULWSUXVN7IQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.126651892 (9h12m23.557732023s) [noise=true , address=104.36.82.5:4848 , piece_id=XOAZFGR3OIAO5HD6NO3H64DEP77P7QTQOFNSMU3UZZALN3CJ2KIA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.177243659 (9h12m23.608323791s) [noise=true , address=104.36.82.36:4648 , piece_id=TDQ5RSPXGUVHCERTTTEHVXH6LJSFD7ARB6PVZLZCHGGW4OREEZ5Q, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.179742340 (9h12m23.610822471s) [noise=true , address=104.36.82.22:4521 , piece_id=PSVFD6W7SXTRXRQDRBJKBU6QAOQRWW3QEY2AQNBGWOSAL77ZO4OQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: <nil>
Aug 9 02:38:29.179756607 (9h12m23.610836738s) [seg_pos={0 0}, upload=9614]: Segment reached optimal threshold of 14 pieces.
Aug 9 02:38:29.179895643 (9h12m23.610975764s) [noise=true , address=104.36.82.59:4323 , piece_id=LQ3LNXUVPJU75X7FKNTK7LS6BJ55COCZO3M5HSGMNMHOLGMGDFHA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLr6Ha1ysWYbUJ8He7RofMFCz8qVuJMBFkfJgnTUVw1kmXckz): protocol: expected piece hash; context canceled; EOF
Aug 9 02:38:29.180007006 (9h12m23.611087137s) [noise=true , address=104.36.82.15:4262 , piece_id=EX5LMAM3C2NFNYLXUFXZLEXAGDDGB2EO252HEUBUXQY2QWLAROOA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Aug 9 02:38:29.180020482 (9h12m23.611100613s) [noise=true , address=104.36.82.52:4113 , piece_id=UXLP55AL3IBQJGTSCVGV45JWKB3CBC6KEP6APZHYYDZ4VA72BWQQ, seg_pos={0 0}, upload=9614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1brZ4RtcK5J3xCPmnbsTccF9hrnj8tqhV1WyMqqrjuitgSGMou): protocol: expected piece hash; context canceled; EOF
Aug 9 02:38:29.180064297 (9h12m23.611144428s) [noise=true , address=104.36.82.44:4897 , piece_id=GH57JACKAAEI3I47QGOXANT4YWHXTNLQDWJOZSVQTTOCM2W3ZNDA, seg_pos={0 0}, upload=9614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 9 02:38:29.180083663 (9h12m23.611163794s) [seg_pos={0 0}, upload=9614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 02:38:29.180316970 (9h12m23.611397101s) [upload=9614]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 02:38:29.180321368 (9h12m23.611401499s) [upload=9614]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 02:38:29.479901204 (9h12m23.910981335s) [upload=9614]: Done uploading segments...
Aug 9 02:38:29.479933285 (9h12m23.911013406s) [upload=9614]: Upload finished. err: <nil>
Duration: 5.653053999s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|