Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................X.............X..........................] duration: 1.999346606s FAIL (2025-08-12 02:23:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.999374569s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X.........................X...X.........................] duration: 5.932536576s FAIL (2025-08-12 02:22:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5bcb3223aad6175f3a85e4ed3576bc584685c3a15171450a8990330a0bf9360f != before a1cb09d0d640b652333a601939d11f28bca1cde12315edd614af1e5f81c54e86 ======LOGS====== Aug 12 02:01:04.299553302 (80h34m58.730633433s) [upload=83945]: Starting upload Aug 12 02:01:04.299598488 (80h34m58.730678619s) [upload=83945]: Done starting upload Aug 12 02:01:04.299674804 (80h34m58.730754946s) [upload=83945]: Uploading segments... Aug 12 02:01:04.299804032 (80h34m58.730884163s) [upload=83945]: Got next segment. Inline: false Aug 12 02:01:04.299848266 (80h34m58.730928397s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:01:04.299854278 (80h34m58.730934409s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 02:01:04.794172039 (80h34m59.22525218s) [seg_pos={0 0}, upload=83945]: Begin upload segment... Aug 12 02:01:04.794265368 (80h34m59.225345499s) [seg_pos={0 0}, upload=83945]: Done begin upload segment. Aug 12 02:01:04.794290176 (80h34m59.225370297s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794304182 (80h34m59.225384313s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794371712 (80h34m59.225451843s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794726560 (80h34m59.225806691s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794748151 (80h34m59.225828282s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795024830 (80h34m59.226104962s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795047003 (80h34m59.226127134s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795438221 (80h34m59.226518352s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795820513 (80h34m59.226900644s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796224436 (80h34m59.227304567s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796822540 (80h34m59.227902661s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797151790 (80h34m59.228231931s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797605458 (80h34m59.228685589s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797939467 (80h34m59.229019608s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798219923 (80h34m59.229300055s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798485312 (80h34m59.229565443s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798763975 (80h34m59.229844106s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.799031106 (80h34m59.230111237s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:05.911038958 (80h35m0.342119089s) [upload=83945]: Next returned nil segment Aug 12 02:01:05.911053635 (80h35m0.342133766s) [upload=83945]: Waiting for error group managing segments... Aug 12 02:01:06.206068616 (80h35m0.637148747s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.267867411 (80h35m0.698947542s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.270789562 (80h35m0.701869683s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.769025920 (80h35m1.200106061s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.794220142 (80h35m1.225300273s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.817560629 (80h35m1.24864076s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.839147038 (80h35m1.270227159s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.842382028 (80h35m1.273462159s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.850956162 (80h35m1.282036293s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.855083227 (80h35m1.286163368s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.857374992 (80h35m1.288455123s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.868715869 (80h35m1.299796s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.878390188 (80h35m1.30947031s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881429374 (80h35m1.312509495s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881443029 (80h35m1.31252316s) [seg_pos={0 0}, upload=83945]: Segment reached optimal threshold of 14 pieces. Aug 12 02:01:06.881536228 (80h35m1.312616359s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881586864 (80h35m1.312666985s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881633263 (80h35m1.312713395s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wNKharWFFSSsLMd1vZYi6zYEYBe3VT6Z3ikrY7Cjo3xPLUK62): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881687307 (80h35m1.312767438s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection Aug 12 02:01:06.881700463 (80h35m1.312780584s) [seg_pos={0 0}, upload=83945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 02:01:06.881760668 (80h35m1.312840799s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 02:01:06.881764525 (80h35m1.312844656s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:01:07.283069742 (80h35m1.714149883s) [upload=83945]: Done uploading segments... Aug 12 02:01:07.283086976 (80h35m1.714167107s) [upload=83945]: Upload finished. err: <nil> Duration: 5.932554401s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................X.............X.........................] duration: 2.672423808s FAIL (2025-08-12 02:22:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.672449207s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................X.............X........................] duration: 2.078229789s FAIL (2025-08-12 02:22:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.078256229s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X.........................X...X........................] duration: 5.706729976s FAIL (2025-08-12 02:21:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5bcb3223aad6175f3a85e4ed3576bc584685c3a15171450a8990330a0bf9360f != before a1cb09d0d640b652333a601939d11f28bca1cde12315edd614af1e5f81c54e86 ======LOGS====== Aug 12 02:01:04.299553302 (80h34m58.730633433s) [upload=83945]: Starting upload Aug 12 02:01:04.299598488 (80h34m58.730678619s) [upload=83945]: Done starting upload Aug 12 02:01:04.299674804 (80h34m58.730754946s) [upload=83945]: Uploading segments... Aug 12 02:01:04.299804032 (80h34m58.730884163s) [upload=83945]: Got next segment. Inline: false Aug 12 02:01:04.299848266 (80h34m58.730928397s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:01:04.299854278 (80h34m58.730934409s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 02:01:04.794172039 (80h34m59.22525218s) [seg_pos={0 0}, upload=83945]: Begin upload segment... Aug 12 02:01:04.794265368 (80h34m59.225345499s) [seg_pos={0 0}, upload=83945]: Done begin upload segment. Aug 12 02:01:04.794290176 (80h34m59.225370297s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794304182 (80h34m59.225384313s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794371712 (80h34m59.225451843s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794726560 (80h34m59.225806691s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794748151 (80h34m59.225828282s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795024830 (80h34m59.226104962s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795047003 (80h34m59.226127134s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795438221 (80h34m59.226518352s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795820513 (80h34m59.226900644s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796224436 (80h34m59.227304567s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796822540 (80h34m59.227902661s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797151790 (80h34m59.228231931s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797605458 (80h34m59.228685589s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797939467 (80h34m59.229019608s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798219923 (80h34m59.229300055s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798485312 (80h34m59.229565443s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798763975 (80h34m59.229844106s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.799031106 (80h34m59.230111237s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:05.911038958 (80h35m0.342119089s) [upload=83945]: Next returned nil segment Aug 12 02:01:05.911053635 (80h35m0.342133766s) [upload=83945]: Waiting for error group managing segments... Aug 12 02:01:06.206068616 (80h35m0.637148747s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.267867411 (80h35m0.698947542s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.270789562 (80h35m0.701869683s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.769025920 (80h35m1.200106061s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.794220142 (80h35m1.225300273s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.817560629 (80h35m1.24864076s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.839147038 (80h35m1.270227159s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.842382028 (80h35m1.273462159s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.850956162 (80h35m1.282036293s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.855083227 (80h35m1.286163368s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.857374992 (80h35m1.288455123s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.868715869 (80h35m1.299796s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.878390188 (80h35m1.30947031s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881429374 (80h35m1.312509495s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881443029 (80h35m1.31252316s) [seg_pos={0 0}, upload=83945]: Segment reached optimal threshold of 14 pieces. Aug 12 02:01:06.881536228 (80h35m1.312616359s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881586864 (80h35m1.312666985s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881633263 (80h35m1.312713395s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wNKharWFFSSsLMd1vZYi6zYEYBe3VT6Z3ikrY7Cjo3xPLUK62): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881687307 (80h35m1.312767438s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection Aug 12 02:01:06.881700463 (80h35m1.312780584s) [seg_pos={0 0}, upload=83945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 02:01:06.881760668 (80h35m1.312840799s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 02:01:06.881764525 (80h35m1.312844656s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:01:07.283069742 (80h35m1.714149883s) [upload=83945]: Done uploading segments... Aug 12 02:01:07.283086976 (80h35m1.714167107s) [upload=83945]: Upload finished. err: <nil> Duration: 5.706753892s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................X.............X.......................] duration: 1.871469017s FAIL (2025-08-12 02:21:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.871490579s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X.........................X...X.......................] duration: 5.868392734s FAIL (2025-08-12 02:21:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5bcb3223aad6175f3a85e4ed3576bc584685c3a15171450a8990330a0bf9360f != before a1cb09d0d640b652333a601939d11f28bca1cde12315edd614af1e5f81c54e86 ======LOGS====== Aug 12 02:01:04.299553302 (80h34m58.730633433s) [upload=83945]: Starting upload Aug 12 02:01:04.299598488 (80h34m58.730678619s) [upload=83945]: Done starting upload Aug 12 02:01:04.299674804 (80h34m58.730754946s) [upload=83945]: Uploading segments... Aug 12 02:01:04.299804032 (80h34m58.730884163s) [upload=83945]: Got next segment. Inline: false Aug 12 02:01:04.299848266 (80h34m58.730928397s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:01:04.299854278 (80h34m58.730934409s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 02:01:04.794172039 (80h34m59.22525218s) [seg_pos={0 0}, upload=83945]: Begin upload segment... Aug 12 02:01:04.794265368 (80h34m59.225345499s) [seg_pos={0 0}, upload=83945]: Done begin upload segment. Aug 12 02:01:04.794290176 (80h34m59.225370297s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794304182 (80h34m59.225384313s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794371712 (80h34m59.225451843s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794726560 (80h34m59.225806691s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794748151 (80h34m59.225828282s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795024830 (80h34m59.226104962s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795047003 (80h34m59.226127134s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795438221 (80h34m59.226518352s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795820513 (80h34m59.226900644s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796224436 (80h34m59.227304567s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796822540 (80h34m59.227902661s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797151790 (80h34m59.228231931s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797605458 (80h34m59.228685589s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797939467 (80h34m59.229019608s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798219923 (80h34m59.229300055s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798485312 (80h34m59.229565443s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798763975 (80h34m59.229844106s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.799031106 (80h34m59.230111237s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:05.911038958 (80h35m0.342119089s) [upload=83945]: Next returned nil segment Aug 12 02:01:05.911053635 (80h35m0.342133766s) [upload=83945]: Waiting for error group managing segments... Aug 12 02:01:06.206068616 (80h35m0.637148747s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.267867411 (80h35m0.698947542s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.270789562 (80h35m0.701869683s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.769025920 (80h35m1.200106061s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.794220142 (80h35m1.225300273s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.817560629 (80h35m1.24864076s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.839147038 (80h35m1.270227159s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.842382028 (80h35m1.273462159s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.850956162 (80h35m1.282036293s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.855083227 (80h35m1.286163368s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.857374992 (80h35m1.288455123s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.868715869 (80h35m1.299796s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.878390188 (80h35m1.30947031s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881429374 (80h35m1.312509495s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881443029 (80h35m1.31252316s) [seg_pos={0 0}, upload=83945]: Segment reached optimal threshold of 14 pieces. Aug 12 02:01:06.881536228 (80h35m1.312616359s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881586864 (80h35m1.312666985s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881633263 (80h35m1.312713395s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wNKharWFFSSsLMd1vZYi6zYEYBe3VT6Z3ikrY7Cjo3xPLUK62): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881687307 (80h35m1.312767438s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection Aug 12 02:01:06.881700463 (80h35m1.312780584s) [seg_pos={0 0}, upload=83945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 02:01:06.881760668 (80h35m1.312840799s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 02:01:06.881764525 (80h35m1.312844656s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:01:07.283069742 (80h35m1.714149883s) [upload=83945]: Done uploading segments... Aug 12 02:01:07.283086976 (80h35m1.714167107s) [upload=83945]: Upload finished. err: <nil> Duration: 5.868421048s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................X.............X......................] duration: 1.87336622s FAIL (2025-08-12 02:20:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.873395726s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................X.............X.....................] duration: 1.91372838s FAIL (2025-08-12 02:20:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.913754059s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X.........................X...X......................] duration: 5.683340289s FAIL (2025-08-12 02:20:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5bcb3223aad6175f3a85e4ed3576bc584685c3a15171450a8990330a0bf9360f != before a1cb09d0d640b652333a601939d11f28bca1cde12315edd614af1e5f81c54e86 ======LOGS====== Aug 12 02:01:04.299553302 (80h34m58.730633433s) [upload=83945]: Starting upload Aug 12 02:01:04.299598488 (80h34m58.730678619s) [upload=83945]: Done starting upload Aug 12 02:01:04.299674804 (80h34m58.730754946s) [upload=83945]: Uploading segments... Aug 12 02:01:04.299804032 (80h34m58.730884163s) [upload=83945]: Got next segment. Inline: false Aug 12 02:01:04.299848266 (80h34m58.730928397s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:01:04.299854278 (80h34m58.730934409s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 02:01:04.794172039 (80h34m59.22525218s) [seg_pos={0 0}, upload=83945]: Begin upload segment... Aug 12 02:01:04.794265368 (80h34m59.225345499s) [seg_pos={0 0}, upload=83945]: Done begin upload segment. Aug 12 02:01:04.794290176 (80h34m59.225370297s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794304182 (80h34m59.225384313s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794371712 (80h34m59.225451843s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794726560 (80h34m59.225806691s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794748151 (80h34m59.225828282s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795024830 (80h34m59.226104962s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795047003 (80h34m59.226127134s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795438221 (80h34m59.226518352s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795820513 (80h34m59.226900644s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796224436 (80h34m59.227304567s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796822540 (80h34m59.227902661s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797151790 (80h34m59.228231931s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797605458 (80h34m59.228685589s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797939467 (80h34m59.229019608s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798219923 (80h34m59.229300055s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798485312 (80h34m59.229565443s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798763975 (80h34m59.229844106s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.799031106 (80h34m59.230111237s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:05.911038958 (80h35m0.342119089s) [upload=83945]: Next returned nil segment Aug 12 02:01:05.911053635 (80h35m0.342133766s) [upload=83945]: Waiting for error group managing segments... Aug 12 02:01:06.206068616 (80h35m0.637148747s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.267867411 (80h35m0.698947542s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.270789562 (80h35m0.701869683s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.769025920 (80h35m1.200106061s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.794220142 (80h35m1.225300273s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.817560629 (80h35m1.24864076s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.839147038 (80h35m1.270227159s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.842382028 (80h35m1.273462159s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.850956162 (80h35m1.282036293s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.855083227 (80h35m1.286163368s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.857374992 (80h35m1.288455123s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.868715869 (80h35m1.299796s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.878390188 (80h35m1.30947031s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881429374 (80h35m1.312509495s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881443029 (80h35m1.31252316s) [seg_pos={0 0}, upload=83945]: Segment reached optimal threshold of 14 pieces. Aug 12 02:01:06.881536228 (80h35m1.312616359s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881586864 (80h35m1.312666985s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881633263 (80h35m1.312713395s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wNKharWFFSSsLMd1vZYi6zYEYBe3VT6Z3ikrY7Cjo3xPLUK62): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881687307 (80h35m1.312767438s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection Aug 12 02:01:06.881700463 (80h35m1.312780584s) [seg_pos={0 0}, upload=83945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 02:01:06.881760668 (80h35m1.312840799s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 02:01:06.881764525 (80h35m1.312844656s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:01:07.283069742 (80h35m1.714149883s) [upload=83945]: Done uploading segments... Aug 12 02:01:07.283086976 (80h35m1.714167107s) [upload=83945]: Upload finished. err: <nil> Duration: 5.683370709s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X.........................X...X.....................] duration: 5.740974688s FAIL (2025-08-12 02:19:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5bcb3223aad6175f3a85e4ed3576bc584685c3a15171450a8990330a0bf9360f != before a1cb09d0d640b652333a601939d11f28bca1cde12315edd614af1e5f81c54e86 ======LOGS====== Aug 12 02:01:04.299553302 (80h34m58.730633433s) [upload=83945]: Starting upload Aug 12 02:01:04.299598488 (80h34m58.730678619s) [upload=83945]: Done starting upload Aug 12 02:01:04.299674804 (80h34m58.730754946s) [upload=83945]: Uploading segments... Aug 12 02:01:04.299804032 (80h34m58.730884163s) [upload=83945]: Got next segment. Inline: false Aug 12 02:01:04.299848266 (80h34m58.730928397s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:01:04.299854278 (80h34m58.730934409s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 02:01:04.794172039 (80h34m59.22525218s) [seg_pos={0 0}, upload=83945]: Begin upload segment... Aug 12 02:01:04.794265368 (80h34m59.225345499s) [seg_pos={0 0}, upload=83945]: Done begin upload segment. Aug 12 02:01:04.794290176 (80h34m59.225370297s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794304182 (80h34m59.225384313s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794371712 (80h34m59.225451843s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794726560 (80h34m59.225806691s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794748151 (80h34m59.225828282s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795024830 (80h34m59.226104962s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795047003 (80h34m59.226127134s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795438221 (80h34m59.226518352s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795820513 (80h34m59.226900644s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796224436 (80h34m59.227304567s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796822540 (80h34m59.227902661s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797151790 (80h34m59.228231931s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797605458 (80h34m59.228685589s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797939467 (80h34m59.229019608s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798219923 (80h34m59.229300055s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798485312 (80h34m59.229565443s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798763975 (80h34m59.229844106s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.799031106 (80h34m59.230111237s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:05.911038958 (80h35m0.342119089s) [upload=83945]: Next returned nil segment Aug 12 02:01:05.911053635 (80h35m0.342133766s) [upload=83945]: Waiting for error group managing segments... Aug 12 02:01:06.206068616 (80h35m0.637148747s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.267867411 (80h35m0.698947542s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.270789562 (80h35m0.701869683s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.769025920 (80h35m1.200106061s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.794220142 (80h35m1.225300273s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.817560629 (80h35m1.24864076s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.839147038 (80h35m1.270227159s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.842382028 (80h35m1.273462159s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.850956162 (80h35m1.282036293s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.855083227 (80h35m1.286163368s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.857374992 (80h35m1.288455123s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.868715869 (80h35m1.299796s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.878390188 (80h35m1.30947031s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881429374 (80h35m1.312509495s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881443029 (80h35m1.31252316s) [seg_pos={0 0}, upload=83945]: Segment reached optimal threshold of 14 pieces. Aug 12 02:01:06.881536228 (80h35m1.312616359s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881586864 (80h35m1.312666985s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881633263 (80h35m1.312713395s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wNKharWFFSSsLMd1vZYi6zYEYBe3VT6Z3ikrY7Cjo3xPLUK62): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881687307 (80h35m1.312767438s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection Aug 12 02:01:06.881700463 (80h35m1.312780584s) [seg_pos={0 0}, upload=83945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 02:01:06.881760668 (80h35m1.312840799s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 02:01:06.881764525 (80h35m1.312844656s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:01:07.283069742 (80h35m1.714149883s) [upload=83945]: Done uploading segments... Aug 12 02:01:07.283086976 (80h35m1.714167107s) [upload=83945]: Upload finished. err: <nil> Duration: 5.740997993s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................X.............X....................] duration: 1.852323865s FAIL (2025-08-12 02:19:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.852347811s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [X........X.........................X...X....................] duration: 5.879624796s FAIL (2025-08-12 02:18:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5bcb3223aad6175f3a85e4ed3576bc584685c3a15171450a8990330a0bf9360f != before a1cb09d0d640b652333a601939d11f28bca1cde12315edd614af1e5f81c54e86 ======LOGS====== Aug 12 02:01:04.299553302 (80h34m58.730633433s) [upload=83945]: Starting upload Aug 12 02:01:04.299598488 (80h34m58.730678619s) [upload=83945]: Done starting upload Aug 12 02:01:04.299674804 (80h34m58.730754946s) [upload=83945]: Uploading segments... Aug 12 02:01:04.299804032 (80h34m58.730884163s) [upload=83945]: Got next segment. Inline: false Aug 12 02:01:04.299848266 (80h34m58.730928397s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:01:04.299854278 (80h34m58.730934409s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 02:01:04.794172039 (80h34m59.22525218s) [seg_pos={0 0}, upload=83945]: Begin upload segment... Aug 12 02:01:04.794265368 (80h34m59.225345499s) [seg_pos={0 0}, upload=83945]: Done begin upload segment. Aug 12 02:01:04.794290176 (80h34m59.225370297s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794304182 (80h34m59.225384313s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794371712 (80h34m59.225451843s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794726560 (80h34m59.225806691s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794748151 (80h34m59.225828282s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795024830 (80h34m59.226104962s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795047003 (80h34m59.226127134s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795438221 (80h34m59.226518352s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795820513 (80h34m59.226900644s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796224436 (80h34m59.227304567s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796822540 (80h34m59.227902661s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797151790 (80h34m59.228231931s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797605458 (80h34m59.228685589s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797939467 (80h34m59.229019608s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798219923 (80h34m59.229300055s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798485312 (80h34m59.229565443s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798763975 (80h34m59.229844106s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.799031106 (80h34m59.230111237s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:05.911038958 (80h35m0.342119089s) [upload=83945]: Next returned nil segment Aug 12 02:01:05.911053635 (80h35m0.342133766s) [upload=83945]: Waiting for error group managing segments... Aug 12 02:01:06.206068616 (80h35m0.637148747s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.267867411 (80h35m0.698947542s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.270789562 (80h35m0.701869683s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.769025920 (80h35m1.200106061s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.794220142 (80h35m1.225300273s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.817560629 (80h35m1.24864076s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.839147038 (80h35m1.270227159s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.842382028 (80h35m1.273462159s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.850956162 (80h35m1.282036293s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.855083227 (80h35m1.286163368s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.857374992 (80h35m1.288455123s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.868715869 (80h35m1.299796s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.878390188 (80h35m1.30947031s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881429374 (80h35m1.312509495s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881443029 (80h35m1.31252316s) [seg_pos={0 0}, upload=83945]: Segment reached optimal threshold of 14 pieces. Aug 12 02:01:06.881536228 (80h35m1.312616359s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881586864 (80h35m1.312666985s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881633263 (80h35m1.312713395s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wNKharWFFSSsLMd1vZYi6zYEYBe3VT6Z3ikrY7Cjo3xPLUK62): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881687307 (80h35m1.312767438s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection Aug 12 02:01:06.881700463 (80h35m1.312780584s) [seg_pos={0 0}, upload=83945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 02:01:06.881760668 (80h35m1.312840799s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 02:01:06.881764525 (80h35m1.312844656s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:01:07.283069742 (80h35m1.714149883s) [upload=83945]: Done uploading segments... Aug 12 02:01:07.283086976 (80h35m1.714167107s) [upload=83945]: Upload finished. err: <nil> Duration: 5.879680805s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................X.............X...................] duration: 1.97633719s FAIL (2025-08-12 02:18:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.976366887s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X........X.........................X...X...................] duration: 5.679916269s FAIL (2025-08-12 02:18:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5bcb3223aad6175f3a85e4ed3576bc584685c3a15171450a8990330a0bf9360f != before a1cb09d0d640b652333a601939d11f28bca1cde12315edd614af1e5f81c54e86 ======LOGS====== Aug 12 02:01:04.299553302 (80h34m58.730633433s) [upload=83945]: Starting upload Aug 12 02:01:04.299598488 (80h34m58.730678619s) [upload=83945]: Done starting upload Aug 12 02:01:04.299674804 (80h34m58.730754946s) [upload=83945]: Uploading segments... Aug 12 02:01:04.299804032 (80h34m58.730884163s) [upload=83945]: Got next segment. Inline: false Aug 12 02:01:04.299848266 (80h34m58.730928397s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:01:04.299854278 (80h34m58.730934409s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 02:01:04.794172039 (80h34m59.22525218s) [seg_pos={0 0}, upload=83945]: Begin upload segment... Aug 12 02:01:04.794265368 (80h34m59.225345499s) [seg_pos={0 0}, upload=83945]: Done begin upload segment. Aug 12 02:01:04.794290176 (80h34m59.225370297s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794304182 (80h34m59.225384313s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794371712 (80h34m59.225451843s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794726560 (80h34m59.225806691s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794748151 (80h34m59.225828282s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795024830 (80h34m59.226104962s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795047003 (80h34m59.226127134s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795438221 (80h34m59.226518352s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795820513 (80h34m59.226900644s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796224436 (80h34m59.227304567s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796822540 (80h34m59.227902661s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797151790 (80h34m59.228231931s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797605458 (80h34m59.228685589s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797939467 (80h34m59.229019608s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798219923 (80h34m59.229300055s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798485312 (80h34m59.229565443s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798763975 (80h34m59.229844106s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.799031106 (80h34m59.230111237s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:05.911038958 (80h35m0.342119089s) [upload=83945]: Next returned nil segment Aug 12 02:01:05.911053635 (80h35m0.342133766s) [upload=83945]: Waiting for error group managing segments... Aug 12 02:01:06.206068616 (80h35m0.637148747s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.267867411 (80h35m0.698947542s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.270789562 (80h35m0.701869683s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.769025920 (80h35m1.200106061s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.794220142 (80h35m1.225300273s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.817560629 (80h35m1.24864076s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.839147038 (80h35m1.270227159s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.842382028 (80h35m1.273462159s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.850956162 (80h35m1.282036293s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.855083227 (80h35m1.286163368s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.857374992 (80h35m1.288455123s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.868715869 (80h35m1.299796s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.878390188 (80h35m1.30947031s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881429374 (80h35m1.312509495s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881443029 (80h35m1.31252316s) [seg_pos={0 0}, upload=83945]: Segment reached optimal threshold of 14 pieces. Aug 12 02:01:06.881536228 (80h35m1.312616359s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881586864 (80h35m1.312666985s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881633263 (80h35m1.312713395s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wNKharWFFSSsLMd1vZYi6zYEYBe3VT6Z3ikrY7Cjo3xPLUK62): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881687307 (80h35m1.312767438s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection Aug 12 02:01:06.881700463 (80h35m1.312780584s) [seg_pos={0 0}, upload=83945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 02:01:06.881760668 (80h35m1.312840799s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 02:01:06.881764525 (80h35m1.312844656s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:01:07.283069742 (80h35m1.714149883s) [upload=83945]: Done uploading segments... Aug 12 02:01:07.283086976 (80h35m1.714167107s) [upload=83945]: Upload finished. err: <nil> Duration: 5.679942799s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X........X.........................X...X..................] duration: 6.115138182s FAIL (2025-08-12 02:17:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5bcb3223aad6175f3a85e4ed3576bc584685c3a15171450a8990330a0bf9360f != before a1cb09d0d640b652333a601939d11f28bca1cde12315edd614af1e5f81c54e86 ======LOGS====== Aug 12 02:01:04.299553302 (80h34m58.730633433s) [upload=83945]: Starting upload Aug 12 02:01:04.299598488 (80h34m58.730678619s) [upload=83945]: Done starting upload Aug 12 02:01:04.299674804 (80h34m58.730754946s) [upload=83945]: Uploading segments... Aug 12 02:01:04.299804032 (80h34m58.730884163s) [upload=83945]: Got next segment. Inline: false Aug 12 02:01:04.299848266 (80h34m58.730928397s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:01:04.299854278 (80h34m58.730934409s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 02:01:04.794172039 (80h34m59.22525218s) [seg_pos={0 0}, upload=83945]: Begin upload segment... Aug 12 02:01:04.794265368 (80h34m59.225345499s) [seg_pos={0 0}, upload=83945]: Done begin upload segment. Aug 12 02:01:04.794290176 (80h34m59.225370297s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794304182 (80h34m59.225384313s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794371712 (80h34m59.225451843s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794726560 (80h34m59.225806691s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794748151 (80h34m59.225828282s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795024830 (80h34m59.226104962s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795047003 (80h34m59.226127134s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795438221 (80h34m59.226518352s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795820513 (80h34m59.226900644s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796224436 (80h34m59.227304567s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796822540 (80h34m59.227902661s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797151790 (80h34m59.228231931s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797605458 (80h34m59.228685589s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797939467 (80h34m59.229019608s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798219923 (80h34m59.229300055s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798485312 (80h34m59.229565443s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798763975 (80h34m59.229844106s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.799031106 (80h34m59.230111237s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:05.911038958 (80h35m0.342119089s) [upload=83945]: Next returned nil segment Aug 12 02:01:05.911053635 (80h35m0.342133766s) [upload=83945]: Waiting for error group managing segments... Aug 12 02:01:06.206068616 (80h35m0.637148747s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.267867411 (80h35m0.698947542s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.270789562 (80h35m0.701869683s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.769025920 (80h35m1.200106061s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.794220142 (80h35m1.225300273s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.817560629 (80h35m1.24864076s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.839147038 (80h35m1.270227159s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.842382028 (80h35m1.273462159s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.850956162 (80h35m1.282036293s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.855083227 (80h35m1.286163368s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.857374992 (80h35m1.288455123s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.868715869 (80h35m1.299796s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.878390188 (80h35m1.30947031s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881429374 (80h35m1.312509495s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881443029 (80h35m1.31252316s) [seg_pos={0 0}, upload=83945]: Segment reached optimal threshold of 14 pieces. Aug 12 02:01:06.881536228 (80h35m1.312616359s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881586864 (80h35m1.312666985s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881633263 (80h35m1.312713395s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wNKharWFFSSsLMd1vZYi6zYEYBe3VT6Z3ikrY7Cjo3xPLUK62): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881687307 (80h35m1.312767438s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection Aug 12 02:01:06.881700463 (80h35m1.312780584s) [seg_pos={0 0}, upload=83945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 02:01:06.881760668 (80h35m1.312840799s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 02:01:06.881764525 (80h35m1.312844656s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:01:07.283069742 (80h35m1.714149883s) [upload=83945]: Done uploading segments... Aug 12 02:01:07.283086976 (80h35m1.714167107s) [upload=83945]: Upload finished. err: <nil> Duration: 6.11516405s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........................X.............X..................] duration: 1.921070112s FAIL (2025-08-12 02:17:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.921096583s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............................X.............X.................] duration: 2.233727048s FAIL (2025-08-12 02:17:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.233753317s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X........X.........................X...X.................] duration: 6.043585873s FAIL (2025-08-12 02:16:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5bcb3223aad6175f3a85e4ed3576bc584685c3a15171450a8990330a0bf9360f != before a1cb09d0d640b652333a601939d11f28bca1cde12315edd614af1e5f81c54e86 ======LOGS====== Aug 12 02:01:04.299553302 (80h34m58.730633433s) [upload=83945]: Starting upload Aug 12 02:01:04.299598488 (80h34m58.730678619s) [upload=83945]: Done starting upload Aug 12 02:01:04.299674804 (80h34m58.730754946s) [upload=83945]: Uploading segments... Aug 12 02:01:04.299804032 (80h34m58.730884163s) [upload=83945]: Got next segment. Inline: false Aug 12 02:01:04.299848266 (80h34m58.730928397s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:01:04.299854278 (80h34m58.730934409s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 02:01:04.794172039 (80h34m59.22525218s) [seg_pos={0 0}, upload=83945]: Begin upload segment... Aug 12 02:01:04.794265368 (80h34m59.225345499s) [seg_pos={0 0}, upload=83945]: Done begin upload segment. Aug 12 02:01:04.794290176 (80h34m59.225370297s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794304182 (80h34m59.225384313s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794371712 (80h34m59.225451843s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794726560 (80h34m59.225806691s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794748151 (80h34m59.225828282s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795024830 (80h34m59.226104962s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795047003 (80h34m59.226127134s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795438221 (80h34m59.226518352s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795820513 (80h34m59.226900644s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796224436 (80h34m59.227304567s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796822540 (80h34m59.227902661s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797151790 (80h34m59.228231931s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797605458 (80h34m59.228685589s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797939467 (80h34m59.229019608s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798219923 (80h34m59.229300055s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798485312 (80h34m59.229565443s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798763975 (80h34m59.229844106s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.799031106 (80h34m59.230111237s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:05.911038958 (80h35m0.342119089s) [upload=83945]: Next returned nil segment Aug 12 02:01:05.911053635 (80h35m0.342133766s) [upload=83945]: Waiting for error group managing segments... Aug 12 02:01:06.206068616 (80h35m0.637148747s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.267867411 (80h35m0.698947542s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.270789562 (80h35m0.701869683s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.769025920 (80h35m1.200106061s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.794220142 (80h35m1.225300273s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.817560629 (80h35m1.24864076s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.839147038 (80h35m1.270227159s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.842382028 (80h35m1.273462159s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.850956162 (80h35m1.282036293s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.855083227 (80h35m1.286163368s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.857374992 (80h35m1.288455123s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.868715869 (80h35m1.299796s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.878390188 (80h35m1.30947031s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881429374 (80h35m1.312509495s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881443029 (80h35m1.31252316s) [seg_pos={0 0}, upload=83945]: Segment reached optimal threshold of 14 pieces. Aug 12 02:01:06.881536228 (80h35m1.312616359s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881586864 (80h35m1.312666985s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881633263 (80h35m1.312713395s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wNKharWFFSSsLMd1vZYi6zYEYBe3VT6Z3ikrY7Cjo3xPLUK62): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881687307 (80h35m1.312767438s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection Aug 12 02:01:06.881700463 (80h35m1.312780584s) [seg_pos={0 0}, upload=83945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 02:01:06.881760668 (80h35m1.312840799s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 02:01:06.881764525 (80h35m1.312844656s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:01:07.283069742 (80h35m1.714149883s) [upload=83945]: Done uploading segments... Aug 12 02:01:07.283086976 (80h35m1.714167107s) [upload=83945]: Upload finished. err: <nil> Duration: 6.043613605s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............................X.............X................] duration: 1.841926096s FAIL (2025-08-12 02:16:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.841949401s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X........X.........................X...X................] duration: 5.633368609s FAIL (2025-08-12 02:16:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5bcb3223aad6175f3a85e4ed3576bc584685c3a15171450a8990330a0bf9360f != before a1cb09d0d640b652333a601939d11f28bca1cde12315edd614af1e5f81c54e86 ======LOGS====== Aug 12 02:01:04.299553302 (80h34m58.730633433s) [upload=83945]: Starting upload Aug 12 02:01:04.299598488 (80h34m58.730678619s) [upload=83945]: Done starting upload Aug 12 02:01:04.299674804 (80h34m58.730754946s) [upload=83945]: Uploading segments... Aug 12 02:01:04.299804032 (80h34m58.730884163s) [upload=83945]: Got next segment. Inline: false Aug 12 02:01:04.299848266 (80h34m58.730928397s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:01:04.299854278 (80h34m58.730934409s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 02:01:04.794172039 (80h34m59.22525218s) [seg_pos={0 0}, upload=83945]: Begin upload segment... Aug 12 02:01:04.794265368 (80h34m59.225345499s) [seg_pos={0 0}, upload=83945]: Done begin upload segment. Aug 12 02:01:04.794290176 (80h34m59.225370297s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794304182 (80h34m59.225384313s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794371712 (80h34m59.225451843s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794726560 (80h34m59.225806691s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794748151 (80h34m59.225828282s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795024830 (80h34m59.226104962s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795047003 (80h34m59.226127134s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795438221 (80h34m59.226518352s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795820513 (80h34m59.226900644s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796224436 (80h34m59.227304567s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796822540 (80h34m59.227902661s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797151790 (80h34m59.228231931s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797605458 (80h34m59.228685589s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797939467 (80h34m59.229019608s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798219923 (80h34m59.229300055s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798485312 (80h34m59.229565443s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798763975 (80h34m59.229844106s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.799031106 (80h34m59.230111237s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:05.911038958 (80h35m0.342119089s) [upload=83945]: Next returned nil segment Aug 12 02:01:05.911053635 (80h35m0.342133766s) [upload=83945]: Waiting for error group managing segments... Aug 12 02:01:06.206068616 (80h35m0.637148747s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.267867411 (80h35m0.698947542s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.270789562 (80h35m0.701869683s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.769025920 (80h35m1.200106061s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.794220142 (80h35m1.225300273s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.817560629 (80h35m1.24864076s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.839147038 (80h35m1.270227159s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.842382028 (80h35m1.273462159s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.850956162 (80h35m1.282036293s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.855083227 (80h35m1.286163368s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.857374992 (80h35m1.288455123s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.868715869 (80h35m1.299796s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.878390188 (80h35m1.30947031s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881429374 (80h35m1.312509495s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881443029 (80h35m1.31252316s) [seg_pos={0 0}, upload=83945]: Segment reached optimal threshold of 14 pieces. Aug 12 02:01:06.881536228 (80h35m1.312616359s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881586864 (80h35m1.312666985s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881633263 (80h35m1.312713395s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wNKharWFFSSsLMd1vZYi6zYEYBe3VT6Z3ikrY7Cjo3xPLUK62): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881687307 (80h35m1.312767438s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection Aug 12 02:01:06.881700463 (80h35m1.312780584s) [seg_pos={0 0}, upload=83945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 02:01:06.881760668 (80h35m1.312840799s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 02:01:06.881764525 (80h35m1.312844656s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:01:07.283069742 (80h35m1.714149883s) [upload=83945]: Done uploading segments... Aug 12 02:01:07.283086976 (80h35m1.714167107s) [upload=83945]: Upload finished. err: <nil> Duration: 5.633390452s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X........X.........................X...X...............] duration: 5.844927156s FAIL (2025-08-12 02:15:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5bcb3223aad6175f3a85e4ed3576bc584685c3a15171450a8990330a0bf9360f != before a1cb09d0d640b652333a601939d11f28bca1cde12315edd614af1e5f81c54e86 ======LOGS====== Aug 12 02:01:04.299553302 (80h34m58.730633433s) [upload=83945]: Starting upload Aug 12 02:01:04.299598488 (80h34m58.730678619s) [upload=83945]: Done starting upload Aug 12 02:01:04.299674804 (80h34m58.730754946s) [upload=83945]: Uploading segments... Aug 12 02:01:04.299804032 (80h34m58.730884163s) [upload=83945]: Got next segment. Inline: false Aug 12 02:01:04.299848266 (80h34m58.730928397s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:01:04.299854278 (80h34m58.730934409s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 02:01:04.794172039 (80h34m59.22525218s) [seg_pos={0 0}, upload=83945]: Begin upload segment... Aug 12 02:01:04.794265368 (80h34m59.225345499s) [seg_pos={0 0}, upload=83945]: Done begin upload segment. Aug 12 02:01:04.794290176 (80h34m59.225370297s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794304182 (80h34m59.225384313s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794371712 (80h34m59.225451843s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794726560 (80h34m59.225806691s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794748151 (80h34m59.225828282s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795024830 (80h34m59.226104962s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795047003 (80h34m59.226127134s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795438221 (80h34m59.226518352s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795820513 (80h34m59.226900644s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796224436 (80h34m59.227304567s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796822540 (80h34m59.227902661s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797151790 (80h34m59.228231931s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797605458 (80h34m59.228685589s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797939467 (80h34m59.229019608s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798219923 (80h34m59.229300055s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798485312 (80h34m59.229565443s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798763975 (80h34m59.229844106s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.799031106 (80h34m59.230111237s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:05.911038958 (80h35m0.342119089s) [upload=83945]: Next returned nil segment Aug 12 02:01:05.911053635 (80h35m0.342133766s) [upload=83945]: Waiting for error group managing segments... Aug 12 02:01:06.206068616 (80h35m0.637148747s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.267867411 (80h35m0.698947542s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.270789562 (80h35m0.701869683s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.769025920 (80h35m1.200106061s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.794220142 (80h35m1.225300273s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.817560629 (80h35m1.24864076s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.839147038 (80h35m1.270227159s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.842382028 (80h35m1.273462159s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.850956162 (80h35m1.282036293s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.855083227 (80h35m1.286163368s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.857374992 (80h35m1.288455123s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.868715869 (80h35m1.299796s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.878390188 (80h35m1.30947031s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881429374 (80h35m1.312509495s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881443029 (80h35m1.31252316s) [seg_pos={0 0}, upload=83945]: Segment reached optimal threshold of 14 pieces. Aug 12 02:01:06.881536228 (80h35m1.312616359s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881586864 (80h35m1.312666985s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881633263 (80h35m1.312713395s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wNKharWFFSSsLMd1vZYi6zYEYBe3VT6Z3ikrY7Cjo3xPLUK62): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881687307 (80h35m1.312767438s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection Aug 12 02:01:06.881700463 (80h35m1.312780584s) [seg_pos={0 0}, upload=83945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 02:01:06.881760668 (80h35m1.312840799s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 02:01:06.881764525 (80h35m1.312844656s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:01:07.283069742 (80h35m1.714149883s) [upload=83945]: Done uploading segments... Aug 12 02:01:07.283086976 (80h35m1.714167107s) [upload=83945]: Upload finished. err: <nil> Duration: 5.845295522s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............................X.............X...............] duration: 1.878000854s FAIL (2025-08-12 02:15:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.878031263s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............................X.............X..............] duration: 1.962106225s FAIL (2025-08-12 02:14:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.962135923s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [X.....X........X.........................X...X..............] duration: 5.99222597s FAIL (2025-08-12 02:14:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5bcb3223aad6175f3a85e4ed3576bc584685c3a15171450a8990330a0bf9360f != before a1cb09d0d640b652333a601939d11f28bca1cde12315edd614af1e5f81c54e86 ======LOGS====== Aug 12 02:01:04.299553302 (80h34m58.730633433s) [upload=83945]: Starting upload Aug 12 02:01:04.299598488 (80h34m58.730678619s) [upload=83945]: Done starting upload Aug 12 02:01:04.299674804 (80h34m58.730754946s) [upload=83945]: Uploading segments... Aug 12 02:01:04.299804032 (80h34m58.730884163s) [upload=83945]: Got next segment. Inline: false Aug 12 02:01:04.299848266 (80h34m58.730928397s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:01:04.299854278 (80h34m58.730934409s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 02:01:04.794172039 (80h34m59.22525218s) [seg_pos={0 0}, upload=83945]: Begin upload segment... Aug 12 02:01:04.794265368 (80h34m59.225345499s) [seg_pos={0 0}, upload=83945]: Done begin upload segment. Aug 12 02:01:04.794290176 (80h34m59.225370297s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794304182 (80h34m59.225384313s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794371712 (80h34m59.225451843s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794726560 (80h34m59.225806691s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794748151 (80h34m59.225828282s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795024830 (80h34m59.226104962s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795047003 (80h34m59.226127134s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795438221 (80h34m59.226518352s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795820513 (80h34m59.226900644s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796224436 (80h34m59.227304567s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796822540 (80h34m59.227902661s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797151790 (80h34m59.228231931s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797605458 (80h34m59.228685589s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797939467 (80h34m59.229019608s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798219923 (80h34m59.229300055s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798485312 (80h34m59.229565443s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798763975 (80h34m59.229844106s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.799031106 (80h34m59.230111237s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:05.911038958 (80h35m0.342119089s) [upload=83945]: Next returned nil segment Aug 12 02:01:05.911053635 (80h35m0.342133766s) [upload=83945]: Waiting for error group managing segments... Aug 12 02:01:06.206068616 (80h35m0.637148747s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.267867411 (80h35m0.698947542s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.270789562 (80h35m0.701869683s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.769025920 (80h35m1.200106061s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.794220142 (80h35m1.225300273s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.817560629 (80h35m1.24864076s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.839147038 (80h35m1.270227159s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.842382028 (80h35m1.273462159s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.850956162 (80h35m1.282036293s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.855083227 (80h35m1.286163368s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.857374992 (80h35m1.288455123s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.868715869 (80h35m1.299796s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.878390188 (80h35m1.30947031s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881429374 (80h35m1.312509495s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881443029 (80h35m1.31252316s) [seg_pos={0 0}, upload=83945]: Segment reached optimal threshold of 14 pieces. Aug 12 02:01:06.881536228 (80h35m1.312616359s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881586864 (80h35m1.312666985s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881633263 (80h35m1.312713395s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wNKharWFFSSsLMd1vZYi6zYEYBe3VT6Z3ikrY7Cjo3xPLUK62): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881687307 (80h35m1.312767438s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection Aug 12 02:01:06.881700463 (80h35m1.312780584s) [seg_pos={0 0}, upload=83945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 02:01:06.881760668 (80h35m1.312840799s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 02:01:06.881764525 (80h35m1.312844656s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:01:07.283069742 (80h35m1.714149883s) [upload=83945]: Done uploading segments... Aug 12 02:01:07.283086976 (80h35m1.714167107s) [upload=83945]: Upload finished. err: <nil> Duration: 5.992256058s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [................................X.............X.............] duration: 1.920399772s FAIL (2025-08-12 02:13:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.920418498s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.X.....X........X.........................X...X.............] duration: 5.909530319s FAIL (2025-08-12 02:13:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5bcb3223aad6175f3a85e4ed3576bc584685c3a15171450a8990330a0bf9360f != before a1cb09d0d640b652333a601939d11f28bca1cde12315edd614af1e5f81c54e86 ======LOGS====== Aug 12 02:01:04.299553302 (80h34m58.730633433s) [upload=83945]: Starting upload Aug 12 02:01:04.299598488 (80h34m58.730678619s) [upload=83945]: Done starting upload Aug 12 02:01:04.299674804 (80h34m58.730754946s) [upload=83945]: Uploading segments... Aug 12 02:01:04.299804032 (80h34m58.730884163s) [upload=83945]: Got next segment. Inline: false Aug 12 02:01:04.299848266 (80h34m58.730928397s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:01:04.299854278 (80h34m58.730934409s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 02:01:04.794172039 (80h34m59.22525218s) [seg_pos={0 0}, upload=83945]: Begin upload segment... Aug 12 02:01:04.794265368 (80h34m59.225345499s) [seg_pos={0 0}, upload=83945]: Done begin upload segment. Aug 12 02:01:04.794290176 (80h34m59.225370297s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794304182 (80h34m59.225384313s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794371712 (80h34m59.225451843s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794726560 (80h34m59.225806691s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794748151 (80h34m59.225828282s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795024830 (80h34m59.226104962s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795047003 (80h34m59.226127134s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795438221 (80h34m59.226518352s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795820513 (80h34m59.226900644s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796224436 (80h34m59.227304567s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796822540 (80h34m59.227902661s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797151790 (80h34m59.228231931s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797605458 (80h34m59.228685589s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797939467 (80h34m59.229019608s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798219923 (80h34m59.229300055s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798485312 (80h34m59.229565443s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798763975 (80h34m59.229844106s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.799031106 (80h34m59.230111237s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:05.911038958 (80h35m0.342119089s) [upload=83945]: Next returned nil segment Aug 12 02:01:05.911053635 (80h35m0.342133766s) [upload=83945]: Waiting for error group managing segments... Aug 12 02:01:06.206068616 (80h35m0.637148747s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.267867411 (80h35m0.698947542s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.270789562 (80h35m0.701869683s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.769025920 (80h35m1.200106061s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.794220142 (80h35m1.225300273s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.817560629 (80h35m1.24864076s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.839147038 (80h35m1.270227159s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.842382028 (80h35m1.273462159s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.850956162 (80h35m1.282036293s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.855083227 (80h35m1.286163368s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.857374992 (80h35m1.288455123s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.868715869 (80h35m1.299796s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.878390188 (80h35m1.30947031s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881429374 (80h35m1.312509495s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881443029 (80h35m1.31252316s) [seg_pos={0 0}, upload=83945]: Segment reached optimal threshold of 14 pieces. Aug 12 02:01:06.881536228 (80h35m1.312616359s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881586864 (80h35m1.312666985s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881633263 (80h35m1.312713395s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wNKharWFFSSsLMd1vZYi6zYEYBe3VT6Z3ikrY7Cjo3xPLUK62): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881687307 (80h35m1.312767438s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection Aug 12 02:01:06.881700463 (80h35m1.312780584s) [seg_pos={0 0}, upload=83945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 02:01:06.881760668 (80h35m1.312840799s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 02:01:06.881764525 (80h35m1.312844656s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:01:07.283069742 (80h35m1.714149883s) [upload=83945]: Done uploading segments... Aug 12 02:01:07.283086976 (80h35m1.714167107s) [upload=83945]: Upload finished. err: <nil> Duration: 5.909555658s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................................X.............X............] duration: 1.817161359s FAIL (2025-08-12 02:13:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.81718297s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..X.....X........X.........................X...X............] duration: 5.906159325s FAIL (2025-08-12 02:13:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5bcb3223aad6175f3a85e4ed3576bc584685c3a15171450a8990330a0bf9360f != before a1cb09d0d640b652333a601939d11f28bca1cde12315edd614af1e5f81c54e86 ======LOGS====== Aug 12 02:01:04.299553302 (80h34m58.730633433s) [upload=83945]: Starting upload Aug 12 02:01:04.299598488 (80h34m58.730678619s) [upload=83945]: Done starting upload Aug 12 02:01:04.299674804 (80h34m58.730754946s) [upload=83945]: Uploading segments... Aug 12 02:01:04.299804032 (80h34m58.730884163s) [upload=83945]: Got next segment. Inline: false Aug 12 02:01:04.299848266 (80h34m58.730928397s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:01:04.299854278 (80h34m58.730934409s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 02:01:04.794172039 (80h34m59.22525218s) [seg_pos={0 0}, upload=83945]: Begin upload segment... Aug 12 02:01:04.794265368 (80h34m59.225345499s) [seg_pos={0 0}, upload=83945]: Done begin upload segment. Aug 12 02:01:04.794290176 (80h34m59.225370297s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794304182 (80h34m59.225384313s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794371712 (80h34m59.225451843s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794726560 (80h34m59.225806691s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794748151 (80h34m59.225828282s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795024830 (80h34m59.226104962s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795047003 (80h34m59.226127134s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795438221 (80h34m59.226518352s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795820513 (80h34m59.226900644s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796224436 (80h34m59.227304567s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796822540 (80h34m59.227902661s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797151790 (80h34m59.228231931s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797605458 (80h34m59.228685589s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797939467 (80h34m59.229019608s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798219923 (80h34m59.229300055s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798485312 (80h34m59.229565443s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798763975 (80h34m59.229844106s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.799031106 (80h34m59.230111237s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:05.911038958 (80h35m0.342119089s) [upload=83945]: Next returned nil segment Aug 12 02:01:05.911053635 (80h35m0.342133766s) [upload=83945]: Waiting for error group managing segments... Aug 12 02:01:06.206068616 (80h35m0.637148747s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.267867411 (80h35m0.698947542s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.270789562 (80h35m0.701869683s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.769025920 (80h35m1.200106061s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.794220142 (80h35m1.225300273s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.817560629 (80h35m1.24864076s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.839147038 (80h35m1.270227159s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.842382028 (80h35m1.273462159s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.850956162 (80h35m1.282036293s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.855083227 (80h35m1.286163368s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.857374992 (80h35m1.288455123s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.868715869 (80h35m1.299796s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.878390188 (80h35m1.30947031s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881429374 (80h35m1.312509495s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881443029 (80h35m1.31252316s) [seg_pos={0 0}, upload=83945]: Segment reached optimal threshold of 14 pieces. Aug 12 02:01:06.881536228 (80h35m1.312616359s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881586864 (80h35m1.312666985s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881633263 (80h35m1.312713395s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wNKharWFFSSsLMd1vZYi6zYEYBe3VT6Z3ikrY7Cjo3xPLUK62): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881687307 (80h35m1.312767438s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection Aug 12 02:01:06.881700463 (80h35m1.312780584s) [seg_pos={0 0}, upload=83945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 02:01:06.881760668 (80h35m1.312840799s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 02:01:06.881764525 (80h35m1.312844656s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:01:07.283069742 (80h35m1.714149883s) [upload=83945]: Done uploading segments... Aug 12 02:01:07.283086976 (80h35m1.714167107s) [upload=83945]: Upload finished. err: <nil> Duration: 5.906184754s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................................X.............X...........] duration: 1.870323199s FAIL (2025-08-12 02:12:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.870351193s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...X.....X........X.........................X...X...........] duration: 5.968379805s FAIL (2025-08-12 02:11:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5bcb3223aad6175f3a85e4ed3576bc584685c3a15171450a8990330a0bf9360f != before a1cb09d0d640b652333a601939d11f28bca1cde12315edd614af1e5f81c54e86 ======LOGS====== Aug 12 02:01:04.299553302 (80h34m58.730633433s) [upload=83945]: Starting upload Aug 12 02:01:04.299598488 (80h34m58.730678619s) [upload=83945]: Done starting upload Aug 12 02:01:04.299674804 (80h34m58.730754946s) [upload=83945]: Uploading segments... Aug 12 02:01:04.299804032 (80h34m58.730884163s) [upload=83945]: Got next segment. Inline: false Aug 12 02:01:04.299848266 (80h34m58.730928397s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:01:04.299854278 (80h34m58.730934409s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 02:01:04.794172039 (80h34m59.22525218s) [seg_pos={0 0}, upload=83945]: Begin upload segment... Aug 12 02:01:04.794265368 (80h34m59.225345499s) [seg_pos={0 0}, upload=83945]: Done begin upload segment. Aug 12 02:01:04.794290176 (80h34m59.225370297s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794304182 (80h34m59.225384313s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794371712 (80h34m59.225451843s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794726560 (80h34m59.225806691s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794748151 (80h34m59.225828282s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795024830 (80h34m59.226104962s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795047003 (80h34m59.226127134s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795438221 (80h34m59.226518352s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795820513 (80h34m59.226900644s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796224436 (80h34m59.227304567s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796822540 (80h34m59.227902661s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797151790 (80h34m59.228231931s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797605458 (80h34m59.228685589s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797939467 (80h34m59.229019608s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798219923 (80h34m59.229300055s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798485312 (80h34m59.229565443s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798763975 (80h34m59.229844106s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.799031106 (80h34m59.230111237s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:05.911038958 (80h35m0.342119089s) [upload=83945]: Next returned nil segment Aug 12 02:01:05.911053635 (80h35m0.342133766s) [upload=83945]: Waiting for error group managing segments... Aug 12 02:01:06.206068616 (80h35m0.637148747s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.267867411 (80h35m0.698947542s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.270789562 (80h35m0.701869683s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.769025920 (80h35m1.200106061s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.794220142 (80h35m1.225300273s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.817560629 (80h35m1.24864076s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.839147038 (80h35m1.270227159s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.842382028 (80h35m1.273462159s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.850956162 (80h35m1.282036293s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.855083227 (80h35m1.286163368s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.857374992 (80h35m1.288455123s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.868715869 (80h35m1.299796s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.878390188 (80h35m1.30947031s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881429374 (80h35m1.312509495s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881443029 (80h35m1.31252316s) [seg_pos={0 0}, upload=83945]: Segment reached optimal threshold of 14 pieces. Aug 12 02:01:06.881536228 (80h35m1.312616359s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881586864 (80h35m1.312666985s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881633263 (80h35m1.312713395s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wNKharWFFSSsLMd1vZYi6zYEYBe3VT6Z3ikrY7Cjo3xPLUK62): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881687307 (80h35m1.312767438s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection Aug 12 02:01:06.881700463 (80h35m1.312780584s) [seg_pos={0 0}, upload=83945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 02:01:06.881760668 (80h35m1.312840799s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 02:01:06.881764525 (80h35m1.312844656s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:01:07.283069742 (80h35m1.714149883s) [upload=83945]: Done uploading segments... Aug 12 02:01:07.283086976 (80h35m1.714167107s) [upload=83945]: Upload finished. err: <nil> Duration: 5.968401636s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................................X.............X..........] duration: 1.909712207s FAIL (2025-08-12 02:11:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.90976634s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................................X.............X.........] duration: 1.857116556s FAIL (2025-08-12 02:11:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.85714546s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [....X.....X........X.........................X...X..........] duration: 5.900624824s FAIL (2025-08-12 02:10:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5bcb3223aad6175f3a85e4ed3576bc584685c3a15171450a8990330a0bf9360f != before a1cb09d0d640b652333a601939d11f28bca1cde12315edd614af1e5f81c54e86 ======LOGS====== Aug 12 02:01:04.299553302 (80h34m58.730633433s) [upload=83945]: Starting upload Aug 12 02:01:04.299598488 (80h34m58.730678619s) [upload=83945]: Done starting upload Aug 12 02:01:04.299674804 (80h34m58.730754946s) [upload=83945]: Uploading segments... Aug 12 02:01:04.299804032 (80h34m58.730884163s) [upload=83945]: Got next segment. Inline: false Aug 12 02:01:04.299848266 (80h34m58.730928397s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:01:04.299854278 (80h34m58.730934409s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 02:01:04.794172039 (80h34m59.22525218s) [seg_pos={0 0}, upload=83945]: Begin upload segment... Aug 12 02:01:04.794265368 (80h34m59.225345499s) [seg_pos={0 0}, upload=83945]: Done begin upload segment. Aug 12 02:01:04.794290176 (80h34m59.225370297s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794304182 (80h34m59.225384313s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794371712 (80h34m59.225451843s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794726560 (80h34m59.225806691s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794748151 (80h34m59.225828282s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795024830 (80h34m59.226104962s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795047003 (80h34m59.226127134s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795438221 (80h34m59.226518352s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795820513 (80h34m59.226900644s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796224436 (80h34m59.227304567s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796822540 (80h34m59.227902661s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797151790 (80h34m59.228231931s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797605458 (80h34m59.228685589s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797939467 (80h34m59.229019608s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798219923 (80h34m59.229300055s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798485312 (80h34m59.229565443s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798763975 (80h34m59.229844106s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.799031106 (80h34m59.230111237s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:05.911038958 (80h35m0.342119089s) [upload=83945]: Next returned nil segment Aug 12 02:01:05.911053635 (80h35m0.342133766s) [upload=83945]: Waiting for error group managing segments... Aug 12 02:01:06.206068616 (80h35m0.637148747s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.267867411 (80h35m0.698947542s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.270789562 (80h35m0.701869683s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.769025920 (80h35m1.200106061s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.794220142 (80h35m1.225300273s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.817560629 (80h35m1.24864076s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.839147038 (80h35m1.270227159s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.842382028 (80h35m1.273462159s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.850956162 (80h35m1.282036293s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.855083227 (80h35m1.286163368s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.857374992 (80h35m1.288455123s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.868715869 (80h35m1.299796s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.878390188 (80h35m1.30947031s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881429374 (80h35m1.312509495s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881443029 (80h35m1.31252316s) [seg_pos={0 0}, upload=83945]: Segment reached optimal threshold of 14 pieces. Aug 12 02:01:06.881536228 (80h35m1.312616359s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881586864 (80h35m1.312666985s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881633263 (80h35m1.312713395s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wNKharWFFSSsLMd1vZYi6zYEYBe3VT6Z3ikrY7Cjo3xPLUK62): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881687307 (80h35m1.312767438s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection Aug 12 02:01:06.881700463 (80h35m1.312780584s) [seg_pos={0 0}, upload=83945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 02:01:06.881760668 (80h35m1.312840799s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 02:01:06.881764525 (80h35m1.312844656s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:01:07.283069742 (80h35m1.714149883s) [upload=83945]: Done uploading segments... Aug 12 02:01:07.283086976 (80h35m1.714167107s) [upload=83945]: Upload finished. err: <nil> Duration: 5.900650473s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X.............X........] duration: 1.92332126s FAIL (2025-08-12 02:09:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.923346608s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.....X.....X........X.........................X...X.........] duration: 5.736682149s FAIL (2025-08-12 02:09:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5bcb3223aad6175f3a85e4ed3576bc584685c3a15171450a8990330a0bf9360f != before a1cb09d0d640b652333a601939d11f28bca1cde12315edd614af1e5f81c54e86 ======LOGS====== Aug 12 02:01:04.299553302 (80h34m58.730633433s) [upload=83945]: Starting upload Aug 12 02:01:04.299598488 (80h34m58.730678619s) [upload=83945]: Done starting upload Aug 12 02:01:04.299674804 (80h34m58.730754946s) [upload=83945]: Uploading segments... Aug 12 02:01:04.299804032 (80h34m58.730884163s) [upload=83945]: Got next segment. Inline: false Aug 12 02:01:04.299848266 (80h34m58.730928397s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:01:04.299854278 (80h34m58.730934409s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 02:01:04.794172039 (80h34m59.22525218s) [seg_pos={0 0}, upload=83945]: Begin upload segment... Aug 12 02:01:04.794265368 (80h34m59.225345499s) [seg_pos={0 0}, upload=83945]: Done begin upload segment. Aug 12 02:01:04.794290176 (80h34m59.225370297s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794304182 (80h34m59.225384313s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794371712 (80h34m59.225451843s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794726560 (80h34m59.225806691s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794748151 (80h34m59.225828282s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795024830 (80h34m59.226104962s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795047003 (80h34m59.226127134s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795438221 (80h34m59.226518352s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795820513 (80h34m59.226900644s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796224436 (80h34m59.227304567s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796822540 (80h34m59.227902661s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797151790 (80h34m59.228231931s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797605458 (80h34m59.228685589s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797939467 (80h34m59.229019608s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798219923 (80h34m59.229300055s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798485312 (80h34m59.229565443s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798763975 (80h34m59.229844106s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.799031106 (80h34m59.230111237s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:05.911038958 (80h35m0.342119089s) [upload=83945]: Next returned nil segment Aug 12 02:01:05.911053635 (80h35m0.342133766s) [upload=83945]: Waiting for error group managing segments... Aug 12 02:01:06.206068616 (80h35m0.637148747s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.267867411 (80h35m0.698947542s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.270789562 (80h35m0.701869683s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.769025920 (80h35m1.200106061s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.794220142 (80h35m1.225300273s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.817560629 (80h35m1.24864076s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.839147038 (80h35m1.270227159s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.842382028 (80h35m1.273462159s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.850956162 (80h35m1.282036293s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.855083227 (80h35m1.286163368s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.857374992 (80h35m1.288455123s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.868715869 (80h35m1.299796s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.878390188 (80h35m1.30947031s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881429374 (80h35m1.312509495s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881443029 (80h35m1.31252316s) [seg_pos={0 0}, upload=83945]: Segment reached optimal threshold of 14 pieces. Aug 12 02:01:06.881536228 (80h35m1.312616359s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881586864 (80h35m1.312666985s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881633263 (80h35m1.312713395s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wNKharWFFSSsLMd1vZYi6zYEYBe3VT6Z3ikrY7Cjo3xPLUK62): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881687307 (80h35m1.312767438s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection Aug 12 02:01:06.881700463 (80h35m1.312780584s) [seg_pos={0 0}, upload=83945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 02:01:06.881760668 (80h35m1.312840799s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 02:01:06.881764525 (80h35m1.312844656s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:01:07.283069742 (80h35m1.714149883s) [upload=83945]: Done uploading segments... Aug 12 02:01:07.283086976 (80h35m1.714167107s) [upload=83945]: Upload finished. err: <nil> Duration: 5.736705402s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................................X.............X.......] duration: 1.947050114s FAIL (2025-08-12 02:08:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.947075382s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [......X.....X........X.........................X...X........] duration: 5.969002396s FAIL (2025-08-12 02:08:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5bcb3223aad6175f3a85e4ed3576bc584685c3a15171450a8990330a0bf9360f != before a1cb09d0d640b652333a601939d11f28bca1cde12315edd614af1e5f81c54e86 ======LOGS====== Aug 12 02:01:04.299553302 (80h34m58.730633433s) [upload=83945]: Starting upload Aug 12 02:01:04.299598488 (80h34m58.730678619s) [upload=83945]: Done starting upload Aug 12 02:01:04.299674804 (80h34m58.730754946s) [upload=83945]: Uploading segments... Aug 12 02:01:04.299804032 (80h34m58.730884163s) [upload=83945]: Got next segment. Inline: false Aug 12 02:01:04.299848266 (80h34m58.730928397s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:01:04.299854278 (80h34m58.730934409s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 02:01:04.794172039 (80h34m59.22525218s) [seg_pos={0 0}, upload=83945]: Begin upload segment... Aug 12 02:01:04.794265368 (80h34m59.225345499s) [seg_pos={0 0}, upload=83945]: Done begin upload segment. Aug 12 02:01:04.794290176 (80h34m59.225370297s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794304182 (80h34m59.225384313s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794371712 (80h34m59.225451843s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794726560 (80h34m59.225806691s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794748151 (80h34m59.225828282s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795024830 (80h34m59.226104962s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795047003 (80h34m59.226127134s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795438221 (80h34m59.226518352s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795820513 (80h34m59.226900644s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796224436 (80h34m59.227304567s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796822540 (80h34m59.227902661s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797151790 (80h34m59.228231931s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797605458 (80h34m59.228685589s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797939467 (80h34m59.229019608s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798219923 (80h34m59.229300055s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798485312 (80h34m59.229565443s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798763975 (80h34m59.229844106s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.799031106 (80h34m59.230111237s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:05.911038958 (80h35m0.342119089s) [upload=83945]: Next returned nil segment Aug 12 02:01:05.911053635 (80h35m0.342133766s) [upload=83945]: Waiting for error group managing segments... Aug 12 02:01:06.206068616 (80h35m0.637148747s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.267867411 (80h35m0.698947542s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.270789562 (80h35m0.701869683s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.769025920 (80h35m1.200106061s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.794220142 (80h35m1.225300273s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.817560629 (80h35m1.24864076s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.839147038 (80h35m1.270227159s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.842382028 (80h35m1.273462159s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.850956162 (80h35m1.282036293s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.855083227 (80h35m1.286163368s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.857374992 (80h35m1.288455123s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.868715869 (80h35m1.299796s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.878390188 (80h35m1.30947031s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881429374 (80h35m1.312509495s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881443029 (80h35m1.31252316s) [seg_pos={0 0}, upload=83945]: Segment reached optimal threshold of 14 pieces. Aug 12 02:01:06.881536228 (80h35m1.312616359s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881586864 (80h35m1.312666985s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881633263 (80h35m1.312713395s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wNKharWFFSSsLMd1vZYi6zYEYBe3VT6Z3ikrY7Cjo3xPLUK62): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881687307 (80h35m1.312767438s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection Aug 12 02:01:06.881700463 (80h35m1.312780584s) [seg_pos={0 0}, upload=83945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 02:01:06.881760668 (80h35m1.312840799s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 02:01:06.881764525 (80h35m1.312844656s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:01:07.283069742 (80h35m1.714149883s) [upload=83945]: Done uploading segments... Aug 12 02:01:07.283086976 (80h35m1.714167107s) [upload=83945]: Upload finished. err: <nil> Duration: 5.969019259s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X.............X......] duration: 1.97988775s FAIL (2025-08-12 02:07:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.979922066s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......X.....X........X.........................X...X.......] duration: 5.894562106s FAIL (2025-08-12 02:07:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5bcb3223aad6175f3a85e4ed3576bc584685c3a15171450a8990330a0bf9360f != before a1cb09d0d640b652333a601939d11f28bca1cde12315edd614af1e5f81c54e86 ======LOGS====== Aug 12 02:01:04.299553302 (80h34m58.730633433s) [upload=83945]: Starting upload Aug 12 02:01:04.299598488 (80h34m58.730678619s) [upload=83945]: Done starting upload Aug 12 02:01:04.299674804 (80h34m58.730754946s) [upload=83945]: Uploading segments... Aug 12 02:01:04.299804032 (80h34m58.730884163s) [upload=83945]: Got next segment. Inline: false Aug 12 02:01:04.299848266 (80h34m58.730928397s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:01:04.299854278 (80h34m58.730934409s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 02:01:04.794172039 (80h34m59.22525218s) [seg_pos={0 0}, upload=83945]: Begin upload segment... Aug 12 02:01:04.794265368 (80h34m59.225345499s) [seg_pos={0 0}, upload=83945]: Done begin upload segment. Aug 12 02:01:04.794290176 (80h34m59.225370297s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794304182 (80h34m59.225384313s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794371712 (80h34m59.225451843s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794726560 (80h34m59.225806691s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794748151 (80h34m59.225828282s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795024830 (80h34m59.226104962s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795047003 (80h34m59.226127134s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795438221 (80h34m59.226518352s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795820513 (80h34m59.226900644s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796224436 (80h34m59.227304567s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796822540 (80h34m59.227902661s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797151790 (80h34m59.228231931s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797605458 (80h34m59.228685589s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797939467 (80h34m59.229019608s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798219923 (80h34m59.229300055s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798485312 (80h34m59.229565443s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798763975 (80h34m59.229844106s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.799031106 (80h34m59.230111237s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:05.911038958 (80h35m0.342119089s) [upload=83945]: Next returned nil segment Aug 12 02:01:05.911053635 (80h35m0.342133766s) [upload=83945]: Waiting for error group managing segments... Aug 12 02:01:06.206068616 (80h35m0.637148747s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.267867411 (80h35m0.698947542s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.270789562 (80h35m0.701869683s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.769025920 (80h35m1.200106061s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.794220142 (80h35m1.225300273s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.817560629 (80h35m1.24864076s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.839147038 (80h35m1.270227159s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.842382028 (80h35m1.273462159s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.850956162 (80h35m1.282036293s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.855083227 (80h35m1.286163368s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.857374992 (80h35m1.288455123s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.868715869 (80h35m1.299796s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.878390188 (80h35m1.30947031s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881429374 (80h35m1.312509495s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881443029 (80h35m1.31252316s) [seg_pos={0 0}, upload=83945]: Segment reached optimal threshold of 14 pieces. Aug 12 02:01:06.881536228 (80h35m1.312616359s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881586864 (80h35m1.312666985s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881633263 (80h35m1.312713395s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wNKharWFFSSsLMd1vZYi6zYEYBe3VT6Z3ikrY7Cjo3xPLUK62): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881687307 (80h35m1.312767438s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection Aug 12 02:01:06.881700463 (80h35m1.312780584s) [seg_pos={0 0}, upload=83945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 02:01:06.881760668 (80h35m1.312840799s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 02:01:06.881764525 (80h35m1.312844656s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:01:07.283069742 (80h35m1.714149883s) [upload=83945]: Done uploading segments... Aug 12 02:01:07.283086976 (80h35m1.714167107s) [upload=83945]: Upload finished. err: <nil> Duration: 5.89458972s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................................X.............X.....] duration: 1.91112989s FAIL (2025-08-12 02:07:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.911148967s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [X........................................X.............X....] duration: 1.927573244s FAIL (2025-08-12 02:06:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.927599384s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [........X.....X........X.........................X...X......] duration: 5.799972638s FAIL (2025-08-12 02:06:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5bcb3223aad6175f3a85e4ed3576bc584685c3a15171450a8990330a0bf9360f != before a1cb09d0d640b652333a601939d11f28bca1cde12315edd614af1e5f81c54e86 ======LOGS====== Aug 12 02:01:04.299553302 (80h34m58.730633433s) [upload=83945]: Starting upload Aug 12 02:01:04.299598488 (80h34m58.730678619s) [upload=83945]: Done starting upload Aug 12 02:01:04.299674804 (80h34m58.730754946s) [upload=83945]: Uploading segments... Aug 12 02:01:04.299804032 (80h34m58.730884163s) [upload=83945]: Got next segment. Inline: false Aug 12 02:01:04.299848266 (80h34m58.730928397s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:01:04.299854278 (80h34m58.730934409s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 02:01:04.794172039 (80h34m59.22525218s) [seg_pos={0 0}, upload=83945]: Begin upload segment... Aug 12 02:01:04.794265368 (80h34m59.225345499s) [seg_pos={0 0}, upload=83945]: Done begin upload segment. Aug 12 02:01:04.794290176 (80h34m59.225370297s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794304182 (80h34m59.225384313s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794371712 (80h34m59.225451843s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794726560 (80h34m59.225806691s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794748151 (80h34m59.225828282s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795024830 (80h34m59.226104962s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795047003 (80h34m59.226127134s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795438221 (80h34m59.226518352s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795820513 (80h34m59.226900644s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796224436 (80h34m59.227304567s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796822540 (80h34m59.227902661s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797151790 (80h34m59.228231931s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797605458 (80h34m59.228685589s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797939467 (80h34m59.229019608s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798219923 (80h34m59.229300055s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798485312 (80h34m59.229565443s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798763975 (80h34m59.229844106s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.799031106 (80h34m59.230111237s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:05.911038958 (80h35m0.342119089s) [upload=83945]: Next returned nil segment Aug 12 02:01:05.911053635 (80h35m0.342133766s) [upload=83945]: Waiting for error group managing segments... Aug 12 02:01:06.206068616 (80h35m0.637148747s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.267867411 (80h35m0.698947542s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.270789562 (80h35m0.701869683s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.769025920 (80h35m1.200106061s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.794220142 (80h35m1.225300273s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.817560629 (80h35m1.24864076s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.839147038 (80h35m1.270227159s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.842382028 (80h35m1.273462159s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.850956162 (80h35m1.282036293s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.855083227 (80h35m1.286163368s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.857374992 (80h35m1.288455123s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.868715869 (80h35m1.299796s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.878390188 (80h35m1.30947031s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881429374 (80h35m1.312509495s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881443029 (80h35m1.31252316s) [seg_pos={0 0}, upload=83945]: Segment reached optimal threshold of 14 pieces. Aug 12 02:01:06.881536228 (80h35m1.312616359s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881586864 (80h35m1.312666985s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881633263 (80h35m1.312713395s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wNKharWFFSSsLMd1vZYi6zYEYBe3VT6Z3ikrY7Cjo3xPLUK62): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881687307 (80h35m1.312767438s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection Aug 12 02:01:06.881700463 (80h35m1.312780584s) [seg_pos={0 0}, upload=83945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 02:01:06.881760668 (80h35m1.312840799s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 02:01:06.881764525 (80h35m1.312844656s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:01:07.283069742 (80h35m1.714149883s) [upload=83945]: Done uploading segments... Aug 12 02:01:07.283086976 (80h35m1.714167107s) [upload=83945]: Upload finished. err: <nil> Duration: 5.800006342s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.X........................................X.............X...] duration: 1.854495249s FAIL (2025-08-12 02:06:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.854518011s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.........X.....X........X.........................X...X.....] duration: 5.975077401s FAIL (2025-08-12 02:06:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5bcb3223aad6175f3a85e4ed3576bc584685c3a15171450a8990330a0bf9360f != before a1cb09d0d640b652333a601939d11f28bca1cde12315edd614af1e5f81c54e86 ======LOGS====== Aug 12 02:01:04.299553302 (80h34m58.730633433s) [upload=83945]: Starting upload Aug 12 02:01:04.299598488 (80h34m58.730678619s) [upload=83945]: Done starting upload Aug 12 02:01:04.299674804 (80h34m58.730754946s) [upload=83945]: Uploading segments... Aug 12 02:01:04.299804032 (80h34m58.730884163s) [upload=83945]: Got next segment. Inline: false Aug 12 02:01:04.299848266 (80h34m58.730928397s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:01:04.299854278 (80h34m58.730934409s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 02:01:04.794172039 (80h34m59.22525218s) [seg_pos={0 0}, upload=83945]: Begin upload segment... Aug 12 02:01:04.794265368 (80h34m59.225345499s) [seg_pos={0 0}, upload=83945]: Done begin upload segment. Aug 12 02:01:04.794290176 (80h34m59.225370297s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794304182 (80h34m59.225384313s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794371712 (80h34m59.225451843s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794726560 (80h34m59.225806691s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794748151 (80h34m59.225828282s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795024830 (80h34m59.226104962s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795047003 (80h34m59.226127134s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795438221 (80h34m59.226518352s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795820513 (80h34m59.226900644s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796224436 (80h34m59.227304567s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796822540 (80h34m59.227902661s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797151790 (80h34m59.228231931s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797605458 (80h34m59.228685589s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797939467 (80h34m59.229019608s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798219923 (80h34m59.229300055s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798485312 (80h34m59.229565443s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798763975 (80h34m59.229844106s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.799031106 (80h34m59.230111237s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:05.911038958 (80h35m0.342119089s) [upload=83945]: Next returned nil segment Aug 12 02:01:05.911053635 (80h35m0.342133766s) [upload=83945]: Waiting for error group managing segments... Aug 12 02:01:06.206068616 (80h35m0.637148747s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.267867411 (80h35m0.698947542s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.270789562 (80h35m0.701869683s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.769025920 (80h35m1.200106061s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.794220142 (80h35m1.225300273s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.817560629 (80h35m1.24864076s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.839147038 (80h35m1.270227159s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.842382028 (80h35m1.273462159s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.850956162 (80h35m1.282036293s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.855083227 (80h35m1.286163368s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.857374992 (80h35m1.288455123s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.868715869 (80h35m1.299796s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.878390188 (80h35m1.30947031s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881429374 (80h35m1.312509495s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881443029 (80h35m1.31252316s) [seg_pos={0 0}, upload=83945]: Segment reached optimal threshold of 14 pieces. Aug 12 02:01:06.881536228 (80h35m1.312616359s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881586864 (80h35m1.312666985s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881633263 (80h35m1.312713395s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wNKharWFFSSsLMd1vZYi6zYEYBe3VT6Z3ikrY7Cjo3xPLUK62): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881687307 (80h35m1.312767438s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection Aug 12 02:01:06.881700463 (80h35m1.312780584s) [seg_pos={0 0}, upload=83945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 02:01:06.881760668 (80h35m1.312840799s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 02:01:06.881764525 (80h35m1.312844656s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:01:07.283069742 (80h35m1.714149883s) [upload=83945]: Done uploading segments... Aug 12 02:01:07.283086976 (80h35m1.714167107s) [upload=83945]: Upload finished. err: <nil> Duration: 5.97510366s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..........X.....X........X.........................X...X....] duration: 5.683023717s FAIL (2025-08-12 02:05:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5bcb3223aad6175f3a85e4ed3576bc584685c3a15171450a8990330a0bf9360f != before a1cb09d0d640b652333a601939d11f28bca1cde12315edd614af1e5f81c54e86 ======LOGS====== Aug 12 02:01:04.299553302 (80h34m58.730633433s) [upload=83945]: Starting upload Aug 12 02:01:04.299598488 (80h34m58.730678619s) [upload=83945]: Done starting upload Aug 12 02:01:04.299674804 (80h34m58.730754946s) [upload=83945]: Uploading segments... Aug 12 02:01:04.299804032 (80h34m58.730884163s) [upload=83945]: Got next segment. Inline: false Aug 12 02:01:04.299848266 (80h34m58.730928397s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:01:04.299854278 (80h34m58.730934409s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 02:01:04.794172039 (80h34m59.22525218s) [seg_pos={0 0}, upload=83945]: Begin upload segment... Aug 12 02:01:04.794265368 (80h34m59.225345499s) [seg_pos={0 0}, upload=83945]: Done begin upload segment. Aug 12 02:01:04.794290176 (80h34m59.225370297s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794304182 (80h34m59.225384313s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794371712 (80h34m59.225451843s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794726560 (80h34m59.225806691s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794748151 (80h34m59.225828282s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795024830 (80h34m59.226104962s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795047003 (80h34m59.226127134s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795438221 (80h34m59.226518352s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795820513 (80h34m59.226900644s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796224436 (80h34m59.227304567s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796822540 (80h34m59.227902661s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797151790 (80h34m59.228231931s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797605458 (80h34m59.228685589s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797939467 (80h34m59.229019608s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798219923 (80h34m59.229300055s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798485312 (80h34m59.229565443s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798763975 (80h34m59.229844106s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.799031106 (80h34m59.230111237s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:05.911038958 (80h35m0.342119089s) [upload=83945]: Next returned nil segment Aug 12 02:01:05.911053635 (80h35m0.342133766s) [upload=83945]: Waiting for error group managing segments... Aug 12 02:01:06.206068616 (80h35m0.637148747s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.267867411 (80h35m0.698947542s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.270789562 (80h35m0.701869683s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.769025920 (80h35m1.200106061s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.794220142 (80h35m1.225300273s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.817560629 (80h35m1.24864076s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.839147038 (80h35m1.270227159s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.842382028 (80h35m1.273462159s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.850956162 (80h35m1.282036293s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.855083227 (80h35m1.286163368s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.857374992 (80h35m1.288455123s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.868715869 (80h35m1.299796s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.878390188 (80h35m1.30947031s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881429374 (80h35m1.312509495s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881443029 (80h35m1.31252316s) [seg_pos={0 0}, upload=83945]: Segment reached optimal threshold of 14 pieces. Aug 12 02:01:06.881536228 (80h35m1.312616359s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881586864 (80h35m1.312666985s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881633263 (80h35m1.312713395s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wNKharWFFSSsLMd1vZYi6zYEYBe3VT6Z3ikrY7Cjo3xPLUK62): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881687307 (80h35m1.312767438s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection Aug 12 02:01:06.881700463 (80h35m1.312780584s) [seg_pos={0 0}, upload=83945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 02:01:06.881760668 (80h35m1.312840799s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 02:01:06.881764525 (80h35m1.312844656s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:01:07.283069742 (80h35m1.714149883s) [upload=83945]: Done uploading segments... Aug 12 02:01:07.283086976 (80h35m1.714167107s) [upload=83945]: Upload finished. err: <nil> Duration: 5.683059084s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..X........................................X.............X..] duration: 1.89441653s FAIL (2025-08-12 02:05:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.894440846s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...........X.....X........X.........................X...X...] duration: 5.947614822s FAIL (2025-08-12 02:04:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5bcb3223aad6175f3a85e4ed3576bc584685c3a15171450a8990330a0bf9360f != before a1cb09d0d640b652333a601939d11f28bca1cde12315edd614af1e5f81c54e86 ======LOGS====== Aug 12 02:01:04.299553302 (80h34m58.730633433s) [upload=83945]: Starting upload Aug 12 02:01:04.299598488 (80h34m58.730678619s) [upload=83945]: Done starting upload Aug 12 02:01:04.299674804 (80h34m58.730754946s) [upload=83945]: Uploading segments... Aug 12 02:01:04.299804032 (80h34m58.730884163s) [upload=83945]: Got next segment. Inline: false Aug 12 02:01:04.299848266 (80h34m58.730928397s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:01:04.299854278 (80h34m58.730934409s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 02:01:04.794172039 (80h34m59.22525218s) [seg_pos={0 0}, upload=83945]: Begin upload segment... Aug 12 02:01:04.794265368 (80h34m59.225345499s) [seg_pos={0 0}, upload=83945]: Done begin upload segment. Aug 12 02:01:04.794290176 (80h34m59.225370297s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794304182 (80h34m59.225384313s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794371712 (80h34m59.225451843s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794726560 (80h34m59.225806691s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.794748151 (80h34m59.225828282s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795024830 (80h34m59.226104962s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795047003 (80h34m59.226127134s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795438221 (80h34m59.226518352s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.795820513 (80h34m59.226900644s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796224436 (80h34m59.227304567s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.796822540 (80h34m59.227902661s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797151790 (80h34m59.228231931s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797605458 (80h34m59.228685589s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.797939467 (80h34m59.229019608s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798219923 (80h34m59.229300055s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798485312 (80h34m59.229565443s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.798763975 (80h34m59.229844106s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:04.799031106 (80h34m59.230111237s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Uploading piece... Aug 12 02:01:05.911038958 (80h35m0.342119089s) [upload=83945]: Next returned nil segment Aug 12 02:01:05.911053635 (80h35m0.342133766s) [upload=83945]: Waiting for error group managing segments... Aug 12 02:01:06.206068616 (80h35m0.637148747s) [noise=true , address=64.49.13.139:4471 , piece_id=C2VHGGAMOWOACGHEWYDEH77D53RZIWQZNBLHVJYEEISEZLNENSQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.267867411 (80h35m0.698947542s) [noise=true , address=64.49.13.26:4947 , piece_id=JBBDMAIR4LWDXMCSRADV7QAJ4ROFAUSCZ2G7IMSXMLGJ4Z4N4FXQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.270789562 (80h35m0.701869683s) [noise=true , address=193.149.164.143:4695 , piece_id=EFLPCZG7XPFYO6YTTSBSCICS2TQEXHVEYNEGSV5AL4NXFOMTOBAQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.769025920 (80h35m1.200106061s) [noise=true , address=77.90.31.11:4567 , piece_id=2ZXJKS6YKZLXJOCIX4AQL5PWQATUQYFMDMQWC4D6VGY7B3ORWPMA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.794220142 (80h35m1.225300273s) [noise=true , address=104.36.82.21:4489 , piece_id=52NJVIKZGBSIB5RGZZL4TKSWBJAJWVHTXKAXW3FZ75ZWRW6BDRFA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.817560629 (80h35m1.24864076s) [noise=true , address=104.36.82.36:4630 , piece_id=ECTJPWUDKXJHVJT4FSVMV6BTR2Q5CQQ4A5SA5XHV43B2TR6HGFVQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.839147038 (80h35m1.270227159s) [noise=true , address=77.90.31.17:4804 , piece_id=YRFS43AWCNFH3QZHOMMROVHESVPLESTDSM2SDIHURLGBW4P6GEIQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.842382028 (80h35m1.273462159s) [noise=true , address=104.36.82.61:4399 , piece_id=GALTELMBKSBRNZWSY43DFHSCWVAEQPX2YHOS6KJNOXTOQ6O66IQQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.850956162 (80h35m1.282036293s) [noise=true , address=104.36.82.46:4494 , piece_id=CIUTD6WLM3NXWRX72RHEQWOB6CQ42E6MXZ2UDN3JSCXZ4DZO74GQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.855083227 (80h35m1.286163368s) [noise=true , address=104.36.82.6:4898 , piece_id=LVPSMXPDWDTTKFEAKPKJSWOZHTXDXYYGYS73XNYFMWBA6IJVE7JQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.857374992 (80h35m1.288455123s) [noise=true , address=104.36.82.37:4683 , piece_id=73U2IRBPWNKMQVVDFOJ4GM6N4OFQFZXGFULKGTDEAQK5FAD6J53Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.868715869 (80h35m1.299796s) [noise=true , address=104.36.82.34:4555 , piece_id=EKWNZC55WSAG5TCCT4DCPFJWGNBXRHTVKJV57A4CTBXLJIV7HR2Q, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.878390188 (80h35m1.30947031s) [noise=true , address=104.36.82.59:4310 , piece_id=LOUQ63BV4LQUYBSWK3MFFF5QIJEMG7JG3DI437KG2WIFYKXVNFUQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881429374 (80h35m1.312509495s) [noise=true , address=104.36.82.8:4995 , piece_id=OU3XAI6VHOTW7NNI7R4U346SXYHQSBT5BJVSTMA44LGNOVEAIVNQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: <nil> Aug 12 02:01:06.881443029 (80h35m1.31252316s) [seg_pos={0 0}, upload=83945]: Segment reached optimal threshold of 14 pieces. Aug 12 02:01:06.881536228 (80h35m1.312616359s) [noise=true , address=104.36.82.4:4822 , piece_id=W2O4CX7JHIDJ2C4HOZFXC2M6FHEREHI2W2KMNKVBQZ7UU6GSI5PQ, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881586864 (80h35m1.312666985s) [noise=true , address=104.36.82.23:4448 , piece_id=W5NLAFKSZHYZKFMRZKUOQXCOT4DW7B63WA5A5KY6T5GTSKOXBZYA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881633263 (80h35m1.312713395s) [noise=true , address=104.36.82.58:4287 , piece_id=3DA5Z2MFGXGVXMAYLC26WYLOIBO6VFLMX4W7HBJ22EA6POW6Z5QA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wNKharWFFSSsLMd1vZYi6zYEYBe3VT6Z3ikrY7Cjo3xPLUK62): protocol: expected piece hash; context canceled; EOF Aug 12 02:01:06.881687307 (80h35m1.312767438s) [noise=true , address=104.36.82.60:4353 , piece_id=QF55NGPBLZD4ZBYYHSLDB76ELF7UEV36GRNBYPYGEALET7I44JZA, seg_pos={0 0}, upload=83945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33868->104.36.82.60:4353: use of closed network connection Aug 12 02:01:06.881700463 (80h35m1.312780584s) [seg_pos={0 0}, upload=83945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 02:01:06.881760668 (80h35m1.312840799s) [upload=83945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 02:01:06.881764525 (80h35m1.312844656s) [upload=83945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:01:07.283069742 (80h35m1.714149883s) [upload=83945]: Done uploading segments... Aug 12 02:01:07.283086976 (80h35m1.714167107s) [upload=83945]: Upload finished. err: <nil> Duration: 5.947636394s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [X..X........................................X.............X.] duration: 1.926150218s FAIL (2025-08-12 02:04:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.926174836s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.X..X........................................X.............X] duration: 866.176539ms FAIL (2025-08-12 02:03:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 02:03:55.034877652 (80h37m49.465957793s) [upload=83990]: Starting upload Aug 12 02:03:55.034922467 (80h37m49.466002598s) [upload=83990]: Done starting upload Aug 12 02:03:55.034980067 (80h37m49.466060198s) [upload=83990]: Uploading segments... Aug 12 02:03:55.035018181 (80h37m49.466098312s) [upload=83990]: Got next segment. Inline: true Aug 12 02:03:55.035022990 (80h37m49.466103121s) [upload=83990]: Waiting for error group managing segments... Aug 12 02:03:55.035061152 (80h37m49.466141293s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 02:03:55.035065550 (80h37m49.466145682s) [upload=83990]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 02:03:55.035068277 (80h37m49.466148418s) [upload=83990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 02:03:55.250437174 (80h37m49.681517305s) [upload=83990]: Done uploading segments... Aug 12 02:03:55.250457433 (80h37m49.681537564s) [upload=83990]: Upload finished. err: metaclient: Too Many Requests Duration:* 866.194284ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)