Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X..................X.................X....................] duration: 5.848992036s FAIL (2025-08-09 03:38:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:24:14.228326086 (9h58m8.659406217s) [upload=10413]: Starting upload Aug 9 03:24:14.228376623 (9h58m8.659456754s) [upload=10413]: Done starting upload Aug 9 03:24:14.228531360 (9h58m8.659611531s) [upload=10413]: Uploading segments... Aug 9 03:24:14.228699671 (9h58m8.659779802s) [upload=10413]: Got next segment. Inline: false Aug 9 03:24:14.228752933 (9h58m8.659833094s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:24:14.228759997 (9h58m8.659840138s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:24:14.687349067 (9h58m9.118429208s) [seg_pos={0 0}, upload=10413]: Begin upload segment... Aug 9 03:24:14.687397730 (9h58m9.118477861s) [seg_pos={0 0}, upload=10413]: Done begin upload segment. Aug 9 03:24:14.687427206 (9h58m9.118507338s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687436945 (9h58m9.118517086s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687828444 (9h58m9.118908575s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688139319 (9h58m9.11921945s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688439492 (9h58m9.119519634s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688447949 (9h58m9.11952808s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688790104 (9h58m9.119870235s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688800865 (9h58m9.119880996s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689065440 (9h58m9.120145571s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689088394 (9h58m9.120168515s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689359774 (9h58m9.120439905s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689375824 (9h58m9.120455955s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689602328 (9h58m9.120682459s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689659407 (9h58m9.120739538s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689971524 (9h58m9.121051655s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690166767 (9h58m9.121246899s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690230430 (9h58m9.121310551s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690731839 (9h58m9.12181197s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:15.853114587 (9h58m10.284194718s) [upload=10413]: Next returned nil segment Aug 9 03:24:15.853130628 (9h58m10.284210759s) [upload=10413]: Waiting for error group managing segments... Aug 9 03:24:16.150481430 (9h58m10.581561561s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.591032647 (9h58m11.022112768s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.592789358 (9h58m11.023869489s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.596957302 (9h58m11.028037433s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.597509168 (9h58m11.028589299s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.604094979 (9h58m11.03517511s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.605047942 (9h58m11.036128073s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.606641681 (9h58m11.037721812s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.660395378 (9h58m11.091475509s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.661987965 (9h58m11.093068096s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.666036521 (9h58m11.097116652s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.695180362 (9h58m11.126260493s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.703535378 (9h58m11.134615499s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704312815 (9h58m11.135392936s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704324839 (9h58m11.13540497s) [seg_pos={0 0}, upload=10413]: Segment reached optimal threshold of 14 pieces. Aug 9 03:24:16.704433627 (9h58m11.135513758s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSPtVhJPKYAb3Gj25ihyExNgkDCGo9QTDaFcEfXRfLdDz8nsh): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704523940 (9h58m11.135604071s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CrzYmDPm95TgyE7SHJsFVbL1JUTdwMmZVge4uEkSCbeP8iBEk): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704584936 (9h58m11.135665067s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125NsQhq7kRmTjKS8nuc51PZddApFEi5C38FzC5pEX2QrWYKzSW): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704595988 (9h58m11.135676119s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N5XGFCAo5JX9Wmgsgt2iarMQW3A6Q5rkdEEyBVx6beWDeC7WQ): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704643267 (9h58m11.135723399s) [seg_pos={0 0}, upload=10413]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:24:16.704731457 (9h58m11.135811588s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:24:16.704736316 (9h58m11.135816447s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:24:17.008678078 (9h58m11.439758199s) [upload=10413]: Done uploading segments... Aug 9 03:24:17.008697475 (9h58m11.439777606s) [upload=10413]: Upload finished. err: <nil> Duration: 5.849016325s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................................X....X] duration: 30.000964021s FAIL (2025-08-09 03:38:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000990262s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.....X.X.....X.....................X........................] duration: 1.879385444s FAIL (2025-08-09 03:38:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.879409369s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.208999589s FAIL (2025-08-09 03:38:02 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 2.209021362s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 754.120463ms FAIL (2025-08-09 03:37:55 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 754.149499ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X..................X.................X...................] duration: 5.800472515s FAIL (2025-08-09 03:37:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:24:14.228326086 (9h58m8.659406217s) [upload=10413]: Starting upload Aug 9 03:24:14.228376623 (9h58m8.659456754s) [upload=10413]: Done starting upload Aug 9 03:24:14.228531360 (9h58m8.659611531s) [upload=10413]: Uploading segments... Aug 9 03:24:14.228699671 (9h58m8.659779802s) [upload=10413]: Got next segment. Inline: false Aug 9 03:24:14.228752933 (9h58m8.659833094s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:24:14.228759997 (9h58m8.659840138s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:24:14.687349067 (9h58m9.118429208s) [seg_pos={0 0}, upload=10413]: Begin upload segment... Aug 9 03:24:14.687397730 (9h58m9.118477861s) [seg_pos={0 0}, upload=10413]: Done begin upload segment. Aug 9 03:24:14.687427206 (9h58m9.118507338s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687436945 (9h58m9.118517086s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687828444 (9h58m9.118908575s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688139319 (9h58m9.11921945s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688439492 (9h58m9.119519634s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688447949 (9h58m9.11952808s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688790104 (9h58m9.119870235s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688800865 (9h58m9.119880996s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689065440 (9h58m9.120145571s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689088394 (9h58m9.120168515s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689359774 (9h58m9.120439905s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689375824 (9h58m9.120455955s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689602328 (9h58m9.120682459s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689659407 (9h58m9.120739538s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689971524 (9h58m9.121051655s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690166767 (9h58m9.121246899s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690230430 (9h58m9.121310551s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690731839 (9h58m9.12181197s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:15.853114587 (9h58m10.284194718s) [upload=10413]: Next returned nil segment Aug 9 03:24:15.853130628 (9h58m10.284210759s) [upload=10413]: Waiting for error group managing segments... Aug 9 03:24:16.150481430 (9h58m10.581561561s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.591032647 (9h58m11.022112768s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.592789358 (9h58m11.023869489s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.596957302 (9h58m11.028037433s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.597509168 (9h58m11.028589299s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.604094979 (9h58m11.03517511s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.605047942 (9h58m11.036128073s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.606641681 (9h58m11.037721812s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.660395378 (9h58m11.091475509s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.661987965 (9h58m11.093068096s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.666036521 (9h58m11.097116652s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.695180362 (9h58m11.126260493s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.703535378 (9h58m11.134615499s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704312815 (9h58m11.135392936s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704324839 (9h58m11.13540497s) [seg_pos={0 0}, upload=10413]: Segment reached optimal threshold of 14 pieces. Aug 9 03:24:16.704433627 (9h58m11.135513758s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSPtVhJPKYAb3Gj25ihyExNgkDCGo9QTDaFcEfXRfLdDz8nsh): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704523940 (9h58m11.135604071s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CrzYmDPm95TgyE7SHJsFVbL1JUTdwMmZVge4uEkSCbeP8iBEk): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704584936 (9h58m11.135665067s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125NsQhq7kRmTjKS8nuc51PZddApFEi5C38FzC5pEX2QrWYKzSW): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704595988 (9h58m11.135676119s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N5XGFCAo5JX9Wmgsgt2iarMQW3A6Q5rkdEEyBVx6beWDeC7WQ): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704643267 (9h58m11.135723399s) [seg_pos={0 0}, upload=10413]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:24:16.704731457 (9h58m11.135811588s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:24:16.704736316 (9h58m11.135816447s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:24:17.008678078 (9h58m11.439758199s) [upload=10413]: Done uploading segments... Aug 9 03:24:17.008697475 (9h58m11.439777606s) [upload=10413]: Upload finished. err: <nil> Duration: 5.800495488s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 764.726045ms FAIL (2025-08-09 03:37:20 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 764.760701ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [......X.X.....X.....................X.......................] duration: 1.846475034s FAIL (2025-08-09 03:37:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.846513789s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.480422672s FAIL (2025-08-09 03:36:54 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 2.48044807s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 7.502675102s FAIL (2025-08-09 03:36:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.502698947s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X..................X.................X..................] duration: 5.804941857s FAIL (2025-08-09 03:36:50 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:24:14.228326086 (9h58m8.659406217s) [upload=10413]: Starting upload Aug 9 03:24:14.228376623 (9h58m8.659456754s) [upload=10413]: Done starting upload Aug 9 03:24:14.228531360 (9h58m8.659611531s) [upload=10413]: Uploading segments... Aug 9 03:24:14.228699671 (9h58m8.659779802s) [upload=10413]: Got next segment. Inline: false Aug 9 03:24:14.228752933 (9h58m8.659833094s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:24:14.228759997 (9h58m8.659840138s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:24:14.687349067 (9h58m9.118429208s) [seg_pos={0 0}, upload=10413]: Begin upload segment... Aug 9 03:24:14.687397730 (9h58m9.118477861s) [seg_pos={0 0}, upload=10413]: Done begin upload segment. Aug 9 03:24:14.687427206 (9h58m9.118507338s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687436945 (9h58m9.118517086s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687828444 (9h58m9.118908575s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688139319 (9h58m9.11921945s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688439492 (9h58m9.119519634s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688447949 (9h58m9.11952808s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688790104 (9h58m9.119870235s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688800865 (9h58m9.119880996s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689065440 (9h58m9.120145571s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689088394 (9h58m9.120168515s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689359774 (9h58m9.120439905s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689375824 (9h58m9.120455955s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689602328 (9h58m9.120682459s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689659407 (9h58m9.120739538s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689971524 (9h58m9.121051655s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690166767 (9h58m9.121246899s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690230430 (9h58m9.121310551s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690731839 (9h58m9.12181197s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:15.853114587 (9h58m10.284194718s) [upload=10413]: Next returned nil segment Aug 9 03:24:15.853130628 (9h58m10.284210759s) [upload=10413]: Waiting for error group managing segments... Aug 9 03:24:16.150481430 (9h58m10.581561561s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.591032647 (9h58m11.022112768s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.592789358 (9h58m11.023869489s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.596957302 (9h58m11.028037433s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.597509168 (9h58m11.028589299s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.604094979 (9h58m11.03517511s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.605047942 (9h58m11.036128073s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.606641681 (9h58m11.037721812s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.660395378 (9h58m11.091475509s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.661987965 (9h58m11.093068096s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.666036521 (9h58m11.097116652s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.695180362 (9h58m11.126260493s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.703535378 (9h58m11.134615499s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704312815 (9h58m11.135392936s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704324839 (9h58m11.13540497s) [seg_pos={0 0}, upload=10413]: Segment reached optimal threshold of 14 pieces. Aug 9 03:24:16.704433627 (9h58m11.135513758s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSPtVhJPKYAb3Gj25ihyExNgkDCGo9QTDaFcEfXRfLdDz8nsh): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704523940 (9h58m11.135604071s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CrzYmDPm95TgyE7SHJsFVbL1JUTdwMmZVge4uEkSCbeP8iBEk): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704584936 (9h58m11.135665067s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125NsQhq7kRmTjKS8nuc51PZddApFEi5C38FzC5pEX2QrWYKzSW): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704595988 (9h58m11.135676119s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N5XGFCAo5JX9Wmgsgt2iarMQW3A6Q5rkdEEyBVx6beWDeC7WQ): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704643267 (9h58m11.135723399s) [seg_pos={0 0}, upload=10413]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:24:16.704731457 (9h58m11.135811588s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:24:16.704736316 (9h58m11.135816447s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:24:17.008678078 (9h58m11.439758199s) [upload=10413]: Done uploading segments... Aug 9 03:24:17.008697475 (9h58m11.439777606s) [upload=10413]: Upload finished. err: <nil> Duration: 5.804971975s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 739.670885ms FAIL (2025-08-09 03:36:16 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 739.707275ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X..................X.................X.................] duration: 5.963778577s FAIL (2025-08-09 03:36:07 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:24:14.228326086 (9h58m8.659406217s) [upload=10413]: Starting upload Aug 9 03:24:14.228376623 (9h58m8.659456754s) [upload=10413]: Done starting upload Aug 9 03:24:14.228531360 (9h58m8.659611531s) [upload=10413]: Uploading segments... Aug 9 03:24:14.228699671 (9h58m8.659779802s) [upload=10413]: Got next segment. Inline: false Aug 9 03:24:14.228752933 (9h58m8.659833094s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:24:14.228759997 (9h58m8.659840138s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:24:14.687349067 (9h58m9.118429208s) [seg_pos={0 0}, upload=10413]: Begin upload segment... Aug 9 03:24:14.687397730 (9h58m9.118477861s) [seg_pos={0 0}, upload=10413]: Done begin upload segment. Aug 9 03:24:14.687427206 (9h58m9.118507338s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687436945 (9h58m9.118517086s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687828444 (9h58m9.118908575s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688139319 (9h58m9.11921945s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688439492 (9h58m9.119519634s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688447949 (9h58m9.11952808s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688790104 (9h58m9.119870235s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688800865 (9h58m9.119880996s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689065440 (9h58m9.120145571s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689088394 (9h58m9.120168515s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689359774 (9h58m9.120439905s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689375824 (9h58m9.120455955s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689602328 (9h58m9.120682459s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689659407 (9h58m9.120739538s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689971524 (9h58m9.121051655s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690166767 (9h58m9.121246899s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690230430 (9h58m9.121310551s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690731839 (9h58m9.12181197s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:15.853114587 (9h58m10.284194718s) [upload=10413]: Next returned nil segment Aug 9 03:24:15.853130628 (9h58m10.284210759s) [upload=10413]: Waiting for error group managing segments... Aug 9 03:24:16.150481430 (9h58m10.581561561s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.591032647 (9h58m11.022112768s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.592789358 (9h58m11.023869489s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.596957302 (9h58m11.028037433s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.597509168 (9h58m11.028589299s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.604094979 (9h58m11.03517511s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.605047942 (9h58m11.036128073s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.606641681 (9h58m11.037721812s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.660395378 (9h58m11.091475509s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.661987965 (9h58m11.093068096s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.666036521 (9h58m11.097116652s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.695180362 (9h58m11.126260493s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.703535378 (9h58m11.134615499s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704312815 (9h58m11.135392936s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704324839 (9h58m11.13540497s) [seg_pos={0 0}, upload=10413]: Segment reached optimal threshold of 14 pieces. Aug 9 03:24:16.704433627 (9h58m11.135513758s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSPtVhJPKYAb3Gj25ihyExNgkDCGo9QTDaFcEfXRfLdDz8nsh): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704523940 (9h58m11.135604071s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CrzYmDPm95TgyE7SHJsFVbL1JUTdwMmZVge4uEkSCbeP8iBEk): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704584936 (9h58m11.135665067s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125NsQhq7kRmTjKS8nuc51PZddApFEi5C38FzC5pEX2QrWYKzSW): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704595988 (9h58m11.135676119s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N5XGFCAo5JX9Wmgsgt2iarMQW3A6Q5rkdEEyBVx6beWDeC7WQ): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704643267 (9h58m11.135723399s) [seg_pos={0 0}, upload=10413]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:24:16.704731457 (9h58m11.135811588s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:24:16.704736316 (9h58m11.135816447s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:24:17.008678078 (9h58m11.439758199s) [upload=10413]: Done uploading segments... Aug 9 03:24:17.008697475 (9h58m11.439777606s) [upload=10413]: Upload finished. err: <nil> Duration: 5.963810078s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.......X.X.....X.....................X......................] duration: 1.866102028s FAIL (2025-08-09 03:36:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.866129892s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.406854401s FAIL (2025-08-09 03:36:00 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 2.406875481s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 9.395368502s FAIL (2025-08-09 03:35:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.395388149s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X..................X.................X................] duration: 6.592426185s FAIL (2025-08-09 03:35:44 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:24:14.228326086 (9h58m8.659406217s) [upload=10413]: Starting upload Aug 9 03:24:14.228376623 (9h58m8.659456754s) [upload=10413]: Done starting upload Aug 9 03:24:14.228531360 (9h58m8.659611531s) [upload=10413]: Uploading segments... Aug 9 03:24:14.228699671 (9h58m8.659779802s) [upload=10413]: Got next segment. Inline: false Aug 9 03:24:14.228752933 (9h58m8.659833094s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:24:14.228759997 (9h58m8.659840138s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:24:14.687349067 (9h58m9.118429208s) [seg_pos={0 0}, upload=10413]: Begin upload segment... Aug 9 03:24:14.687397730 (9h58m9.118477861s) [seg_pos={0 0}, upload=10413]: Done begin upload segment. Aug 9 03:24:14.687427206 (9h58m9.118507338s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687436945 (9h58m9.118517086s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687828444 (9h58m9.118908575s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688139319 (9h58m9.11921945s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688439492 (9h58m9.119519634s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688447949 (9h58m9.11952808s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688790104 (9h58m9.119870235s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688800865 (9h58m9.119880996s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689065440 (9h58m9.120145571s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689088394 (9h58m9.120168515s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689359774 (9h58m9.120439905s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689375824 (9h58m9.120455955s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689602328 (9h58m9.120682459s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689659407 (9h58m9.120739538s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689971524 (9h58m9.121051655s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690166767 (9h58m9.121246899s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690230430 (9h58m9.121310551s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690731839 (9h58m9.12181197s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:15.853114587 (9h58m10.284194718s) [upload=10413]: Next returned nil segment Aug 9 03:24:15.853130628 (9h58m10.284210759s) [upload=10413]: Waiting for error group managing segments... Aug 9 03:24:16.150481430 (9h58m10.581561561s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.591032647 (9h58m11.022112768s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.592789358 (9h58m11.023869489s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.596957302 (9h58m11.028037433s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.597509168 (9h58m11.028589299s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.604094979 (9h58m11.03517511s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.605047942 (9h58m11.036128073s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.606641681 (9h58m11.037721812s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.660395378 (9h58m11.091475509s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.661987965 (9h58m11.093068096s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.666036521 (9h58m11.097116652s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.695180362 (9h58m11.126260493s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.703535378 (9h58m11.134615499s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704312815 (9h58m11.135392936s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704324839 (9h58m11.13540497s) [seg_pos={0 0}, upload=10413]: Segment reached optimal threshold of 14 pieces. Aug 9 03:24:16.704433627 (9h58m11.135513758s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSPtVhJPKYAb3Gj25ihyExNgkDCGo9QTDaFcEfXRfLdDz8nsh): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704523940 (9h58m11.135604071s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CrzYmDPm95TgyE7SHJsFVbL1JUTdwMmZVge4uEkSCbeP8iBEk): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704584936 (9h58m11.135665067s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125NsQhq7kRmTjKS8nuc51PZddApFEi5C38FzC5pEX2QrWYKzSW): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704595988 (9h58m11.135676119s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N5XGFCAo5JX9Wmgsgt2iarMQW3A6Q5rkdEEyBVx6beWDeC7WQ): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704643267 (9h58m11.135723399s) [seg_pos={0 0}, upload=10413]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:24:16.704731457 (9h58m11.135811588s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:24:16.704736316 (9h58m11.135816447s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:24:17.008678078 (9h58m11.439758199s) [upload=10413]: Done uploading segments... Aug 9 03:24:17.008697475 (9h58m11.439777606s) [upload=10413]: Upload finished. err: <nil> Duration: 6.59244937s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 762.249458ms FAIL (2025-08-09 03:35:43 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 762.281148ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 9.165993394s FAIL (2025-08-09 03:35:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.166021167s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X..................X.................X...............] duration: 5.929610537s FAIL (2025-08-09 03:35:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:24:14.228326086 (9h58m8.659406217s) [upload=10413]: Starting upload Aug 9 03:24:14.228376623 (9h58m8.659456754s) [upload=10413]: Done starting upload Aug 9 03:24:14.228531360 (9h58m8.659611531s) [upload=10413]: Uploading segments... Aug 9 03:24:14.228699671 (9h58m8.659779802s) [upload=10413]: Got next segment. Inline: false Aug 9 03:24:14.228752933 (9h58m8.659833094s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:24:14.228759997 (9h58m8.659840138s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:24:14.687349067 (9h58m9.118429208s) [seg_pos={0 0}, upload=10413]: Begin upload segment... Aug 9 03:24:14.687397730 (9h58m9.118477861s) [seg_pos={0 0}, upload=10413]: Done begin upload segment. Aug 9 03:24:14.687427206 (9h58m9.118507338s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687436945 (9h58m9.118517086s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687828444 (9h58m9.118908575s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688139319 (9h58m9.11921945s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688439492 (9h58m9.119519634s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688447949 (9h58m9.11952808s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688790104 (9h58m9.119870235s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688800865 (9h58m9.119880996s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689065440 (9h58m9.120145571s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689088394 (9h58m9.120168515s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689359774 (9h58m9.120439905s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689375824 (9h58m9.120455955s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689602328 (9h58m9.120682459s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689659407 (9h58m9.120739538s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689971524 (9h58m9.121051655s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690166767 (9h58m9.121246899s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690230430 (9h58m9.121310551s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690731839 (9h58m9.12181197s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:15.853114587 (9h58m10.284194718s) [upload=10413]: Next returned nil segment Aug 9 03:24:15.853130628 (9h58m10.284210759s) [upload=10413]: Waiting for error group managing segments... Aug 9 03:24:16.150481430 (9h58m10.581561561s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.591032647 (9h58m11.022112768s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.592789358 (9h58m11.023869489s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.596957302 (9h58m11.028037433s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.597509168 (9h58m11.028589299s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.604094979 (9h58m11.03517511s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.605047942 (9h58m11.036128073s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.606641681 (9h58m11.037721812s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.660395378 (9h58m11.091475509s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.661987965 (9h58m11.093068096s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.666036521 (9h58m11.097116652s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.695180362 (9h58m11.126260493s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.703535378 (9h58m11.134615499s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704312815 (9h58m11.135392936s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704324839 (9h58m11.13540497s) [seg_pos={0 0}, upload=10413]: Segment reached optimal threshold of 14 pieces. Aug 9 03:24:16.704433627 (9h58m11.135513758s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSPtVhJPKYAb3Gj25ihyExNgkDCGo9QTDaFcEfXRfLdDz8nsh): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704523940 (9h58m11.135604071s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CrzYmDPm95TgyE7SHJsFVbL1JUTdwMmZVge4uEkSCbeP8iBEk): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704584936 (9h58m11.135665067s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125NsQhq7kRmTjKS8nuc51PZddApFEi5C38FzC5pEX2QrWYKzSW): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704595988 (9h58m11.135676119s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N5XGFCAo5JX9Wmgsgt2iarMQW3A6Q5rkdEEyBVx6beWDeC7WQ): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704643267 (9h58m11.135723399s) [seg_pos={0 0}, upload=10413]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:24:16.704731457 (9h58m11.135811588s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:24:16.704736316 (9h58m11.135816447s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:24:17.008678078 (9h58m11.439758199s) [upload=10413]: Done uploading segments... Aug 9 03:24:17.008697475 (9h58m11.439777606s) [upload=10413]: Upload finished. err: <nil> Duration: 5.929638039s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [........X.X.....X.....................X.....................] duration: 1.845672219s FAIL (2025-08-09 03:35:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.845712616s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.386880842s FAIL (2025-08-09 03:35:03 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 2.386909958s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.........X.X.....X.....................X....................] duration: 1.981099721s FAIL (2025-08-09 03:34:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.981123828s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 809.825648ms FAIL (2025-08-09 03:34:37 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 809.85299ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.3981434s FAIL (2025-08-09 03:34:27 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 2.398167086s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X..................X.................X..............] duration: 5.938193586s FAIL (2025-08-09 03:34:18 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:24:14.228326086 (9h58m8.659406217s) [upload=10413]: Starting upload Aug 9 03:24:14.228376623 (9h58m8.659456754s) [upload=10413]: Done starting upload Aug 9 03:24:14.228531360 (9h58m8.659611531s) [upload=10413]: Uploading segments... Aug 9 03:24:14.228699671 (9h58m8.659779802s) [upload=10413]: Got next segment. Inline: false Aug 9 03:24:14.228752933 (9h58m8.659833094s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:24:14.228759997 (9h58m8.659840138s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:24:14.687349067 (9h58m9.118429208s) [seg_pos={0 0}, upload=10413]: Begin upload segment... Aug 9 03:24:14.687397730 (9h58m9.118477861s) [seg_pos={0 0}, upload=10413]: Done begin upload segment. Aug 9 03:24:14.687427206 (9h58m9.118507338s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687436945 (9h58m9.118517086s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687828444 (9h58m9.118908575s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688139319 (9h58m9.11921945s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688439492 (9h58m9.119519634s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688447949 (9h58m9.11952808s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688790104 (9h58m9.119870235s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688800865 (9h58m9.119880996s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689065440 (9h58m9.120145571s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689088394 (9h58m9.120168515s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689359774 (9h58m9.120439905s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689375824 (9h58m9.120455955s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689602328 (9h58m9.120682459s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689659407 (9h58m9.120739538s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689971524 (9h58m9.121051655s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690166767 (9h58m9.121246899s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690230430 (9h58m9.121310551s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690731839 (9h58m9.12181197s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:15.853114587 (9h58m10.284194718s) [upload=10413]: Next returned nil segment Aug 9 03:24:15.853130628 (9h58m10.284210759s) [upload=10413]: Waiting for error group managing segments... Aug 9 03:24:16.150481430 (9h58m10.581561561s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.591032647 (9h58m11.022112768s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.592789358 (9h58m11.023869489s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.596957302 (9h58m11.028037433s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.597509168 (9h58m11.028589299s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.604094979 (9h58m11.03517511s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.605047942 (9h58m11.036128073s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.606641681 (9h58m11.037721812s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.660395378 (9h58m11.091475509s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.661987965 (9h58m11.093068096s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.666036521 (9h58m11.097116652s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.695180362 (9h58m11.126260493s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.703535378 (9h58m11.134615499s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704312815 (9h58m11.135392936s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704324839 (9h58m11.13540497s) [seg_pos={0 0}, upload=10413]: Segment reached optimal threshold of 14 pieces. Aug 9 03:24:16.704433627 (9h58m11.135513758s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSPtVhJPKYAb3Gj25ihyExNgkDCGo9QTDaFcEfXRfLdDz8nsh): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704523940 (9h58m11.135604071s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CrzYmDPm95TgyE7SHJsFVbL1JUTdwMmZVge4uEkSCbeP8iBEk): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704584936 (9h58m11.135665067s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125NsQhq7kRmTjKS8nuc51PZddApFEi5C38FzC5pEX2QrWYKzSW): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704595988 (9h58m11.135676119s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N5XGFCAo5JX9Wmgsgt2iarMQW3A6Q5rkdEEyBVx6beWDeC7WQ): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704643267 (9h58m11.135723399s) [seg_pos={0 0}, upload=10413]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:24:16.704731457 (9h58m11.135811588s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:24:16.704736316 (9h58m11.135816447s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:24:17.008678078 (9h58m11.439758199s) [upload=10413]: Done uploading segments... Aug 9 03:24:17.008697475 (9h58m11.439777606s) [upload=10413]: Upload finished. err: <nil> Duration: 5.938219034s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..........X.X.....X.....................X...................] duration: 1.939253704s FAIL (2025-08-09 03:34:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.939301376s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 7.589682031s FAIL (2025-08-09 03:34:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.589693913s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 11.807631582s FAIL (2025-08-09 03:34:01 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 11.807647093s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.000614688s FAIL (2025-08-09 03:33:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000634747s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X..................X.................X.............] duration: 5.589841377s FAIL (2025-08-09 03:33:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:24:14.228326086 (9h58m8.659406217s) [upload=10413]: Starting upload Aug 9 03:24:14.228376623 (9h58m8.659456754s) [upload=10413]: Done starting upload Aug 9 03:24:14.228531360 (9h58m8.659611531s) [upload=10413]: Uploading segments... Aug 9 03:24:14.228699671 (9h58m8.659779802s) [upload=10413]: Got next segment. Inline: false Aug 9 03:24:14.228752933 (9h58m8.659833094s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:24:14.228759997 (9h58m8.659840138s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:24:14.687349067 (9h58m9.118429208s) [seg_pos={0 0}, upload=10413]: Begin upload segment... Aug 9 03:24:14.687397730 (9h58m9.118477861s) [seg_pos={0 0}, upload=10413]: Done begin upload segment. Aug 9 03:24:14.687427206 (9h58m9.118507338s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687436945 (9h58m9.118517086s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687828444 (9h58m9.118908575s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688139319 (9h58m9.11921945s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688439492 (9h58m9.119519634s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688447949 (9h58m9.11952808s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688790104 (9h58m9.119870235s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688800865 (9h58m9.119880996s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689065440 (9h58m9.120145571s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689088394 (9h58m9.120168515s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689359774 (9h58m9.120439905s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689375824 (9h58m9.120455955s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689602328 (9h58m9.120682459s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689659407 (9h58m9.120739538s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689971524 (9h58m9.121051655s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690166767 (9h58m9.121246899s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690230430 (9h58m9.121310551s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690731839 (9h58m9.12181197s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:15.853114587 (9h58m10.284194718s) [upload=10413]: Next returned nil segment Aug 9 03:24:15.853130628 (9h58m10.284210759s) [upload=10413]: Waiting for error group managing segments... Aug 9 03:24:16.150481430 (9h58m10.581561561s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.591032647 (9h58m11.022112768s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.592789358 (9h58m11.023869489s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.596957302 (9h58m11.028037433s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.597509168 (9h58m11.028589299s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.604094979 (9h58m11.03517511s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.605047942 (9h58m11.036128073s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.606641681 (9h58m11.037721812s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.660395378 (9h58m11.091475509s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.661987965 (9h58m11.093068096s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.666036521 (9h58m11.097116652s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.695180362 (9h58m11.126260493s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.703535378 (9h58m11.134615499s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704312815 (9h58m11.135392936s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704324839 (9h58m11.13540497s) [seg_pos={0 0}, upload=10413]: Segment reached optimal threshold of 14 pieces. Aug 9 03:24:16.704433627 (9h58m11.135513758s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSPtVhJPKYAb3Gj25ihyExNgkDCGo9QTDaFcEfXRfLdDz8nsh): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704523940 (9h58m11.135604071s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CrzYmDPm95TgyE7SHJsFVbL1JUTdwMmZVge4uEkSCbeP8iBEk): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704584936 (9h58m11.135665067s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125NsQhq7kRmTjKS8nuc51PZddApFEi5C38FzC5pEX2QrWYKzSW): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704595988 (9h58m11.135676119s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N5XGFCAo5JX9Wmgsgt2iarMQW3A6Q5rkdEEyBVx6beWDeC7WQ): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704643267 (9h58m11.135723399s) [seg_pos={0 0}, upload=10413]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:24:16.704731457 (9h58m11.135811588s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:24:16.704736316 (9h58m11.135816447s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:24:17.008678078 (9h58m11.439758199s) [upload=10413]: Done uploading segments... Aug 9 03:24:17.008697475 (9h58m11.439777606s) [upload=10413]: Upload finished. err: <nil> Duration: 5.58986392s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 854.439802ms FAIL (2025-08-09 03:33:28 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 854.469038ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.456139009s FAIL (2025-08-09 03:33:18 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 2.45615433s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........X..................X.................X............] duration: 5.76680194s FAIL (2025-08-09 03:33:01 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:24:14.228326086 (9h58m8.659406217s) [upload=10413]: Starting upload Aug 9 03:24:14.228376623 (9h58m8.659456754s) [upload=10413]: Done starting upload Aug 9 03:24:14.228531360 (9h58m8.659611531s) [upload=10413]: Uploading segments... Aug 9 03:24:14.228699671 (9h58m8.659779802s) [upload=10413]: Got next segment. Inline: false Aug 9 03:24:14.228752933 (9h58m8.659833094s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:24:14.228759997 (9h58m8.659840138s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:24:14.687349067 (9h58m9.118429208s) [seg_pos={0 0}, upload=10413]: Begin upload segment... Aug 9 03:24:14.687397730 (9h58m9.118477861s) [seg_pos={0 0}, upload=10413]: Done begin upload segment. Aug 9 03:24:14.687427206 (9h58m9.118507338s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687436945 (9h58m9.118517086s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687828444 (9h58m9.118908575s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688139319 (9h58m9.11921945s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688439492 (9h58m9.119519634s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688447949 (9h58m9.11952808s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688790104 (9h58m9.119870235s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688800865 (9h58m9.119880996s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689065440 (9h58m9.120145571s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689088394 (9h58m9.120168515s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689359774 (9h58m9.120439905s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689375824 (9h58m9.120455955s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689602328 (9h58m9.120682459s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689659407 (9h58m9.120739538s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689971524 (9h58m9.121051655s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690166767 (9h58m9.121246899s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690230430 (9h58m9.121310551s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690731839 (9h58m9.12181197s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:15.853114587 (9h58m10.284194718s) [upload=10413]: Next returned nil segment Aug 9 03:24:15.853130628 (9h58m10.284210759s) [upload=10413]: Waiting for error group managing segments... Aug 9 03:24:16.150481430 (9h58m10.581561561s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.591032647 (9h58m11.022112768s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.592789358 (9h58m11.023869489s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.596957302 (9h58m11.028037433s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.597509168 (9h58m11.028589299s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.604094979 (9h58m11.03517511s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.605047942 (9h58m11.036128073s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.606641681 (9h58m11.037721812s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.660395378 (9h58m11.091475509s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.661987965 (9h58m11.093068096s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.666036521 (9h58m11.097116652s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.695180362 (9h58m11.126260493s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.703535378 (9h58m11.134615499s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704312815 (9h58m11.135392936s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704324839 (9h58m11.13540497s) [seg_pos={0 0}, upload=10413]: Segment reached optimal threshold of 14 pieces. Aug 9 03:24:16.704433627 (9h58m11.135513758s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSPtVhJPKYAb3Gj25ihyExNgkDCGo9QTDaFcEfXRfLdDz8nsh): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704523940 (9h58m11.135604071s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CrzYmDPm95TgyE7SHJsFVbL1JUTdwMmZVge4uEkSCbeP8iBEk): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704584936 (9h58m11.135665067s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125NsQhq7kRmTjKS8nuc51PZddApFEi5C38FzC5pEX2QrWYKzSW): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704595988 (9h58m11.135676119s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N5XGFCAo5JX9Wmgsgt2iarMQW3A6Q5rkdEEyBVx6beWDeC7WQ): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704643267 (9h58m11.135723399s) [seg_pos={0 0}, upload=10413]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:24:16.704731457 (9h58m11.135811588s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:24:16.704736316 (9h58m11.135816447s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:24:17.008678078 (9h58m11.439758199s) [upload=10413]: Done uploading segments... Aug 9 03:24:17.008697475 (9h58m11.439777606s) [upload=10413]: Upload finished. err: <nil> Duration: 5.766831218s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...........X.X.....X.....................X..................] duration: 1.934249732s FAIL (2025-08-09 03:32:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.934278276s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 3.047895209s FAIL (2025-08-09 03:32:37 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 3.047908755s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 732.086554ms FAIL (2025-08-09 03:32:37 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 732.128044ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........X..................X.................X...........] duration: 5.613758852s FAIL (2025-08-09 03:32:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:24:14.228326086 (9h58m8.659406217s) [upload=10413]: Starting upload Aug 9 03:24:14.228376623 (9h58m8.659456754s) [upload=10413]: Done starting upload Aug 9 03:24:14.228531360 (9h58m8.659611531s) [upload=10413]: Uploading segments... Aug 9 03:24:14.228699671 (9h58m8.659779802s) [upload=10413]: Got next segment. Inline: false Aug 9 03:24:14.228752933 (9h58m8.659833094s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:24:14.228759997 (9h58m8.659840138s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:24:14.687349067 (9h58m9.118429208s) [seg_pos={0 0}, upload=10413]: Begin upload segment... Aug 9 03:24:14.687397730 (9h58m9.118477861s) [seg_pos={0 0}, upload=10413]: Done begin upload segment. Aug 9 03:24:14.687427206 (9h58m9.118507338s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687436945 (9h58m9.118517086s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687828444 (9h58m9.118908575s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688139319 (9h58m9.11921945s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688439492 (9h58m9.119519634s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688447949 (9h58m9.11952808s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688790104 (9h58m9.119870235s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688800865 (9h58m9.119880996s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689065440 (9h58m9.120145571s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689088394 (9h58m9.120168515s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689359774 (9h58m9.120439905s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689375824 (9h58m9.120455955s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689602328 (9h58m9.120682459s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689659407 (9h58m9.120739538s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689971524 (9h58m9.121051655s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690166767 (9h58m9.121246899s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690230430 (9h58m9.121310551s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690731839 (9h58m9.12181197s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:15.853114587 (9h58m10.284194718s) [upload=10413]: Next returned nil segment Aug 9 03:24:15.853130628 (9h58m10.284210759s) [upload=10413]: Waiting for error group managing segments... Aug 9 03:24:16.150481430 (9h58m10.581561561s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.591032647 (9h58m11.022112768s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.592789358 (9h58m11.023869489s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.596957302 (9h58m11.028037433s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.597509168 (9h58m11.028589299s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.604094979 (9h58m11.03517511s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.605047942 (9h58m11.036128073s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.606641681 (9h58m11.037721812s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.660395378 (9h58m11.091475509s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.661987965 (9h58m11.093068096s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.666036521 (9h58m11.097116652s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.695180362 (9h58m11.126260493s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.703535378 (9h58m11.134615499s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704312815 (9h58m11.135392936s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704324839 (9h58m11.13540497s) [seg_pos={0 0}, upload=10413]: Segment reached optimal threshold of 14 pieces. Aug 9 03:24:16.704433627 (9h58m11.135513758s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSPtVhJPKYAb3Gj25ihyExNgkDCGo9QTDaFcEfXRfLdDz8nsh): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704523940 (9h58m11.135604071s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CrzYmDPm95TgyE7SHJsFVbL1JUTdwMmZVge4uEkSCbeP8iBEk): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704584936 (9h58m11.135665067s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125NsQhq7kRmTjKS8nuc51PZddApFEi5C38FzC5pEX2QrWYKzSW): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704595988 (9h58m11.135676119s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N5XGFCAo5JX9Wmgsgt2iarMQW3A6Q5rkdEEyBVx6beWDeC7WQ): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704643267 (9h58m11.135723399s) [seg_pos={0 0}, upload=10413]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:24:16.704731457 (9h58m11.135811588s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:24:16.704736316 (9h58m11.135816447s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:24:17.008678078 (9h58m11.439758199s) [upload=10413]: Done uploading segments... Aug 9 03:24:17.008697475 (9h58m11.439777606s) [upload=10413]: Upload finished. err: <nil> Duration: 5.613786865s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [............X.X.....X.....................X.................] duration: 1.825018389s FAIL (2025-08-09 03:32:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.825046233s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [............X..................X.................X..........] duration: 5.764067928s FAIL (2025-08-09 03:32:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:24:14.228326086 (9h58m8.659406217s) [upload=10413]: Starting upload Aug 9 03:24:14.228376623 (9h58m8.659456754s) [upload=10413]: Done starting upload Aug 9 03:24:14.228531360 (9h58m8.659611531s) [upload=10413]: Uploading segments... Aug 9 03:24:14.228699671 (9h58m8.659779802s) [upload=10413]: Got next segment. Inline: false Aug 9 03:24:14.228752933 (9h58m8.659833094s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:24:14.228759997 (9h58m8.659840138s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:24:14.687349067 (9h58m9.118429208s) [seg_pos={0 0}, upload=10413]: Begin upload segment... Aug 9 03:24:14.687397730 (9h58m9.118477861s) [seg_pos={0 0}, upload=10413]: Done begin upload segment. Aug 9 03:24:14.687427206 (9h58m9.118507338s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687436945 (9h58m9.118517086s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687828444 (9h58m9.118908575s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688139319 (9h58m9.11921945s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688439492 (9h58m9.119519634s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688447949 (9h58m9.11952808s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688790104 (9h58m9.119870235s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688800865 (9h58m9.119880996s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689065440 (9h58m9.120145571s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689088394 (9h58m9.120168515s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689359774 (9h58m9.120439905s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689375824 (9h58m9.120455955s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689602328 (9h58m9.120682459s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689659407 (9h58m9.120739538s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689971524 (9h58m9.121051655s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690166767 (9h58m9.121246899s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690230430 (9h58m9.121310551s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690731839 (9h58m9.12181197s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:15.853114587 (9h58m10.284194718s) [upload=10413]: Next returned nil segment Aug 9 03:24:15.853130628 (9h58m10.284210759s) [upload=10413]: Waiting for error group managing segments... Aug 9 03:24:16.150481430 (9h58m10.581561561s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.591032647 (9h58m11.022112768s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.592789358 (9h58m11.023869489s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.596957302 (9h58m11.028037433s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.597509168 (9h58m11.028589299s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.604094979 (9h58m11.03517511s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.605047942 (9h58m11.036128073s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.606641681 (9h58m11.037721812s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.660395378 (9h58m11.091475509s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.661987965 (9h58m11.093068096s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.666036521 (9h58m11.097116652s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.695180362 (9h58m11.126260493s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.703535378 (9h58m11.134615499s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704312815 (9h58m11.135392936s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704324839 (9h58m11.13540497s) [seg_pos={0 0}, upload=10413]: Segment reached optimal threshold of 14 pieces. Aug 9 03:24:16.704433627 (9h58m11.135513758s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSPtVhJPKYAb3Gj25ihyExNgkDCGo9QTDaFcEfXRfLdDz8nsh): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704523940 (9h58m11.135604071s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CrzYmDPm95TgyE7SHJsFVbL1JUTdwMmZVge4uEkSCbeP8iBEk): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704584936 (9h58m11.135665067s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125NsQhq7kRmTjKS8nuc51PZddApFEi5C38FzC5pEX2QrWYKzSW): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704595988 (9h58m11.135676119s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N5XGFCAo5JX9Wmgsgt2iarMQW3A6Q5rkdEEyBVx6beWDeC7WQ): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704643267 (9h58m11.135723399s) [seg_pos={0 0}, upload=10413]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:24:16.704731457 (9h58m11.135811588s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:24:16.704736316 (9h58m11.135816447s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:24:17.008678078 (9h58m11.439758199s) [upload=10413]: Done uploading segments... Aug 9 03:24:17.008697475 (9h58m11.439777606s) [upload=10413]: Upload finished. err: <nil> Duration: 5.764101171s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.............X.X.....X.....................X................] duration: 1.833583507s FAIL (2025-08-09 03:32:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.833613415s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............X..................X.................X.........] duration: 5.789567616s FAIL (2025-08-09 03:32:01 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:24:14.228326086 (9h58m8.659406217s) [upload=10413]: Starting upload Aug 9 03:24:14.228376623 (9h58m8.659456754s) [upload=10413]: Done starting upload Aug 9 03:24:14.228531360 (9h58m8.659611531s) [upload=10413]: Uploading segments... Aug 9 03:24:14.228699671 (9h58m8.659779802s) [upload=10413]: Got next segment. Inline: false Aug 9 03:24:14.228752933 (9h58m8.659833094s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:24:14.228759997 (9h58m8.659840138s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:24:14.687349067 (9h58m9.118429208s) [seg_pos={0 0}, upload=10413]: Begin upload segment... Aug 9 03:24:14.687397730 (9h58m9.118477861s) [seg_pos={0 0}, upload=10413]: Done begin upload segment. Aug 9 03:24:14.687427206 (9h58m9.118507338s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687436945 (9h58m9.118517086s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687828444 (9h58m9.118908575s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688139319 (9h58m9.11921945s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688439492 (9h58m9.119519634s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688447949 (9h58m9.11952808s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688790104 (9h58m9.119870235s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688800865 (9h58m9.119880996s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689065440 (9h58m9.120145571s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689088394 (9h58m9.120168515s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689359774 (9h58m9.120439905s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689375824 (9h58m9.120455955s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689602328 (9h58m9.120682459s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689659407 (9h58m9.120739538s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689971524 (9h58m9.121051655s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690166767 (9h58m9.121246899s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690230430 (9h58m9.121310551s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690731839 (9h58m9.12181197s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:15.853114587 (9h58m10.284194718s) [upload=10413]: Next returned nil segment Aug 9 03:24:15.853130628 (9h58m10.284210759s) [upload=10413]: Waiting for error group managing segments... Aug 9 03:24:16.150481430 (9h58m10.581561561s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.591032647 (9h58m11.022112768s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.592789358 (9h58m11.023869489s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.596957302 (9h58m11.028037433s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.597509168 (9h58m11.028589299s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.604094979 (9h58m11.03517511s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.605047942 (9h58m11.036128073s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.606641681 (9h58m11.037721812s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.660395378 (9h58m11.091475509s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.661987965 (9h58m11.093068096s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.666036521 (9h58m11.097116652s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.695180362 (9h58m11.126260493s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.703535378 (9h58m11.134615499s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704312815 (9h58m11.135392936s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704324839 (9h58m11.13540497s) [seg_pos={0 0}, upload=10413]: Segment reached optimal threshold of 14 pieces. Aug 9 03:24:16.704433627 (9h58m11.135513758s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSPtVhJPKYAb3Gj25ihyExNgkDCGo9QTDaFcEfXRfLdDz8nsh): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704523940 (9h58m11.135604071s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CrzYmDPm95TgyE7SHJsFVbL1JUTdwMmZVge4uEkSCbeP8iBEk): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704584936 (9h58m11.135665067s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125NsQhq7kRmTjKS8nuc51PZddApFEi5C38FzC5pEX2QrWYKzSW): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704595988 (9h58m11.135676119s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N5XGFCAo5JX9Wmgsgt2iarMQW3A6Q5rkdEEyBVx6beWDeC7WQ): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704643267 (9h58m11.135723399s) [seg_pos={0 0}, upload=10413]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:24:16.704731457 (9h58m11.135811588s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:24:16.704736316 (9h58m11.135816447s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:24:17.008678078 (9h58m11.439758199s) [upload=10413]: Done uploading segments... Aug 9 03:24:17.008697475 (9h58m11.439777606s) [upload=10413]: Upload finished. err: <nil> Duration: 5.789589358s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.389115897s FAIL (2025-08-09 03:31:45 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 2.389137127s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 740.500313ms FAIL (2025-08-09 03:31:31 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 740.553004ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..............X.X.....X.....................X...............] duration: 1.860246166s FAIL (2025-08-09 03:31:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.86027471s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 24.454564186s FAIL (2025-08-09 03:31:18 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 24.45458101s edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............X..................X.................X........] duration: 5.672245451s FAIL (2025-08-09 03:30:57 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:24:14.228326086 (9h58m8.659406217s) [upload=10413]: Starting upload Aug 9 03:24:14.228376623 (9h58m8.659456754s) [upload=10413]: Done starting upload Aug 9 03:24:14.228531360 (9h58m8.659611531s) [upload=10413]: Uploading segments... Aug 9 03:24:14.228699671 (9h58m8.659779802s) [upload=10413]: Got next segment. Inline: false Aug 9 03:24:14.228752933 (9h58m8.659833094s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:24:14.228759997 (9h58m8.659840138s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:24:14.687349067 (9h58m9.118429208s) [seg_pos={0 0}, upload=10413]: Begin upload segment... Aug 9 03:24:14.687397730 (9h58m9.118477861s) [seg_pos={0 0}, upload=10413]: Done begin upload segment. Aug 9 03:24:14.687427206 (9h58m9.118507338s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687436945 (9h58m9.118517086s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687828444 (9h58m9.118908575s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688139319 (9h58m9.11921945s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688439492 (9h58m9.119519634s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688447949 (9h58m9.11952808s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688790104 (9h58m9.119870235s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688800865 (9h58m9.119880996s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689065440 (9h58m9.120145571s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689088394 (9h58m9.120168515s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689359774 (9h58m9.120439905s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689375824 (9h58m9.120455955s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689602328 (9h58m9.120682459s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689659407 (9h58m9.120739538s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689971524 (9h58m9.121051655s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690166767 (9h58m9.121246899s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690230430 (9h58m9.121310551s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690731839 (9h58m9.12181197s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:15.853114587 (9h58m10.284194718s) [upload=10413]: Next returned nil segment Aug 9 03:24:15.853130628 (9h58m10.284210759s) [upload=10413]: Waiting for error group managing segments... Aug 9 03:24:16.150481430 (9h58m10.581561561s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.591032647 (9h58m11.022112768s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.592789358 (9h58m11.023869489s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.596957302 (9h58m11.028037433s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.597509168 (9h58m11.028589299s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.604094979 (9h58m11.03517511s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.605047942 (9h58m11.036128073s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.606641681 (9h58m11.037721812s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.660395378 (9h58m11.091475509s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.661987965 (9h58m11.093068096s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.666036521 (9h58m11.097116652s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.695180362 (9h58m11.126260493s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.703535378 (9h58m11.134615499s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704312815 (9h58m11.135392936s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704324839 (9h58m11.13540497s) [seg_pos={0 0}, upload=10413]: Segment reached optimal threshold of 14 pieces. Aug 9 03:24:16.704433627 (9h58m11.135513758s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSPtVhJPKYAb3Gj25ihyExNgkDCGo9QTDaFcEfXRfLdDz8nsh): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704523940 (9h58m11.135604071s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CrzYmDPm95TgyE7SHJsFVbL1JUTdwMmZVge4uEkSCbeP8iBEk): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704584936 (9h58m11.135665067s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125NsQhq7kRmTjKS8nuc51PZddApFEi5C38FzC5pEX2QrWYKzSW): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704595988 (9h58m11.135676119s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N5XGFCAo5JX9Wmgsgt2iarMQW3A6Q5rkdEEyBVx6beWDeC7WQ): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704643267 (9h58m11.135723399s) [seg_pos={0 0}, upload=10413]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:24:16.704731457 (9h58m11.135811588s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:24:16.704736316 (9h58m11.135816447s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:24:17.008678078 (9h58m11.439758199s) [upload=10413]: Done uploading segments... Aug 9 03:24:17.008697475 (9h58m11.439777606s) [upload=10413]: Upload finished. err: <nil> Duration: 5.672269977s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...............X.X.....X.....................X..............] duration: 1.892962793s FAIL (2025-08-09 03:30:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.892984625s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.418226668s FAIL (2025-08-09 03:30:45 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 2.418248399s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 794.253375ms FAIL (2025-08-09 03:30:25 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 794.269324ms edge authservice http us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)