Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [XX..........................................................] duration: 7.73074852s FAIL (2025-08-13 04:04:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.730772106s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 1.825287961s FAIL (2025-08-13 04:04:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.825321254s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........X............................X...................] duration: 5.643153285s FAIL (2025-08-13 04:04:09 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 5.643171801s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.XX.........................................................] duration: 8.547551608s FAIL (2025-08-13 04:04:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.547574292s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.213224483s FAIL (2025-08-13 04:03:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.213252245s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..XX........................................................] duration: 12.497857767s FAIL (2025-08-13 04:03:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 12.497883547s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............X............................X..................] duration: 6.129310285s FAIL (2025-08-13 04:03:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 6.129337517s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 1.844805746s FAIL (2025-08-13 04:02:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.8448387s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...XX.......................................................] duration: 8.259117497s FAIL (2025-08-13 04:02:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.25914015s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.098379368s FAIL (2025-08-13 04:02:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.098412281s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....XX......................................................] duration: 7.678321416s FAIL (2025-08-13 04:02:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.678343498s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X............................X.................] duration: 5.721600331s FAIL (2025-08-13 04:01:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 5.721628554s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 1.837311397s FAIL (2025-08-13 04:01:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.837347466s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............X............................X................] duration: 6.072970893s FAIL (2025-08-13 04:01:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 6.072996141s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.092369318s FAIL (2025-08-13 04:01:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.092402661s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............X............................X...............] duration: 5.98951478s FAIL (2025-08-13 04:00:59 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 5.989550448s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration: 7.999592106s FAIL (2025-08-13 04:00:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.999615911s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 1.944991624s FAIL (2025-08-13 04:00:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.945016511s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X............................X..............] duration: 6.062374414s FAIL (2025-08-13 04:00:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 6.062391668s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 1.873320473s FAIL (2025-08-13 04:00:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.873355519s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [X.....XX....................................................] duration: 7.440049997s FAIL (2025-08-13 03:59:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.440072079s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X.....XX...................................................] duration: 7.707075079s FAIL (2025-08-13 03:59:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.707264892s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 1.88306005s FAIL (2025-08-13 03:59:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.883092471s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................X............................X.............] duration: 5.845375452s FAIL (2025-08-13 03:59:19 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 5.845394077s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X.....XX..................................................] duration: 7.611347342s FAIL (2025-08-13 03:59:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.611395775s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................X............................X............] duration: 5.911056353s FAIL (2025-08-13 03:59:00 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 5.911082283s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.048585185s FAIL (2025-08-13 03:58:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.048610091s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X.....XX.................................................] duration: 11.179917059s FAIL (2025-08-13 03:58:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 11.179935424s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................X............................X...........] duration: 5.787359773s FAIL (2025-08-13 03:58:00 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 5.78738905s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X.....XX................................................] duration: 7.620825273s FAIL (2025-08-13 03:57:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.620846323s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X...................X............................X..........] duration: 5.91557302s FAIL (2025-08-13 03:57:38 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 5.915600953s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 1.912869936s FAIL (2025-08-13 03:57:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.912897658s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X...................X............................X.........] duration: 6.379246029s FAIL (2025-08-13 03:57:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 6.379292878s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X.....XX...............................................] duration: 10.582131582s FAIL (2025-08-13 03:57:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 10.58215717s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 1.949502125s FAIL (2025-08-13 03:56:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.949529708s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X...................X............................X........] duration: 5.663525376s FAIL (2025-08-13 03:56:18 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 5.663600339s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 1.883910385s FAIL (2025-08-13 03:56:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.88395414s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X.....XX..............................................] duration: 8.112850996s FAIL (2025-08-13 03:56:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.112872265s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X...................X............................X.......] duration: 5.82263052s FAIL (2025-08-13 03:55:58 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 5.822657893s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.072387457s FAIL (2025-08-13 03:55:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.072418878s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X.....XX.............................................] duration: 7.557046341s FAIL (2025-08-13 03:55:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.557068595s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X...................X............................X......] duration: 5.614107735s FAIL (2025-08-13 03:54:56 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 5.614133523s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 1.865537093s FAIL (2025-08-13 03:54:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.86556249s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X...................X............................X.....] duration: 5.860096909s FAIL (2025-08-13 03:54:23 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 5.860126195s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X.....XX............................................] duration: 7.49350166s FAIL (2025-08-13 03:54:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.49351713s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 1.82317026s FAIL (2025-08-13 03:54:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.823197684s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X...................X............................X....] duration: 5.642563709s FAIL (2025-08-13 03:53:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 5.642591072s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 1.985967707s FAIL (2025-08-13 03:53:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.985988116s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 1.926207034s FAIL (2025-08-13 03:53:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.92623122s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X.....XX...........................................] duration: 7.80259033s FAIL (2025-08-13 03:52:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.802611891s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)