Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.982845694s FAIL (2025-10-27 08:58:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.982885389s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 624.57778ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 08:57:42 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 624.607497ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.059232076s FAIL (2025-10-27 08:57:31 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.059268646s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.916810811s FAIL (2025-10-27 08:57:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.916870965s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 626.53693ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 08:57:01 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 626.569383ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.049372863s FAIL (2025-10-27 08:56:48 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.04940761s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.882691471s FAIL (2025-10-27 08:56:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.882728141s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 623.597104ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 08:56:19 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 623.628923ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.067554892s FAIL (2025-10-27 08:55:51 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.067583217s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.887365933s FAIL (2025-10-27 08:55:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.887397844s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 624.54625ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 08:55:26 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 624.574615ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.951268947s FAIL (2025-10-27 08:55:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.951305888s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.071242688s FAIL (2025-10-27 08:55:05 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.071300929s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 6.194496497s FAIL (2025-10-27 08:54:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.194520694s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 611.997526ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 08:54:35 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 612.027031ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.031471806s FAIL (2025-10-27 08:54:18 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.031496433s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 614.782035ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 08:54:15 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 614.831048ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 626.790843ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 08:53:52 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 626.82017ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.909393587s FAIL (2025-10-27 08:53:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.909423723s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.032116973s FAIL (2025-10-27 08:53:46 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.032153022s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 628.54801ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 08:52:46 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 628.572907ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.819960327s FAIL (2025-10-27 08:52:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.819989584s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.032100932s FAIL (2025-10-27 08:52:34 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.03213183s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 627.094633ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 08:52:04 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 627.128948ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.165223177s FAIL (2025-10-27 08:51:50 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.165246501s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 6.082677961s FAIL (2025-10-27 08:51:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.082710373s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 6.011945632s FAIL (2025-10-27 08:51:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.011982432s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 624.96177ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 08:51:03 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 625.006145ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.07098174s FAIL (2025-10-27 08:50:53 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.071018049s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.947995362s FAIL (2025-10-27 08:50:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.948027032s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 1.986270843s FAIL (2025-10-27 08:50:31 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.986298495s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 622.10534ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 08:50:28 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 622.194472ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 6.032420405s FAIL (2025-10-27 08:50:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.032459799s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 624.245126ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 08:49:53 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 624.281406ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.074379418s FAIL (2025-10-27 08:49:25 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.074407831s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 614.965744ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 08:49:12 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 614.998206ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 9.611596501s FAIL (2025-10-27 08:49:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 9.611631369s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 622.480126ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 08:48:48 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 622.514903ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 624.49232ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 08:48:12 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 624.526554ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.045175559s FAIL (2025-10-27 08:48:10 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.045238449s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 6.181182326s FAIL (2025-10-27 08:48:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.181218304s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 611.324062ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 08:47:47 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 611.352488ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.120735791s FAIL (2025-10-27 08:47:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.12081413s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 6.174359918s FAIL (2025-10-27 08:47:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.174399502s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.043694937s FAIL (2025-10-27 08:46:56 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.043727207s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 612.615881ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 08:46:39 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 612.64684ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.947294725s FAIL (2025-10-27 08:46:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.947341554s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.075491918s FAIL (2025-10-27 08:46:07 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.075530581s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 619.149972ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 08:45:53 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 619.177455ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 614.313565ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 08:45:22 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 614.33767ms core website

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)