Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 6.132605095s FAIL (2025-10-27 09:23:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.132643618s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 1.999587254s FAIL (2025-10-27 09:23:17 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.999620878s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.921116058s FAIL (2025-10-27 09:23:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.921139083s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 652.494487ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 09:22:45 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 652.545894ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.022211866s FAIL (2025-10-27 09:22:28 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.022268523s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.94023607s FAIL (2025-10-27 09:22:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.940282999s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 632.205392ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 09:21:56 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 632.228465ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 1.988860116s FAIL (2025-10-27 09:21:29 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.988889753s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 622.170653ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 09:21:24 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 622.197786ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 7.018986257s FAIL (2025-10-27 09:21:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 7.019020662s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.855451142s FAIL (2025-10-27 09:20:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.855482963s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.050897529s FAIL (2025-10-27 09:20:46 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.05096642s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.006938521s FAIL (2025-10-27 09:20:17 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.006970372s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 614.417491ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 09:20:14 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 614.466435ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 6.169770398s FAIL (2025-10-27 09:20:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.169807538s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.090904461s FAIL (2025-10-27 09:19:56 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.090937222s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 624.070733ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 09:19:31 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 624.099306ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.101066781s FAIL (2025-10-27 09:19:23 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.101100656s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 647.751465ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 09:18:58 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 647.773566ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 6.008615474s FAIL (2025-10-27 09:18:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.008638709s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 623.853669ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 09:18:28 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 623.881611ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.061871344s FAIL (2025-10-27 09:18:16 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.06191073s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 6.03571537s FAIL (2025-10-27 09:17:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.035739206s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 623.541455ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 09:17:29 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 623.571122ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 651.681851ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 09:17:07 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 651.710416ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.067913788s FAIL (2025-10-27 09:17:04 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.06795099s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 6.060950648s FAIL (2025-10-27 09:16:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.060987509s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 617.274441ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 09:16:25 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 617.296203ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.112024686s FAIL (2025-10-27 09:16:01 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.112063078s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 6.000958914s FAIL (2025-10-27 09:16:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.0009938s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 621.923063ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 09:15:38 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 621.940986ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 9.132895434s FAIL (2025-10-27 09:15:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 9.132927837s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.088169943s FAIL (2025-10-27 09:15:06 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.088209679s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.993460086s FAIL (2025-10-27 09:14:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.993485395s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 622.178038ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 09:14:35 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 622.206823ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 613.464304ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 09:14:04 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 613.514771ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.081301905s FAIL (2025-10-27 09:13:54 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.081323145s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.953864336s FAIL (2025-10-27 09:13:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.953901668s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.083572877s FAIL (2025-10-27 09:13:24 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.083612352s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 615.439768ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 09:13:10 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 615.463983ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 6.050035961s FAIL (2025-10-27 09:12:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.050074146s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.096011223s FAIL (2025-10-27 09:12:32 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.096041251s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 626.444096ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 09:12:24 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 626.48859ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.024722572s FAIL (2025-10-27 09:11:54 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.024752991s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 733.03851ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 09:11:48 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 733.065762ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 6.043977641s FAIL (2025-10-27 09:11:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.044000355s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.01871308s FAIL (2025-10-27 09:11:23 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.018740131s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 6.045678472s FAIL (2025-10-27 09:11:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments... Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment... Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment. Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece... Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments... Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil> Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces. Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments... Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.045712426s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.015757443s FAIL (2025-10-27 09:10:50 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.01579322s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 625.972105ms remote: "tcp:34.173.164.90:443" target: https://version.storj.io/ FAIL (2025-10-27 09:10:46 UTC) orbiter warning: Get "https://version.storj.io/": EOF Duration: 626.002333ms core website

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)