Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
625.972105ms remote:
"tcp:34.173.164.90:443" target:
https://version.storj.io/
FAIL (2025-10-27 09:10:46 UTC)
orbiter warning: Get "https://version.storj.io/": EOF
Duration: 626.002333ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
6.036728675s
FAIL (2025-10-27 09:10:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload
Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload
Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments...
Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false
Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment...
Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment.
Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment
Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments...
Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces.
Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments...
Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.036765624s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
623.068265ms remote:
"tcp:34.173.164.90:443" target:
https://version.storj.io/
FAIL (2025-10-27 09:10:24 UTC)
orbiter warning: Get "https://version.storj.io/": EOF
Duration: 623.105997ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
7.838103059s
FAIL (2025-10-27 09:10:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload
Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload
Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments...
Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false
Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment...
Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment.
Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment
Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments...
Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces.
Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments...
Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded
Duration: 7.838138997s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
624.120078ms remote:
"tcp:34.173.164.90:443" target:
https://version.storj.io/
FAIL (2025-10-27 09:10:05 UTC)
orbiter warning: Get "https://version.storj.io/": EOF
Duration: 624.154302ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
6.133406542s
FAIL (2025-10-27 09:10:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload
Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload
Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments...
Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false
Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment...
Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment.
Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment
Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments...
Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces.
Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments...
Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.133437201s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.068180106s
FAIL (2025-10-27 09:09:37 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 2.068205634s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
6.091549521s
FAIL (2025-10-27 09:09:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload
Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload
Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments...
Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false
Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment...
Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment.
Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment
Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments...
Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces.
Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments...
Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.091584347s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
614.161386ms remote:
"tcp:34.173.164.90:443" target:
https://version.storj.io/
FAIL (2025-10-27 09:09:06 UTC)
orbiter warning: Get "https://version.storj.io/": EOF
Duration: 614.195241ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
7.776541936s
FAIL (2025-10-27 09:08:49 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload
Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload
Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments...
Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false
Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment...
Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment.
Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment
Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments...
Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces.
Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments...
Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded
Duration: 7.776572483s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
1.991479092s
FAIL (2025-10-27 09:08:41 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.991549646s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
6.029585877s
FAIL (2025-10-27 09:08:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload
Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload
Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments...
Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false
Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment...
Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment.
Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment
Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments...
Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces.
Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments...
Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.029614903s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
613.432767ms remote:
"tcp:34.173.164.90:443" target:
https://version.storj.io/
FAIL (2025-10-27 09:08:22 UTC)
orbiter warning: Get "https://version.storj.io/": EOF
Duration: 613.457715ms
core
website
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
628.110098ms remote:
"tcp:34.173.164.90:443" target:
https://version.storj.io/
FAIL (2025-10-27 09:08:07 UTC)
orbiter warning: Get "https://version.storj.io/": EOF
Duration: 628.138151ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
6.922908082s
FAIL (2025-10-27 09:07:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload
Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload
Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments...
Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false
Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment...
Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment.
Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment
Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments...
Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces.
Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments...
Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.922935113s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.061975839s
FAIL (2025-10-27 09:07:39 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 2.06200713s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
5.991170266s
FAIL (2025-10-27 09:07:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload
Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload
Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments...
Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false
Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment...
Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment.
Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment
Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments...
Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces.
Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments...
Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.99119866s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
730.993156ms remote:
"tcp:34.173.164.90:443" target:
https://version.storj.io/
FAIL (2025-10-27 09:06:56 UTC)
orbiter warning: Get "https://version.storj.io/": EOF
Duration: 731.025577ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.087414941s
FAIL (2025-10-27 09:06:40 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 2.087445078s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
7.908467618s
FAIL (2025-10-27 09:06:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload
Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload
Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments...
Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false
Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment...
Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment.
Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment
Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments...
Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces.
Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments...
Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded
Duration: 7.908495512s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
624.632143ms remote:
"tcp:34.173.164.90:443" target:
https://version.storj.io/
FAIL (2025-10-27 09:05:54 UTC)
orbiter warning: Get "https://version.storj.io/": EOF
Duration: 624.654245ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
6.027755943s
FAIL (2025-10-27 09:05:30 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload
Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload
Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments...
Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false
Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment...
Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment.
Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment
Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments...
Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces.
Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments...
Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.027788936s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.017967651s
FAIL (2025-10-27 09:05:26 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 2.018007766s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
614.386253ms remote:
"tcp:34.173.164.90:443" target:
https://version.storj.io/
FAIL (2025-10-27 09:05:25 UTC)
orbiter warning: Get "https://version.storj.io/": EOF
Duration: 614.410961ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
5.977611369s
FAIL (2025-10-27 09:04:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload
Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload
Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments...
Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false
Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment...
Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment.
Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment
Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments...
Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces.
Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments...
Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.977640024s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.083314422s
FAIL (2025-10-27 09:04:55 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 2.083347717s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
615.636084ms remote:
"tcp:34.173.164.90:443" target:
https://version.storj.io/
FAIL (2025-10-27 09:04:54 UTC)
orbiter warning: Get "https://version.storj.io/": EOF
Duration: 615.670508ms
core
website
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
613.865471ms remote:
"tcp:34.173.164.90:443" target:
https://version.storj.io/
FAIL (2025-10-27 09:04:21 UTC)
orbiter warning: Get "https://version.storj.io/": EOF
Duration: 613.937139ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
7.876599751s
FAIL (2025-10-27 09:03:53 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload
Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload
Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments...
Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false
Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment...
Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment.
Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment
Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments...
Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces.
Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments...
Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded
Duration: 7.876632385s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.06410698s
FAIL (2025-10-27 09:03:44 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 2.064135794s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.048217816s
FAIL (2025-10-27 09:03:23 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 2.048247652s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
6.000341161s
FAIL (2025-10-27 09:03:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload
Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload
Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments...
Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false
Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment...
Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment.
Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment
Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments...
Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces.
Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments...
Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.000370988s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
627.286477ms remote:
"tcp:34.173.164.90:443" target:
https://version.storj.io/
FAIL (2025-10-27 09:03:11 UTC)
orbiter warning: Get "https://version.storj.io/": EOF
Duration: 627.311596ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.03170506s
FAIL (2025-10-27 09:02:57 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 2.031739105s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.109280149s
FAIL (2025-10-27 09:02:31 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 2.109389867s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
649.266792ms remote:
"tcp:34.173.164.90:443" target:
https://version.storj.io/
FAIL (2025-10-27 09:02:14 UTC)
orbiter warning: Get "https://version.storj.io/": EOF
Duration: 649.330634ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
6.169203706s
FAIL (2025-10-27 09:02:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload
Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload
Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments...
Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false
Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment...
Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment.
Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment
Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments...
Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces.
Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments...
Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.169251627s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.036122711s
FAIL (2025-10-27 09:01:43 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 2.036157017s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
5.801886808s
FAIL (2025-10-27 09:01:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload
Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload
Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments...
Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false
Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment...
Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment.
Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment
Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments...
Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces.
Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments...
Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.801919561s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
617.386787ms remote:
"tcp:34.173.164.90:443" target:
https://version.storj.io/
FAIL (2025-10-27 09:01:06 UTC)
orbiter warning: Get "https://version.storj.io/": EOF
Duration: 617.422295ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
5.903948123s
FAIL (2025-10-27 09:00:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload
Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload
Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments...
Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false
Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment...
Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment.
Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment
Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments...
Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces.
Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments...
Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.903983249s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.007170941s
FAIL (2025-10-27 09:00:55 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 2.00721738s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
624.524987ms remote:
"tcp:34.173.164.90:443" target:
https://version.storj.io/
FAIL (2025-10-27 09:00:28 UTC)
orbiter warning: Get "https://version.storj.io/": EOF
Duration: 624.562329ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.056941153s
FAIL (2025-10-27 09:00:17 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 2.056979428s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
6.055269876s
FAIL (2025-10-27 09:00:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload
Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload
Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments...
Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false
Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment...
Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment.
Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment
Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments...
Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces.
Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments...
Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.055300093s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
622.897845ms remote:
"tcp:34.173.164.90:443" target:
https://version.storj.io/
FAIL (2025-10-27 08:59:45 UTC)
orbiter warning: Get "https://version.storj.io/": EOF
Duration: 622.942049ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.018164727s
FAIL (2025-10-27 08:59:42 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 2.018195345s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
5.876876139s
FAIL (2025-10-27 08:59:10 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 27 08:42:54.781556772 (811h11m40.243649245s) [upload=713500]: Starting upload
Oct 27 08:42:54.781668174 (811h11m40.243760647s) [upload=713500]: Done starting upload
Oct 27 08:42:54.781748818 (811h11m40.243841301s) [upload=713500]: Uploading segments...
Oct 27 08:42:54.781936966 (811h11m40.244029439s) [upload=713500]: Got next segment. Inline: false
Oct 27 08:42:54.782007581 (811h11m40.244100074s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 27 08:42:54.782013772 (811h11m40.244106256s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 27 08:42:55.283845470 (811h11m40.745937953s) [seg_pos={0 0}, upload=713500]: Begin upload segment...
Oct 27 08:42:55.283940179 (811h11m40.746032672s) [seg_pos={0 0}, upload=713500]: Done begin upload segment.
Oct 27 08:42:55.284000715 (811h11m40.746093198s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284031724 (811h11m40.746124207s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284578646 (811h11m40.746671119s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.284946606 (811h11m40.747039089s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285426560 (811h11m40.747519043s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.285984693 (811h11m40.748077196s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.286470408 (811h11m40.748562881s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287081551 (811h11m40.749174024s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.287469300 (811h11m40.749561773s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288784584 (811h11m40.750877057s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.288948857 (811h11m40.75104134s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291263274 (811h11m40.753355767s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.291835163 (811h11m40.753927646s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.295815964 (811h11m40.757908447s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.296727830 (811h11m40.758820313s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:55.299687365 (811h11m40.761779848s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Uploading piece...
Oct 27 08:42:57.047478536 (811h11m42.509571019s) [upload=713500]: Next returned nil segment
Oct 27 08:42:57.047499997 (811h11m42.50959247s) [upload=713500]: Waiting for error group managing segments...
Oct 27 08:42:57.333935777 (811h11m42.79602825s) [noise=true , address=145.79.227.20:4439 , piece_id=R25OUETWY3HWQLPJBQOBEXYGYMNPD5RXZ7ESSSYMHFXKLP4PJ33A, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335389806 (811h11m42.797482279s) [noise=true , address=145.79.227.7:4294 , piece_id=4J7QMZR2V7ORE2WP3JIODZPMIODBA3COFPMOFENG4JYQMLA7NYHA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.335803023 (811h11m42.797895496s) [noise=true , address=145.79.227.14:4840 , piece_id=DVNG3RUPKJJIQL5G5TAK333MG4ATH22TH2ZY2R6LMTTFWVTWS4DQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.348114446 (811h11m42.810206919s) [noise=true , address=145.79.227.13:4802 , piece_id=DG2GE55IUFTZSBASGOSJJ46NQWMLTP3XP7DGLWQNZS3QB3YLGXIA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.349192599 (811h11m42.811285072s) [noise=true , address=145.79.227.15:4873 , piece_id=WIAPN5DZQQNXGHHD3XFTCLLPU7HO7OL5CVLHJEGU4TMM7AHLHGTA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352596010 (811h11m42.814688493s) [noise=true , address=145.79.227.26:4654 , piece_id=YT46TWJUFK4A2TNF4Q5ED5HKEXBZAO76IDUXD4O7WWLH7JU4H3HQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.352799167 (811h11m42.81489164s) [noise=true , address=145.79.227.19:4078 , piece_id=BXHZDUEHG4PQ5KASIPGEACS63J2DMH7J4AOJFLKYNMFP3NTUIC6Q, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.353399781 (811h11m42.815492264s) [noise=true , address=145.79.227.23:4546 , piece_id=FRCRFE2YK2CQUVM2YDQXPGXLK6VJWOJCAYII3YOTRZY474APJHJA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.355427622 (811h11m42.817520105s) [noise=true , address=145.79.227.18:4006 , piece_id=BO22O6SI6BMVBYRYC6KO5IPBXM6FZIIXOWPAN7R7ILF2TZBOMSPA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.357071612 (811h11m42.819164095s) [noise=true , address=145.79.227.22:4509 , piece_id=5SOTJUUPPAC4EM2WFJW4FKWC4A2LQKHFK25473P3JYTZFAVYDQRA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.358393300 (811h11m42.820485783s) [noise=true , address=145.79.227.18:4007 , piece_id=V2OF6JGPSHPBQHD2SV6SHFW4EJQW2U4M4IV2UQBCMCPKMHGJDLNA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.375787832 (811h11m42.837880305s) [noise=true , address=145.79.227.5:4223 , piece_id=TXC3A5L4S4UAGQEF73HR6QJTPUTX45Q5GKA4WXUGWFI7J7TQXXAA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382252040 (811h11m42.844344514s) [noise=true , address=145.79.227.16:4912 , piece_id=ROKTJRQBC6HMNUSX7NQSIQEO5ZYETCXJ2JOJLDIJDHAVM2EVTBKQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: <nil>
Oct 27 08:42:57.382281837 (811h11m42.84437431s) [seg_pos={0 0}, upload=713500]: Segment reached optimal threshold of 13 pieces.
Oct 27 08:42:57.382449637 (811h11m42.84454214s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382461229 (811h11m42.844553702s) [noise=true , address=77.90.31.16:4735 , piece_id=XDALQ556WJC6YQFZO62VPIWGPJFDJP2LBHBBPBGD27RSM6642FFQ, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382533197 (811h11m42.84462567s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382608179 (811h11m42.844700672s) [noise=true , address=77.90.31.12:4592 , piece_id=ODTKGJIPHH3YJ6PGVM5HLWYVHZDVNEIAHO3M2VIVJA6D7JGPFBZA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382693582 (811h11m42.844786055s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU): protocol: expected piece hash; context canceled; EOF
Oct 27 08:42:57.382700555 (811h11m42.844793028s) [noise=true , address=145.79.227.8:4331 , piece_id=JWJKIG2THYOKPQTXZ2ZNZ2J7MVJPTDOPE3S324IK2UFX3TQ4H7JA, seg_pos={0 0}, upload=713500]: Long tail cancellation due to optimal threshold
Oct 27 08:42:57.382720834 (811h11m42.844813317s) [seg_pos={0 0}, upload=713500]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 27 08:42:57.382786449 (811h11m42.844878922s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 27 08:42:57.382791568 (811h11m42.844884041s) [upload=713500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 27 08:42:58.003802187 (811h11m43.46589468s) [upload=713500]: Done uploading segments...
Oct 27 08:42:58.003826833 (811h11m43.465919326s) [upload=713500]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.876908351s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.020501065s
FAIL (2025-10-27 08:58:58 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 2.020532505s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
627.163263ms remote:
"tcp:34.173.164.90:443" target:
https://version.storj.io/
FAIL (2025-10-27 08:58:50 UTC)
orbiter warning: Get "https://version.storj.io/": EOF
Duration: 627.19277ms
core
website
|