Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
7.040480398s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:55:02 UTC)
orbiter warning: context deadline exceeded
Duration: 7.040529933s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
7.554272744s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:54:16 UTC)
orbiter warning: context deadline exceeded
Duration: 7.5542968s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
6.83093212s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:53:46 UTC)
orbiter warning: context deadline exceeded
Duration: 6.830950455s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
4.04860944s trace:
https://jaeger.dev.storj.io/trace/1034ec799a20bbc
FAIL (2026-05-25 10:53:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment
May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments...
May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces
May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments...
May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.048635271s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
6.595557062s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:52:50 UTC)
orbiter warning: context deadline exceeded
Duration: 6.595577782s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
4.616794385s trace:
https://jaeger.dev.storj.io/trace/1034ec799a20bbc
FAIL (2026-05-25 10:52:10 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment
May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments...
May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces
May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments...
May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.61681772s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
6.741154297s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:51:47 UTC)
orbiter warning: context deadline exceeded
Duration: 6.741187662s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
4.035369607s trace:
https://jaeger.dev.storj.io/trace/1034ec799a20bbc
FAIL (2026-05-25 10:51:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment
May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments...
May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces
May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments...
May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.035386789s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
7.534256513s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:51:10 UTC)
orbiter warning: context deadline exceeded
Duration: 7.534276892s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
4.266867294s trace:
https://jaeger.dev.storj.io/trace/1034ec799a20bbc
FAIL (2026-05-25 10:50:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment
May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments...
May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces
May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments...
May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.266891529s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
6.722755836s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:50:10 UTC)
orbiter warning: context deadline exceeded
Duration: 6.72278393s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
4.678950679s trace:
https://jaeger.dev.storj.io/trace/1034ec799a20bbc
FAIL (2026-05-25 10:49:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment
May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments...
May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces
May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments...
May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.678968923s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
6.526323501s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:49:30 UTC)
orbiter warning: context deadline exceeded
Duration: 6.526346355s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
3.979188139s trace:
https://jaeger.dev.storj.io/trace/1034ec799a20bbc
FAIL (2026-05-25 10:49:05 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment
May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments...
May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces
May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments...
May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded
Duration: 3.979211004s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
6.719663424s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:49:05 UTC)
orbiter warning: context deadline exceeded
Duration: 6.719685395s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
6.701230571s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:48:40 UTC)
orbiter warning: context deadline exceeded
Duration: 6.701254477s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
6.776467871s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:48:23 UTC)
orbiter warning: context deadline exceeded
Duration: 6.77648765s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
3.949993615s trace:
https://jaeger.dev.storj.io/trace/1034ec799a20bbc
FAIL (2026-05-25 10:48:05 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment
May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments...
May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces
May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments...
May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded
Duration: 3.950020416s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
6.712542791s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:47:58 UTC)
orbiter warning: context deadline exceeded
Duration: 6.712560434s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
3.984826827s trace:
https://jaeger.dev.storj.io/trace/1034ec799a20bbc
FAIL (2026-05-25 10:47:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment
May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments...
May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces
May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments...
May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded
Duration: 3.984847257s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
6.57759044s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:47:34 UTC)
orbiter warning: context deadline exceeded
Duration: 6.577608917s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
34.452048363s trace:
https://jaeger.dev.storj.io/trace/1034ec799a20bbc
FAIL (2026-05-25 10:47:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment
May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments...
May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces
May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments...
May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded
Duration: 34.452069163s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
6.729952115s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:46:59 UTC)
orbiter warning: context deadline exceeded
Duration: 6.729973685s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
6.731539402s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:46:27 UTC)
orbiter warning: context deadline exceeded
Duration: 6.731559249s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
6.55676666s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:45:48 UTC)
orbiter warning: context deadline exceeded
Duration: 6.556787671s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
4.052958619s trace:
https://jaeger.dev.storj.io/trace/1034ec799a20bbc
FAIL (2026-05-25 10:45:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment
May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments...
May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces
May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments...
May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.052978838s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
6.767969786s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:45:31 UTC)
orbiter warning: context deadline exceeded
Duration: 6.767980155s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
7.495507308s trace:
https://jaeger.dev.storj.io/trace/1034ec799a20bbc
FAIL (2026-05-25 10:45:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment
May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments...
May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces
May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments...
May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded
Duration: 7.49552904s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
6.833718086s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:45:13 UTC)
orbiter warning: context deadline exceeded
Duration: 6.833738396s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
4.484604579s trace:
https://jaeger.dev.storj.io/trace/1034ec799a20bbc
FAIL (2026-05-25 10:44:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment
May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments...
May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces
May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments...
May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.48462588s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
3.997561035s trace:
https://jaeger.dev.storj.io/trace/1034ec799a20bbc
FAIL (2026-05-25 10:44:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment
May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments...
May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces
May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments...
May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded
Duration: 3.997579709s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
6.633665733s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:44:09 UTC)
orbiter warning: context deadline exceeded
Duration: 6.633682494s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
6.818337188s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:43:41 UTC)
orbiter warning: context deadline exceeded
Duration: 6.818352366s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
4.071193653s trace:
https://jaeger.dev.storj.io/trace/1034ec799a20bbc
FAIL (2026-05-25 10:43:26 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment
May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments...
May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces
May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments...
May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.071219544s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
6.776477047s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:43:04 UTC)
orbiter warning: context deadline exceeded
Duration: 6.776495762s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
4.451599548s trace:
https://jaeger.dev.storj.io/trace/1034ec799a20bbc
FAIL (2026-05-25 10:42:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment
May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments...
May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces
May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments...
May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.451620168s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
4.462712463s trace:
https://jaeger.dev.storj.io/trace/1034ec799a20bbc
FAIL (2026-05-25 10:42:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment
May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments...
May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces
May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments...
May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.462732581s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
6.774946527s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:42:12 UTC)
orbiter warning: context deadline exceeded
Duration: 6.774965173s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
6.493168767s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:41:22 UTC)
orbiter warning: context deadline exceeded
Duration: 6.493185168s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
3.938224169s trace:
https://jaeger.dev.storj.io/trace/1034ec799a20bbc
FAIL (2026-05-25 10:41:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment
May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments...
May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces
May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments...
May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded
Duration: 3.938290926s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
6.541371193s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:40:39 UTC)
orbiter warning: context deadline exceeded
Duration: 6.5413911s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
8.091336668s trace:
https://jaeger.dev.storj.io/trace/1034ec799a20bbc
FAIL (2026-05-25 10:40:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment
May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments...
May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces
May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments...
May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded
Duration: 8.09135865s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
6.743769519s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:39:59 UTC)
orbiter warning: context deadline exceeded
Duration: 6.743792463s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
6.688730976s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:39:28 UTC)
orbiter warning: context deadline exceeded
Duration: 6.688751906s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
6.520002582s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:39:04 UTC)
orbiter warning: context deadline exceeded
Duration: 6.520100779s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
6.982971549s trace:
https://jaeger.dev.storj.io/trace/1034ec799a20bbc
FAIL (2026-05-25 10:38:53 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment
May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments...
May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces
May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments...
May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.982991276s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
4.062849268s trace:
https://jaeger.dev.storj.io/trace/1034ec799a20bbc
FAIL (2026-05-25 10:38:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment
May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments...
May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces
May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments...
May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.062869797s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
6.625215448s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:37:56 UTC)
orbiter warning: context deadline exceeded
Duration: 6.625235756s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
5.166354885s trace:
https://jaeger.dev.storj.io/trace/1034ec799a20bbc
FAIL (2026-05-25 10:37:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece...
May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment
May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments...
May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil>
May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces
May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF
May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold
May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments...
May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.166378911s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
6.732995171s trace:
https://jaeger.dev.storj.io/trace/3dd35135526dbf86
FAIL (2026-05-25 10:36:48 UTC)
orbiter warning: context deadline exceeded
Duration: 6.733019728s
core
uplink
us-select-1
us1-placement-20
|