Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 6.493168767s trace: https://jaeger.dev.storj.io/trace/3dd35135526dbf86 FAIL (2026-05-25 10:41:22 UTC) orbiter warning: context deadline exceeded Duration: 6.493185168s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 3.938224169s trace: https://jaeger.dev.storj.io/trace/1034ec799a20bbc FAIL (2026-05-25 10:41:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments... May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments... May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.938290926s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.541371193s trace: https://jaeger.dev.storj.io/trace/3dd35135526dbf86 FAIL (2026-05-25 10:40:39 UTC) orbiter warning: context deadline exceeded Duration: 6.5413911s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 8.091336668s trace: https://jaeger.dev.storj.io/trace/1034ec799a20bbc FAIL (2026-05-25 10:40:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments... May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments... May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded Duration: 8.09135865s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 6.743769519s trace: https://jaeger.dev.storj.io/trace/3dd35135526dbf86 FAIL (2026-05-25 10:39:59 UTC) orbiter warning: context deadline exceeded Duration: 6.743792463s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 6.688730976s trace: https://jaeger.dev.storj.io/trace/3dd35135526dbf86 FAIL (2026-05-25 10:39:28 UTC) orbiter warning: context deadline exceeded Duration: 6.688751906s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.520002582s trace: https://jaeger.dev.storj.io/trace/3dd35135526dbf86 FAIL (2026-05-25 10:39:04 UTC) orbiter warning: context deadline exceeded Duration: 6.520100779s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 6.982971549s trace: https://jaeger.dev.storj.io/trace/1034ec799a20bbc FAIL (2026-05-25 10:38:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments... May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments... May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.982991276s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 4.062849268s trace: https://jaeger.dev.storj.io/trace/1034ec799a20bbc FAIL (2026-05-25 10:38:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments... May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments... May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.062869797s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 6.625215448s trace: https://jaeger.dev.storj.io/trace/3dd35135526dbf86 FAIL (2026-05-25 10:37:56 UTC) orbiter warning: context deadline exceeded Duration: 6.625235756s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.166354885s trace: https://jaeger.dev.storj.io/trace/1034ec799a20bbc FAIL (2026-05-25 10:37:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments... May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments... May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.166378911s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 6.732995171s trace: https://jaeger.dev.storj.io/trace/3dd35135526dbf86 FAIL (2026-05-25 10:36:48 UTC) orbiter warning: context deadline exceeded Duration: 6.733019728s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 4.215718834s trace: https://jaeger.dev.storj.io/trace/1034ec799a20bbc FAIL (2026-05-25 10:36:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments... May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments... May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.215739594s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 6.808457085s trace: https://jaeger.dev.storj.io/trace/3dd35135526dbf86 FAIL (2026-05-25 10:36:07 UTC) orbiter warning: context deadline exceeded Duration: 6.8085283s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 6.767261543s trace: https://jaeger.dev.storj.io/trace/3dd35135526dbf86 FAIL (2026-05-25 10:35:50 UTC) orbiter warning: context deadline exceeded Duration: 6.767280007s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 4.545397649s trace: https://jaeger.dev.storj.io/trace/1034ec799a20bbc FAIL (2026-05-25 10:35:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments... May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments... May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.54541864s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 6.830085685s trace: https://jaeger.dev.storj.io/trace/3dd35135526dbf86 FAIL (2026-05-25 10:35:34 UTC) orbiter warning: context deadline exceeded Duration: 6.830111694s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 3.923943645s trace: https://jaeger.dev.storj.io/trace/1034ec799a20bbc FAIL (2026-05-25 10:35:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments... May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments... May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.923967209s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 4.505784238s trace: https://jaeger.dev.storj.io/trace/1034ec799a20bbc FAIL (2026-05-25 10:34:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments... May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments... May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.505810028s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 6.673570651s trace: https://jaeger.dev.storj.io/trace/3dd35135526dbf86 FAIL (2026-05-25 10:34:24 UTC) orbiter warning: context deadline exceeded Duration: 6.67359145s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 8.414533464s trace: https://jaeger.dev.storj.io/trace/1034ec799a20bbc FAIL (2026-05-25 10:33:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments... May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments... May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded Duration: 8.414556057s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 6.67168006s trace: https://jaeger.dev.storj.io/trace/3dd35135526dbf86 FAIL (2026-05-25 10:33:30 UTC) orbiter warning: context deadline exceeded Duration: 6.671706231s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 6.613459963s trace: https://jaeger.dev.storj.io/trace/3dd35135526dbf86 FAIL (2026-05-25 10:33:02 UTC) orbiter warning: context deadline exceeded Duration: 6.613499439s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 3.906599694s trace: https://jaeger.dev.storj.io/trace/1034ec799a20bbc FAIL (2026-05-25 10:32:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments... May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments... May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.906627025s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 3.921531531s trace: https://jaeger.dev.storj.io/trace/1034ec799a20bbc FAIL (2026-05-25 10:32:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments... May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments... May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.921561949s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 6.715705029s trace: https://jaeger.dev.storj.io/trace/3dd35135526dbf86 FAIL (2026-05-25 10:32:16 UTC) orbiter warning: context deadline exceeded Duration: 6.715725337s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 6.637649144s trace: https://jaeger.dev.storj.io/trace/3dd35135526dbf86 FAIL (2026-05-25 10:31:54 UTC) orbiter warning: context deadline exceeded Duration: 6.637674211s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 3.878315257s trace: https://jaeger.dev.storj.io/trace/1034ec799a20bbc FAIL (2026-05-25 10:31:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments... May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments... May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.878338611s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 6.788432136s trace: https://jaeger.dev.storj.io/trace/1034ec799a20bbc FAIL (2026-05-25 10:31:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments... May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments... May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.788465479s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 6.561572759s trace: https://jaeger.dev.storj.io/trace/3dd35135526dbf86 FAIL (2026-05-25 10:30:49 UTC) orbiter warning: context deadline exceeded Duration: 6.561592136s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 4.658653006s trace: https://jaeger.dev.storj.io/trace/1034ec799a20bbc FAIL (2026-05-25 10:30:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments... May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments... May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.658675287s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 6.455355292s trace: https://jaeger.dev.storj.io/trace/3dd35135526dbf86 FAIL (2026-05-25 10:30:25 UTC) orbiter warning: context deadline exceeded Duration: 6.455378395s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.810458312s trace: https://jaeger.dev.storj.io/trace/1034ec799a20bbc FAIL (2026-05-25 10:29:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments... May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments... May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.81047841s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.269604178s trace: https://jaeger.dev.storj.io/trace/1034ec799a20bbc FAIL (2026-05-25 10:29:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments... May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments... May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.269616832s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 7.361535841s trace: https://jaeger.dev.storj.io/trace/3dd35135526dbf86 FAIL (2026-05-25 10:29:25 UTC) orbiter warning: context deadline exceeded Duration: 7.361555799s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 6.766090609s trace: https://jaeger.dev.storj.io/trace/3dd35135526dbf86 FAIL (2026-05-25 10:29:00 UTC) orbiter warning: context deadline exceeded Duration: 6.766111859s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.782330673s trace: https://jaeger.dev.storj.io/trace/1034ec799a20bbc FAIL (2026-05-25 10:28:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments... May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments... May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.782348438s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.122626178s trace: https://jaeger.dev.storj.io/trace/1034ec799a20bbc FAIL (2026-05-25 10:28:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments... May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments... May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.122650794s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 6.79720057s trace: https://jaeger.dev.storj.io/trace/3dd35135526dbf86 FAIL (2026-05-25 10:27:45 UTC) orbiter warning: context deadline exceeded Duration: 6.797220357s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 6.78150337s trace: https://jaeger.dev.storj.io/trace/1034ec799a20bbc FAIL (2026-05-25 10:27:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments... May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments... May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.781521835s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 3.967898237s trace: https://jaeger.dev.storj.io/trace/1034ec799a20bbc FAIL (2026-05-25 10:27:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments... May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments... May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.967919418s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 6.78269353s trace: https://jaeger.dev.storj.io/trace/3dd35135526dbf86 FAIL (2026-05-25 10:26:55 UTC) orbiter warning: context deadline exceeded Duration: 6.782712146s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 10.701943841s trace: https://jaeger.dev.storj.io/trace/3dd35135526dbf86 FAIL (2026-05-25 10:26:43 UTC) orbiter warning: context deadline exceeded Duration: 10.701978266s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 8.481197716s trace: https://jaeger.dev.storj.io/trace/1034ec799a20bbc FAIL (2026-05-25 10:26:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments... May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments... May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded Duration: 8.481217704s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 6.478206081s trace: https://jaeger.dev.storj.io/trace/3dd35135526dbf86 FAIL (2026-05-25 10:26:00 UTC) orbiter warning: context deadline exceeded Duration: 6.47823116s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 4.390323857s trace: https://jaeger.dev.storj.io/trace/1034ec799a20bbc FAIL (2026-05-25 10:25:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments... May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments... May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.390344087s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 4.004039477s trace: https://jaeger.dev.storj.io/trace/1034ec799a20bbc FAIL (2026-05-25 10:24:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments... May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments... May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.004065227s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.559289421s trace: https://jaeger.dev.storj.io/trace/3dd35135526dbf86 FAIL (2026-05-25 10:24:51 UTC) orbiter warning: context deadline exceeded Duration: 6.559311024s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 6.453811778s trace: https://jaeger.dev.storj.io/trace/3dd35135526dbf86 FAIL (2026-05-25 10:24:23 UTC) orbiter warning: context deadline exceeded Duration: 6.453830113s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 4.456326185s trace: https://jaeger.dev.storj.io/trace/1034ec799a20bbc FAIL (2026-05-25 10:24:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 35372577s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852396903 (8h4m28.635737002s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852641450 (8h4m28.635981549s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.852876398 (8h4m28.636216487s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853119302 (8h4m28.636459401s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853452037 (8h4m28.636792136s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853758661 (8h4m28.637098761s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.853931502 (8h4m28.637271601s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854257905 (8h4m28.637598004s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854608202 (8h4m28.637948301s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.854945245 (8h4m28.638285354s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855326673 (8h4m28.638666772s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.855651373 (8h4m28.638991472s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856007261 (8h4m28.639347351s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856391575 (8h4m28.639731664s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:42.856730622 (8h4m28.640070721s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Uploading piece... May 25 10:08:43.927482841 (8h4m29.71082293s) [upload=7753]: Next returned nil segment May 25 10:08:43.927494334 (8h4m29.710834433s) [upload=7753]: Waiting for error group managing segments... May 25 10:08:44.208156829 (8h4m29.991496928s) [noise=true , address=212.102.52.213:4334 , piece_id=ZI7LMSC2SXFQM63533ZM2YU53CJVFEUZCHPEM3IJN677SHBSFBGA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.209504721 (8h4m29.99284482s) [noise=true , address=212.102.52.214:4366 , piece_id=SKBELBNPAEF3KGXLA22OPQU3JH7IQ4YZTVHYDMGDIHDZQJV7OGDA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.210864685 (8h4m29.994204785s) [noise=true , address=212.102.52.214:4358 , piece_id=7T5PLGN2CLOXMVMO3X5L2NRZXZWYJRNIZ7RRXXQGRCSMA63MDUBA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.215417934 (8h4m29.998758043s) [noise=true , address=212.102.52.214:4361 , piece_id=FM67X2ZRRG5PXSRRQ243TVVQNGBQ6RQKKYXQB4F44GBM6BMZZWVA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.218804034 (8h4m30.002144123s) [noise=true , address=212.102.52.215:4386 , piece_id=NOMTX5PRRXBSI4H7GDKZ5FX7EHD3GCBPAN4AASCERCIMW3MAOZAA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219271346 (8h4m30.002611445s) [noise=true , address=212.102.52.215:4387 , piece_id=FXPN5MLL3LWZZCQT4YLQLEBYBWL33E2BXGQTICKW26AVQHFRF62A, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219342231 (8h4m30.00268233s) [noise=true , address=212.102.52.216:4412 , piece_id=NM27G5B3FXWVBAOFPY5HYWKIUW2IW7J6PSH4FIZN24NAEN4ZFS2Q, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.219683082 (8h4m30.003023181s) [noise=true , address=212.102.52.213:4327 , piece_id=GZ7XZDEZPK2WXSG4REGKCP4IOEQ5IX3WITRWUROTL275EQBVG2QA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.221411550 (8h4m30.004751649s) [noise=true , address=212.102.52.217:4432 , piece_id=AYI4MSDB5YFLHAMWSEFMFFSX2HRVL5YUP3BSDFDS7PXUJN7NZUSQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.226560133 (8h4m30.009900222s) [noise=true , address=212.102.52.217:4418 , piece_id=B4S3CEBD5AGGWMJA2MUTZM7EZWEJNJKUIT65IYVXE6AKMAXW7EMA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.228266380 (8h4m30.011606469s) [noise=true , address=212.102.52.215:4385 , piece_id=PNSKLE65V2UZBECR5RTKIJSM2S3C6VDX3IAE4NFK6CUWXAPJGWSA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.235448804 (8h4m30.018788903s) [noise=true , address=212.102.52.217:4427 , piece_id=AFV4R35RCIYQSFUWTBAAVTVRJ7AKYODM2MKMOJ72RPRPAEGWUHYQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.273458310 (8h4m30.056798409s) [noise=true , address=212.102.52.216:4393 , piece_id=FMGYLRSBPUAYWHG7MB6E2RHYDFNH2VBOLF4SLRUVBCYAMGULE6GQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.274640074 (8h4m30.057980173s) [noise=true , address=212.102.52.216:4405 , piece_id=2M2VPAGHYKBUSQCVE7OPNSXLFBGFWBWY2HFPYDUNWDCQ76NRI3XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.279448971 (8h4m30.06278907s) [noise=true , address=212.102.52.216:4400 , piece_id=2Y5WLNNRJF36F2CTPTO7FQ5A2OBPEKRBRD5LEAK6WAZJRZPTMQLA, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284933956 (8h4m30.068274055s) [noise=true , address=212.102.52.217:4423 , piece_id=LUTBVKXF3Q4QBYKXCL4YNOS7UE7X4N35ZM62JJDCIBEMEAREMMFQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: <nil> May 25 10:08:44.284947773 (8h4m30.068287872s) [seg_pos={0 0}, upload=7753]: Satisfied cohort requirements after 16 pieces May 25 10:08:44.285158565 (8h4m30.068498654s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16QRjPkVjsvSczuSVS3M22YoZGSHqcDrMECQmBrwv55v43bHkG): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285173503 (8h4m30.068513602s) [noise=true , address=212.102.52.215:4379 , piece_id=IVFCHESTQXW3GFH77IPY7QNNRFK73PP4ORV4CE7BTKMEKYUQXXMQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285195565 (8h4m30.068535654s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mH9FnbUFBp3PEhiqXoY1G13G2Qq2kBM13zVQGVHrE3qeYQK2J): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285203921 (8h4m30.06854402s) [noise=true , address=212.102.52.213:4329 , piece_id=6YOQFDDY4J4SPCFEI3GYECTA3OYZ5QD225SDW7VSFRTEVPUMG7XQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285393914 (8h4m30.068734013s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285400787 (8h4m30.068740886s) [noise=true , address=212.102.52.214:4362 , piece_id=IV7EDHH3WBDUYFZST7C46Z2KDJTXOPHDOHRGQFNZJZNYOET6AXRQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285531656 (8h4m30.068871755s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15oktwdg3Zq7QEGkDpv7PUCi9WXZqj7HsGRyzbvp31uWhhQrKC): protocol: expected piece hash; context canceled; EOF May 25 10:08:44.285537628 (8h4m30.068877727s) [noise=true , address=212.102.52.213:4332 , piece_id=P2RTZJC2UBUDCOXKNNKX4EKUQMHSJFJOFLAUUUFS75KHUR43XKVQ, seg_pos={0 0}, upload=7753]: Long tail cancellation due to optimal threshold May 25 10:08:44.285562736 (8h4m30.068902835s) [seg_pos={0 0}, upload=7753]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 10:08:44.285617260 (8h4m30.068957359s) [upload=7753]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 10:08:44.285620696 (8h4m30.068960795s) [upload=7753]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 10:09:37.870454601 (8h5m23.6537947s) [upload=7753]: Done uploading segments... May 25 10:09:37.870520758 (8h5m23.653860857s) [upload=7753]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.456404273s core uplink uk-select-1 uk1-placement-17

Orbiter Check History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)