Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................................................X] duration: 5.001547891s trace: https://jaeger.dev.storj.io/trace/5867dddbed7af4dc FAIL (2026-05-26 12:44:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001562458s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...........................X....X...........................] duration: 5.568185906s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:43:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 5.568209873s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [............................X....X..........................] duration: 3.921728847s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:42:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 3.921745007s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.............................X....X.........................] duration: 3.982259066s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:42:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 3.982284916s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..............................X....X........................] duration: 3.92263162s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:42:11 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 3.922644425s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...............................X....X.......................] duration: 4.995647696s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:41:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.99567051s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [................................X....X......................] duration: 4.033134182s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:40:01 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.03315875s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.................................X....X.....................] duration: 3.997066665s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:39:13 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 3.997081142s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [X.................................X....X....................] duration: 5.790412564s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:38:29 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 5.790430748s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.X.................................X....X...................] duration: 4.527787878s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:37:38 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.527808317s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [..X.................................X....X..................] duration: 4.073618005s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:36:38 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.073632274s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [...X.................................X....X.................] duration: 4.107287563s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:35:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.107311929s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [....X.................................X....X................] duration: 4.154921606s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:34:44 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.154943638s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.....X.................................X....X...............] duration: 4.067129937s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:34:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.067160955s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [......X.................................X....X..............] duration: 4.118743473s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:33:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.118763963s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [X......X.................................X....X.............] duration: 4.085561966s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:33:04 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.085582765s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [.X......X.................................X....X............] duration: 4.220189242s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:32:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.22020931s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [..X......X.................................X....X...........] duration: 4.004790606s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:31:39 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.004813028s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [...X......X.................................X....X..........] duration: 6.750518459s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:31:26 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 6.750541413s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [....X......X.................................X....X.........] duration: 4.185204367s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:30:13 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.185227008s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [.....X......X.................................X....X........] duration: 3.975665531s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:29:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 3.975687083s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [......X......X.................................X....X.......] duration: 4.078166443s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:28:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.078185801s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [.......X......X.................................X....X......] duration: 4.084462126s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:28:00 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.08448533s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [........X......X.................................X....X.....] duration: 4.054131173s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:27:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.054141505s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [.........X......X.................................X....X....] duration: 4.422111578s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:26:11 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.422134553s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [..........X......X.................................X....X...] duration: 3.955839259s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:25:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 3.955856473s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [...........X......X.................................X....X..] duration: 4.097245757s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:24:40 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.097258792s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [............X......X.................................X....X.] duration: 4.226051661s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:23:36 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.226061919s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [.............X......X.................................X....X] duration: 1m0.001832785s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:23:32 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 1m0.001854285s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [..............X......X.................................X....] duration: 4.164198133s trace: https://jaeger.dev.storj.io/trace/75b508fa4998aa64 FAIL (2026-05-26 12:22:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =32801]: Uploading piece... May 26 12:19:31.716941461 (34h15m17.50028156s) [noise=true , address=212.102.52.214:4351 , piece_id=HPEPPDU2RQL4EOB5IPV6V27RBKC7TCBBAQJ76P54IWDUKVZEK5KQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717202910 (34h15m17.500543009s) [noise=true , address=212.102.52.216:4393 , piece_id=PEPRXU3OY327CCBWLLK2MWGPETCKZ4OURWEWA65UYRPOV6J46WFA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717209863 (34h15m17.500549962s) [noise=true , address=212.102.52.217:4440 , piece_id=ZEKBZTSKD54RTDEMPDFAQF6HNNHMFILY7NUXTTBACEDFRXDUXCIA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717457876 (34h15m17.500797975s) [noise=true , address=212.102.52.215:4382 , piece_id=K4HENFKKVM6U2OFDX5RDRT4RQF76YRXQ6YT3R7W2IDRMUQM7RJKQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717560773 (34h15m17.500900872s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717839194 (34h15m17.501179283s) [noise=true , address=212.102.52.217:4423 , piece_id=Y545RC3YMIHHHSNS5OSA2SXTXJFZ5HDI6OF6J5JF5N4N6IQ3MI6Q, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717884921 (34h15m17.50122502s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718141300 (34h15m17.5014814s) [noise=true , address=212.102.52.216:4413 , piece_id=E4JSJJFL3M42V7PC24QLWBFCDRVHQ7AH2ZX235B44CUY4QQYZCIA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718208198 (34h15m17.501548287s) [noise=true , address=212.102.52.213:4331 , piece_id=E6TKWX5TC4RPER7RD3V7XDZFJUBXB5Z2DNBMIFCSWSNOGHHXUWNA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718532437 (34h15m17.501872536s) [noise=true , address=212.102.52.213:4332 , piece_id=QWOVHF52QDFKFIQUD3N6DOGRAZZXMFF66GE7GOO6LPC225MJMYWA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718878607 (34h15m17.502218706s) [noise=true , address=212.102.52.214:4360 , piece_id=4O462KAS5NDNF2OS56LIM23LZUMDFF6PPX3DNS2J4YOVS72FI5NQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719174882 (34h15m17.502514971s) [noise=true , address=212.102.52.214:4346 , piece_id=M77OWJXNJDC7PQPIWF7ETB7SXA4MIT2S6B5R6F56YYGWVC33HIMQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719492419 (34h15m17.502832518s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719784156 (34h15m17.503124255s) [noise=true , address=212.102.52.215:4389 , piece_id=ZWMP5HZ46SCGWGYG5YFUOBAWIJYH7SC7LMXP2WRCDN56VHY7MMOA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.720031868 (34h15m17.503371957s) [noise=true , address=212.102.52.215:4374 , piece_id=5PJXH7J3GPQANUTHRNASWS7IIOPK6ZCEYTQV7HJCHNDFUTFXLLYA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:32.784571496 (34h15m18.567911595s) [upload=32801]: Next returned nil segment May 26 12:19:32.784582568 (34h15m18.567922667s) [upload=32801]: Waiting for error group managing segments... May 26 12:19:33.062237028 (34h15m18.845577127s) [noise=true , address=212.102.52.217:4422 , piece_id=5GSTTHDL5KJLLOEEKPRDR4ALMQRJS7TR3OWRRBPWI4W6MW6PTLBA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.064059716 (34h15m18.847399815s) [noise=true , address=212.102.52.214:4348 , piece_id=ODTUOV7TRRSO5EONFHQSKIEE6P2ZXZVHTYOF52P3Z6OYYZH6AH3A, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.069664922 (34h15m18.853005011s) [noise=true , address=212.102.52.217:4440 , piece_id=ZEKBZTSKD54RTDEMPDFAQF6HNNHMFILY7NUXTTBACEDFRXDUXCIA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.075595288 (34h15m18.858935387s) [noise=true , address=212.102.52.213:4332 , piece_id=QWOVHF52QDFKFIQUD3N6DOGRAZZXMFF66GE7GOO6LPC225MJMYWA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.076790227 (34h15m18.860130326s) [noise=true , address=212.102.52.216:4413 , piece_id=E4JSJJFL3M42V7PC24QLWBFCDRVHQ7AH2ZX235B44CUY4QQYZCIA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.078552991 (34h15m18.86189309s) [noise=true , address=212.102.52.216:4393 , piece_id=PEPRXU3OY327CCBWLLK2MWGPETCKZ4OURWEWA65UYRPOV6J46WFA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.110167946 (34h15m18.893508085s) [noise=true , address=212.102.52.214:4346 , piece_id=M77OWJXNJDC7PQPIWF7ETB7SXA4MIT2S6B5R6F56YYGWVC33HIMQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.110318544 (34h15m18.893658633s) [noise=true , address=212.102.52.213:4331 , piece_id=E6TKWX5TC4RPER7RD3V7XDZFJUBXB5Z2DNBMIFCSWSNOGHHXUWNA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.111555875 (34h15m18.894895974s) [noise=true , address=212.102.52.214:4360 , piece_id=4O462KAS5NDNF2OS56LIM23LZUMDFF6PPX3DNS2J4YOVS72FI5NQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.111803587 (34h15m18.895143676s) [noise=true , address=212.102.52.215:4389 , piece_id=ZWMP5HZ46SCGWGYG5YFUOBAWIJYH7SC7LMXP2WRCDN56VHY7MMOA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.114217373 (34h15m18.897557472s) [noise=true , address=212.102.52.216:4411 , piece_id=XVTGPIXYPVJCVGQXAKSVZXH6CAJZUZM6BU2XLRHQY5HVHCUTOL4Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.116598127 (34h15m18.899938226s) [noise=true , address=212.102.52.215:4382 , piece_id=K4HENFKKVM6U2OFDX5RDRT4RQF76YRXQ6YT3R7W2IDRMUQM7RJKQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.117364549 (34h15m18.900704638s) [noise=true , address=212.102.52.215:4374 , piece_id=5PJXH7J3GPQANUTHRNASWS7IIOPK6ZCEYTQV7HJCHNDFUTFXLLYA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.118288161 (34h15m18.90162826s) [noise=true , address=212.102.52.217:4435 , piece_id=B6XPVKZCMSCTYFXH6PLHYJZFZMCDEP34IC4NTLRNB7BJKBU2GY3Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.118389785 (34h15m18.901729894s) [noise=true , address=212.102.52.214:4351 , piece_id=HPEPPDU2RQL4EOB5IPV6V27RBKC7TCBBAQJ76P54IWDUKVZEK5KQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.121953905 (34h15m18.905294004s) [noise=true , address=212.102.52.217:4423 , piece_id=Y545RC3YMIHHHSNS5OSA2SXTXJFZ5HDI6OF6J5JF5N4N6IQ3MI6Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.121969375 (34h15m18.905309544s) [seg_pos={0 0}, upload=32801]: Satisfied cohort requirements after 16 pieces May 26 12:19:33.122163295 (34h15m18.905503394s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJ3Cc6SDXz1kVAonxneo6cmqGJSyarDuB7mnLpk3jptn72B97): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122184926 (34h15m18.905525025s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122219532 (34h15m18.905559641s) [noise=true , address=212.102.52.213:4341 , piece_id=ZYQH7GINHGIDJAP7VYYWZV4UHEUNYBJ6OSF6WQWHOOQY3MVOVFLQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K65J7VCBmysqtxarNThUGarMstzQxGicA9LN4EbXhyDSR64mh): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122231184 (34h15m18.905571323s) [noise=true , address=212.102.52.213:4341 , piece_id=ZYQH7GINHGIDJAP7VYYWZV4UHEUNYBJ6OSF6WQWHOOQY3MVOVFLQ, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122440644 (34h15m18.905780743s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ba2xzEg4HQRMyHzTfny9mKtSRRrs9upRgRdax4U3RWwG8w7g7): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122448329 (34h15m18.905788428s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122460963 (34h15m18.905801052s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tz4zmQwQuZRv11trxzYvGvc7UHKHaz9edHsd6KPeK3V4usmUr): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122468277 (34h15m18.905808376s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122484839 (34h15m18.905824928s) [seg_pos={0 0}, upload=32801]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:19:33.122574470 (34h15m18.905914569s) [upload=32801]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:19:33.122580351 (34h15m18.90592048s) [upload=32801]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:20:00.406268993 (34h15m46.189609092s) [upload=32801]: Done uploading segments... May 26 12:20:00.406311565 (34h15m46.189651664s) [upload=32801]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.164229762s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [...............X......X.................................X...] duration: 4.18729239s trace: https://jaeger.dev.storj.io/trace/75b508fa4998aa64 FAIL (2026-05-26 12:21:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =32801]: Uploading piece... May 26 12:19:31.716941461 (34h15m17.50028156s) [noise=true , address=212.102.52.214:4351 , piece_id=HPEPPDU2RQL4EOB5IPV6V27RBKC7TCBBAQJ76P54IWDUKVZEK5KQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717202910 (34h15m17.500543009s) [noise=true , address=212.102.52.216:4393 , piece_id=PEPRXU3OY327CCBWLLK2MWGPETCKZ4OURWEWA65UYRPOV6J46WFA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717209863 (34h15m17.500549962s) [noise=true , address=212.102.52.217:4440 , piece_id=ZEKBZTSKD54RTDEMPDFAQF6HNNHMFILY7NUXTTBACEDFRXDUXCIA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717457876 (34h15m17.500797975s) [noise=true , address=212.102.52.215:4382 , piece_id=K4HENFKKVM6U2OFDX5RDRT4RQF76YRXQ6YT3R7W2IDRMUQM7RJKQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717560773 (34h15m17.500900872s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717839194 (34h15m17.501179283s) [noise=true , address=212.102.52.217:4423 , piece_id=Y545RC3YMIHHHSNS5OSA2SXTXJFZ5HDI6OF6J5JF5N4N6IQ3MI6Q, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717884921 (34h15m17.50122502s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718141300 (34h15m17.5014814s) [noise=true , address=212.102.52.216:4413 , piece_id=E4JSJJFL3M42V7PC24QLWBFCDRVHQ7AH2ZX235B44CUY4QQYZCIA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718208198 (34h15m17.501548287s) [noise=true , address=212.102.52.213:4331 , piece_id=E6TKWX5TC4RPER7RD3V7XDZFJUBXB5Z2DNBMIFCSWSNOGHHXUWNA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718532437 (34h15m17.501872536s) [noise=true , address=212.102.52.213:4332 , piece_id=QWOVHF52QDFKFIQUD3N6DOGRAZZXMFF66GE7GOO6LPC225MJMYWA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718878607 (34h15m17.502218706s) [noise=true , address=212.102.52.214:4360 , piece_id=4O462KAS5NDNF2OS56LIM23LZUMDFF6PPX3DNS2J4YOVS72FI5NQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719174882 (34h15m17.502514971s) [noise=true , address=212.102.52.214:4346 , piece_id=M77OWJXNJDC7PQPIWF7ETB7SXA4MIT2S6B5R6F56YYGWVC33HIMQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719492419 (34h15m17.502832518s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719784156 (34h15m17.503124255s) [noise=true , address=212.102.52.215:4389 , piece_id=ZWMP5HZ46SCGWGYG5YFUOBAWIJYH7SC7LMXP2WRCDN56VHY7MMOA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.720031868 (34h15m17.503371957s) [noise=true , address=212.102.52.215:4374 , piece_id=5PJXH7J3GPQANUTHRNASWS7IIOPK6ZCEYTQV7HJCHNDFUTFXLLYA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:32.784571496 (34h15m18.567911595s) [upload=32801]: Next returned nil segment May 26 12:19:32.784582568 (34h15m18.567922667s) [upload=32801]: Waiting for error group managing segments... May 26 12:19:33.062237028 (34h15m18.845577127s) [noise=true , address=212.102.52.217:4422 , piece_id=5GSTTHDL5KJLLOEEKPRDR4ALMQRJS7TR3OWRRBPWI4W6MW6PTLBA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.064059716 (34h15m18.847399815s) [noise=true , address=212.102.52.214:4348 , piece_id=ODTUOV7TRRSO5EONFHQSKIEE6P2ZXZVHTYOF52P3Z6OYYZH6AH3A, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.069664922 (34h15m18.853005011s) [noise=true , address=212.102.52.217:4440 , piece_id=ZEKBZTSKD54RTDEMPDFAQF6HNNHMFILY7NUXTTBACEDFRXDUXCIA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.075595288 (34h15m18.858935387s) [noise=true , address=212.102.52.213:4332 , piece_id=QWOVHF52QDFKFIQUD3N6DOGRAZZXMFF66GE7GOO6LPC225MJMYWA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.076790227 (34h15m18.860130326s) [noise=true , address=212.102.52.216:4413 , piece_id=E4JSJJFL3M42V7PC24QLWBFCDRVHQ7AH2ZX235B44CUY4QQYZCIA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.078552991 (34h15m18.86189309s) [noise=true , address=212.102.52.216:4393 , piece_id=PEPRXU3OY327CCBWLLK2MWGPETCKZ4OURWEWA65UYRPOV6J46WFA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.110167946 (34h15m18.893508085s) [noise=true , address=212.102.52.214:4346 , piece_id=M77OWJXNJDC7PQPIWF7ETB7SXA4MIT2S6B5R6F56YYGWVC33HIMQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.110318544 (34h15m18.893658633s) [noise=true , address=212.102.52.213:4331 , piece_id=E6TKWX5TC4RPER7RD3V7XDZFJUBXB5Z2DNBMIFCSWSNOGHHXUWNA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.111555875 (34h15m18.894895974s) [noise=true , address=212.102.52.214:4360 , piece_id=4O462KAS5NDNF2OS56LIM23LZUMDFF6PPX3DNS2J4YOVS72FI5NQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.111803587 (34h15m18.895143676s) [noise=true , address=212.102.52.215:4389 , piece_id=ZWMP5HZ46SCGWGYG5YFUOBAWIJYH7SC7LMXP2WRCDN56VHY7MMOA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.114217373 (34h15m18.897557472s) [noise=true , address=212.102.52.216:4411 , piece_id=XVTGPIXYPVJCVGQXAKSVZXH6CAJZUZM6BU2XLRHQY5HVHCUTOL4Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.116598127 (34h15m18.899938226s) [noise=true , address=212.102.52.215:4382 , piece_id=K4HENFKKVM6U2OFDX5RDRT4RQF76YRXQ6YT3R7W2IDRMUQM7RJKQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.117364549 (34h15m18.900704638s) [noise=true , address=212.102.52.215:4374 , piece_id=5PJXH7J3GPQANUTHRNASWS7IIOPK6ZCEYTQV7HJCHNDFUTFXLLYA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.118288161 (34h15m18.90162826s) [noise=true , address=212.102.52.217:4435 , piece_id=B6XPVKZCMSCTYFXH6PLHYJZFZMCDEP34IC4NTLRNB7BJKBU2GY3Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.118389785 (34h15m18.901729894s) [noise=true , address=212.102.52.214:4351 , piece_id=HPEPPDU2RQL4EOB5IPV6V27RBKC7TCBBAQJ76P54IWDUKVZEK5KQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.121953905 (34h15m18.905294004s) [noise=true , address=212.102.52.217:4423 , piece_id=Y545RC3YMIHHHSNS5OSA2SXTXJFZ5HDI6OF6J5JF5N4N6IQ3MI6Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.121969375 (34h15m18.905309544s) [seg_pos={0 0}, upload=32801]: Satisfied cohort requirements after 16 pieces May 26 12:19:33.122163295 (34h15m18.905503394s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJ3Cc6SDXz1kVAonxneo6cmqGJSyarDuB7mnLpk3jptn72B97): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122184926 (34h15m18.905525025s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122219532 (34h15m18.905559641s) [noise=true , address=212.102.52.213:4341 , piece_id=ZYQH7GINHGIDJAP7VYYWZV4UHEUNYBJ6OSF6WQWHOOQY3MVOVFLQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K65J7VCBmysqtxarNThUGarMstzQxGicA9LN4EbXhyDSR64mh): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122231184 (34h15m18.905571323s) [noise=true , address=212.102.52.213:4341 , piece_id=ZYQH7GINHGIDJAP7VYYWZV4UHEUNYBJ6OSF6WQWHOOQY3MVOVFLQ, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122440644 (34h15m18.905780743s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ba2xzEg4HQRMyHzTfny9mKtSRRrs9upRgRdax4U3RWwG8w7g7): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122448329 (34h15m18.905788428s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122460963 (34h15m18.905801052s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tz4zmQwQuZRv11trxzYvGvc7UHKHaz9edHsd6KPeK3V4usmUr): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122468277 (34h15m18.905808376s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122484839 (34h15m18.905824928s) [seg_pos={0 0}, upload=32801]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:19:33.122574470 (34h15m18.905914569s) [upload=32801]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:19:33.122580351 (34h15m18.90592048s) [upload=32801]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:20:00.406268993 (34h15m46.189609092s) [upload=32801]: Done uploading segments... May 26 12:20:00.406311565 (34h15m46.189651664s) [upload=32801]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.187327057s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [................X......X.................................X..] duration: 4.216925807s trace: https://jaeger.dev.storj.io/trace/75b508fa4998aa64 FAIL (2026-05-26 12:20:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =32801]: Uploading piece... May 26 12:19:31.716941461 (34h15m17.50028156s) [noise=true , address=212.102.52.214:4351 , piece_id=HPEPPDU2RQL4EOB5IPV6V27RBKC7TCBBAQJ76P54IWDUKVZEK5KQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717202910 (34h15m17.500543009s) [noise=true , address=212.102.52.216:4393 , piece_id=PEPRXU3OY327CCBWLLK2MWGPETCKZ4OURWEWA65UYRPOV6J46WFA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717209863 (34h15m17.500549962s) [noise=true , address=212.102.52.217:4440 , piece_id=ZEKBZTSKD54RTDEMPDFAQF6HNNHMFILY7NUXTTBACEDFRXDUXCIA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717457876 (34h15m17.500797975s) [noise=true , address=212.102.52.215:4382 , piece_id=K4HENFKKVM6U2OFDX5RDRT4RQF76YRXQ6YT3R7W2IDRMUQM7RJKQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717560773 (34h15m17.500900872s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717839194 (34h15m17.501179283s) [noise=true , address=212.102.52.217:4423 , piece_id=Y545RC3YMIHHHSNS5OSA2SXTXJFZ5HDI6OF6J5JF5N4N6IQ3MI6Q, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717884921 (34h15m17.50122502s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718141300 (34h15m17.5014814s) [noise=true , address=212.102.52.216:4413 , piece_id=E4JSJJFL3M42V7PC24QLWBFCDRVHQ7AH2ZX235B44CUY4QQYZCIA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718208198 (34h15m17.501548287s) [noise=true , address=212.102.52.213:4331 , piece_id=E6TKWX5TC4RPER7RD3V7XDZFJUBXB5Z2DNBMIFCSWSNOGHHXUWNA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718532437 (34h15m17.501872536s) [noise=true , address=212.102.52.213:4332 , piece_id=QWOVHF52QDFKFIQUD3N6DOGRAZZXMFF66GE7GOO6LPC225MJMYWA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718878607 (34h15m17.502218706s) [noise=true , address=212.102.52.214:4360 , piece_id=4O462KAS5NDNF2OS56LIM23LZUMDFF6PPX3DNS2J4YOVS72FI5NQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719174882 (34h15m17.502514971s) [noise=true , address=212.102.52.214:4346 , piece_id=M77OWJXNJDC7PQPIWF7ETB7SXA4MIT2S6B5R6F56YYGWVC33HIMQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719492419 (34h15m17.502832518s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719784156 (34h15m17.503124255s) [noise=true , address=212.102.52.215:4389 , piece_id=ZWMP5HZ46SCGWGYG5YFUOBAWIJYH7SC7LMXP2WRCDN56VHY7MMOA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.720031868 (34h15m17.503371957s) [noise=true , address=212.102.52.215:4374 , piece_id=5PJXH7J3GPQANUTHRNASWS7IIOPK6ZCEYTQV7HJCHNDFUTFXLLYA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:32.784571496 (34h15m18.567911595s) [upload=32801]: Next returned nil segment May 26 12:19:32.784582568 (34h15m18.567922667s) [upload=32801]: Waiting for error group managing segments... May 26 12:19:33.062237028 (34h15m18.845577127s) [noise=true , address=212.102.52.217:4422 , piece_id=5GSTTHDL5KJLLOEEKPRDR4ALMQRJS7TR3OWRRBPWI4W6MW6PTLBA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.064059716 (34h15m18.847399815s) [noise=true , address=212.102.52.214:4348 , piece_id=ODTUOV7TRRSO5EONFHQSKIEE6P2ZXZVHTYOF52P3Z6OYYZH6AH3A, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.069664922 (34h15m18.853005011s) [noise=true , address=212.102.52.217:4440 , piece_id=ZEKBZTSKD54RTDEMPDFAQF6HNNHMFILY7NUXTTBACEDFRXDUXCIA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.075595288 (34h15m18.858935387s) [noise=true , address=212.102.52.213:4332 , piece_id=QWOVHF52QDFKFIQUD3N6DOGRAZZXMFF66GE7GOO6LPC225MJMYWA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.076790227 (34h15m18.860130326s) [noise=true , address=212.102.52.216:4413 , piece_id=E4JSJJFL3M42V7PC24QLWBFCDRVHQ7AH2ZX235B44CUY4QQYZCIA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.078552991 (34h15m18.86189309s) [noise=true , address=212.102.52.216:4393 , piece_id=PEPRXU3OY327CCBWLLK2MWGPETCKZ4OURWEWA65UYRPOV6J46WFA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.110167946 (34h15m18.893508085s) [noise=true , address=212.102.52.214:4346 , piece_id=M77OWJXNJDC7PQPIWF7ETB7SXA4MIT2S6B5R6F56YYGWVC33HIMQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.110318544 (34h15m18.893658633s) [noise=true , address=212.102.52.213:4331 , piece_id=E6TKWX5TC4RPER7RD3V7XDZFJUBXB5Z2DNBMIFCSWSNOGHHXUWNA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.111555875 (34h15m18.894895974s) [noise=true , address=212.102.52.214:4360 , piece_id=4O462KAS5NDNF2OS56LIM23LZUMDFF6PPX3DNS2J4YOVS72FI5NQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.111803587 (34h15m18.895143676s) [noise=true , address=212.102.52.215:4389 , piece_id=ZWMP5HZ46SCGWGYG5YFUOBAWIJYH7SC7LMXP2WRCDN56VHY7MMOA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.114217373 (34h15m18.897557472s) [noise=true , address=212.102.52.216:4411 , piece_id=XVTGPIXYPVJCVGQXAKSVZXH6CAJZUZM6BU2XLRHQY5HVHCUTOL4Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.116598127 (34h15m18.899938226s) [noise=true , address=212.102.52.215:4382 , piece_id=K4HENFKKVM6U2OFDX5RDRT4RQF76YRXQ6YT3R7W2IDRMUQM7RJKQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.117364549 (34h15m18.900704638s) [noise=true , address=212.102.52.215:4374 , piece_id=5PJXH7J3GPQANUTHRNASWS7IIOPK6ZCEYTQV7HJCHNDFUTFXLLYA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.118288161 (34h15m18.90162826s) [noise=true , address=212.102.52.217:4435 , piece_id=B6XPVKZCMSCTYFXH6PLHYJZFZMCDEP34IC4NTLRNB7BJKBU2GY3Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.118389785 (34h15m18.901729894s) [noise=true , address=212.102.52.214:4351 , piece_id=HPEPPDU2RQL4EOB5IPV6V27RBKC7TCBBAQJ76P54IWDUKVZEK5KQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.121953905 (34h15m18.905294004s) [noise=true , address=212.102.52.217:4423 , piece_id=Y545RC3YMIHHHSNS5OSA2SXTXJFZ5HDI6OF6J5JF5N4N6IQ3MI6Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.121969375 (34h15m18.905309544s) [seg_pos={0 0}, upload=32801]: Satisfied cohort requirements after 16 pieces May 26 12:19:33.122163295 (34h15m18.905503394s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJ3Cc6SDXz1kVAonxneo6cmqGJSyarDuB7mnLpk3jptn72B97): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122184926 (34h15m18.905525025s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122219532 (34h15m18.905559641s) [noise=true , address=212.102.52.213:4341 , piece_id=ZYQH7GINHGIDJAP7VYYWZV4UHEUNYBJ6OSF6WQWHOOQY3MVOVFLQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K65J7VCBmysqtxarNThUGarMstzQxGicA9LN4EbXhyDSR64mh): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122231184 (34h15m18.905571323s) [noise=true , address=212.102.52.213:4341 , piece_id=ZYQH7GINHGIDJAP7VYYWZV4UHEUNYBJ6OSF6WQWHOOQY3MVOVFLQ, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122440644 (34h15m18.905780743s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ba2xzEg4HQRMyHzTfny9mKtSRRrs9upRgRdax4U3RWwG8w7g7): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122448329 (34h15m18.905788428s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122460963 (34h15m18.905801052s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tz4zmQwQuZRv11trxzYvGvc7UHKHaz9edHsd6KPeK3V4usmUr): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122468277 (34h15m18.905808376s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122484839 (34h15m18.905824928s) [seg_pos={0 0}, upload=32801]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:19:33.122574470 (34h15m18.905914569s) [upload=32801]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:19:33.122580351 (34h15m18.90592048s) [upload=32801]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:20:00.406268993 (34h15m46.189609092s) [upload=32801]: Done uploading segments... May 26 12:20:00.406311565 (34h15m46.189651664s) [upload=32801]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.216983207s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.................X......X.................................X.] duration: 7.318581774s trace: https://jaeger.dev.storj.io/trace/75b508fa4998aa64 FAIL (2026-05-26 12:20:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =32801]: Uploading piece... May 26 12:19:31.716941461 (34h15m17.50028156s) [noise=true , address=212.102.52.214:4351 , piece_id=HPEPPDU2RQL4EOB5IPV6V27RBKC7TCBBAQJ76P54IWDUKVZEK5KQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717202910 (34h15m17.500543009s) [noise=true , address=212.102.52.216:4393 , piece_id=PEPRXU3OY327CCBWLLK2MWGPETCKZ4OURWEWA65UYRPOV6J46WFA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717209863 (34h15m17.500549962s) [noise=true , address=212.102.52.217:4440 , piece_id=ZEKBZTSKD54RTDEMPDFAQF6HNNHMFILY7NUXTTBACEDFRXDUXCIA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717457876 (34h15m17.500797975s) [noise=true , address=212.102.52.215:4382 , piece_id=K4HENFKKVM6U2OFDX5RDRT4RQF76YRXQ6YT3R7W2IDRMUQM7RJKQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717560773 (34h15m17.500900872s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717839194 (34h15m17.501179283s) [noise=true , address=212.102.52.217:4423 , piece_id=Y545RC3YMIHHHSNS5OSA2SXTXJFZ5HDI6OF6J5JF5N4N6IQ3MI6Q, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717884921 (34h15m17.50122502s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718141300 (34h15m17.5014814s) [noise=true , address=212.102.52.216:4413 , piece_id=E4JSJJFL3M42V7PC24QLWBFCDRVHQ7AH2ZX235B44CUY4QQYZCIA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718208198 (34h15m17.501548287s) [noise=true , address=212.102.52.213:4331 , piece_id=E6TKWX5TC4RPER7RD3V7XDZFJUBXB5Z2DNBMIFCSWSNOGHHXUWNA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718532437 (34h15m17.501872536s) [noise=true , address=212.102.52.213:4332 , piece_id=QWOVHF52QDFKFIQUD3N6DOGRAZZXMFF66GE7GOO6LPC225MJMYWA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718878607 (34h15m17.502218706s) [noise=true , address=212.102.52.214:4360 , piece_id=4O462KAS5NDNF2OS56LIM23LZUMDFF6PPX3DNS2J4YOVS72FI5NQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719174882 (34h15m17.502514971s) [noise=true , address=212.102.52.214:4346 , piece_id=M77OWJXNJDC7PQPIWF7ETB7SXA4MIT2S6B5R6F56YYGWVC33HIMQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719492419 (34h15m17.502832518s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719784156 (34h15m17.503124255s) [noise=true , address=212.102.52.215:4389 , piece_id=ZWMP5HZ46SCGWGYG5YFUOBAWIJYH7SC7LMXP2WRCDN56VHY7MMOA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.720031868 (34h15m17.503371957s) [noise=true , address=212.102.52.215:4374 , piece_id=5PJXH7J3GPQANUTHRNASWS7IIOPK6ZCEYTQV7HJCHNDFUTFXLLYA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:32.784571496 (34h15m18.567911595s) [upload=32801]: Next returned nil segment May 26 12:19:32.784582568 (34h15m18.567922667s) [upload=32801]: Waiting for error group managing segments... May 26 12:19:33.062237028 (34h15m18.845577127s) [noise=true , address=212.102.52.217:4422 , piece_id=5GSTTHDL5KJLLOEEKPRDR4ALMQRJS7TR3OWRRBPWI4W6MW6PTLBA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.064059716 (34h15m18.847399815s) [noise=true , address=212.102.52.214:4348 , piece_id=ODTUOV7TRRSO5EONFHQSKIEE6P2ZXZVHTYOF52P3Z6OYYZH6AH3A, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.069664922 (34h15m18.853005011s) [noise=true , address=212.102.52.217:4440 , piece_id=ZEKBZTSKD54RTDEMPDFAQF6HNNHMFILY7NUXTTBACEDFRXDUXCIA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.075595288 (34h15m18.858935387s) [noise=true , address=212.102.52.213:4332 , piece_id=QWOVHF52QDFKFIQUD3N6DOGRAZZXMFF66GE7GOO6LPC225MJMYWA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.076790227 (34h15m18.860130326s) [noise=true , address=212.102.52.216:4413 , piece_id=E4JSJJFL3M42V7PC24QLWBFCDRVHQ7AH2ZX235B44CUY4QQYZCIA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.078552991 (34h15m18.86189309s) [noise=true , address=212.102.52.216:4393 , piece_id=PEPRXU3OY327CCBWLLK2MWGPETCKZ4OURWEWA65UYRPOV6J46WFA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.110167946 (34h15m18.893508085s) [noise=true , address=212.102.52.214:4346 , piece_id=M77OWJXNJDC7PQPIWF7ETB7SXA4MIT2S6B5R6F56YYGWVC33HIMQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.110318544 (34h15m18.893658633s) [noise=true , address=212.102.52.213:4331 , piece_id=E6TKWX5TC4RPER7RD3V7XDZFJUBXB5Z2DNBMIFCSWSNOGHHXUWNA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.111555875 (34h15m18.894895974s) [noise=true , address=212.102.52.214:4360 , piece_id=4O462KAS5NDNF2OS56LIM23LZUMDFF6PPX3DNS2J4YOVS72FI5NQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.111803587 (34h15m18.895143676s) [noise=true , address=212.102.52.215:4389 , piece_id=ZWMP5HZ46SCGWGYG5YFUOBAWIJYH7SC7LMXP2WRCDN56VHY7MMOA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.114217373 (34h15m18.897557472s) [noise=true , address=212.102.52.216:4411 , piece_id=XVTGPIXYPVJCVGQXAKSVZXH6CAJZUZM6BU2XLRHQY5HVHCUTOL4Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.116598127 (34h15m18.899938226s) [noise=true , address=212.102.52.215:4382 , piece_id=K4HENFKKVM6U2OFDX5RDRT4RQF76YRXQ6YT3R7W2IDRMUQM7RJKQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.117364549 (34h15m18.900704638s) [noise=true , address=212.102.52.215:4374 , piece_id=5PJXH7J3GPQANUTHRNASWS7IIOPK6ZCEYTQV7HJCHNDFUTFXLLYA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.118288161 (34h15m18.90162826s) [noise=true , address=212.102.52.217:4435 , piece_id=B6XPVKZCMSCTYFXH6PLHYJZFZMCDEP34IC4NTLRNB7BJKBU2GY3Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.118389785 (34h15m18.901729894s) [noise=true , address=212.102.52.214:4351 , piece_id=HPEPPDU2RQL4EOB5IPV6V27RBKC7TCBBAQJ76P54IWDUKVZEK5KQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.121953905 (34h15m18.905294004s) [noise=true , address=212.102.52.217:4423 , piece_id=Y545RC3YMIHHHSNS5OSA2SXTXJFZ5HDI6OF6J5JF5N4N6IQ3MI6Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.121969375 (34h15m18.905309544s) [seg_pos={0 0}, upload=32801]: Satisfied cohort requirements after 16 pieces May 26 12:19:33.122163295 (34h15m18.905503394s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJ3Cc6SDXz1kVAonxneo6cmqGJSyarDuB7mnLpk3jptn72B97): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122184926 (34h15m18.905525025s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122219532 (34h15m18.905559641s) [noise=true , address=212.102.52.213:4341 , piece_id=ZYQH7GINHGIDJAP7VYYWZV4UHEUNYBJ6OSF6WQWHOOQY3MVOVFLQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K65J7VCBmysqtxarNThUGarMstzQxGicA9LN4EbXhyDSR64mh): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122231184 (34h15m18.905571323s) [noise=true , address=212.102.52.213:4341 , piece_id=ZYQH7GINHGIDJAP7VYYWZV4UHEUNYBJ6OSF6WQWHOOQY3MVOVFLQ, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122440644 (34h15m18.905780743s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ba2xzEg4HQRMyHzTfny9mKtSRRrs9upRgRdax4U3RWwG8w7g7): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122448329 (34h15m18.905788428s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122460963 (34h15m18.905801052s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tz4zmQwQuZRv11trxzYvGvc7UHKHaz9edHsd6KPeK3V4usmUr): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122468277 (34h15m18.905808376s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122484839 (34h15m18.905824928s) [seg_pos={0 0}, upload=32801]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:19:33.122574470 (34h15m18.905914569s) [upload=32801]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:19:33.122580351 (34h15m18.90592048s) [upload=32801]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:20:00.406268993 (34h15m46.189609092s) [upload=32801]: Done uploading segments... May 26 12:20:00.406311565 (34h15m46.189651664s) [upload=32801]: Upload finished. err: metaclient: context deadline exceeded Duration: 7.318592023s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [..................X......X.................................X] duration: 1m3.109927733s trace: https://jaeger.dev.storj.io/trace/75b508fa4998aa64 FAIL (2026-05-26 12:20:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =32801]: Uploading piece... May 26 12:19:31.716941461 (34h15m17.50028156s) [noise=true , address=212.102.52.214:4351 , piece_id=HPEPPDU2RQL4EOB5IPV6V27RBKC7TCBBAQJ76P54IWDUKVZEK5KQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717202910 (34h15m17.500543009s) [noise=true , address=212.102.52.216:4393 , piece_id=PEPRXU3OY327CCBWLLK2MWGPETCKZ4OURWEWA65UYRPOV6J46WFA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717209863 (34h15m17.500549962s) [noise=true , address=212.102.52.217:4440 , piece_id=ZEKBZTSKD54RTDEMPDFAQF6HNNHMFILY7NUXTTBACEDFRXDUXCIA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717457876 (34h15m17.500797975s) [noise=true , address=212.102.52.215:4382 , piece_id=K4HENFKKVM6U2OFDX5RDRT4RQF76YRXQ6YT3R7W2IDRMUQM7RJKQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717560773 (34h15m17.500900872s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717839194 (34h15m17.501179283s) [noise=true , address=212.102.52.217:4423 , piece_id=Y545RC3YMIHHHSNS5OSA2SXTXJFZ5HDI6OF6J5JF5N4N6IQ3MI6Q, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717884921 (34h15m17.50122502s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718141300 (34h15m17.5014814s) [noise=true , address=212.102.52.216:4413 , piece_id=E4JSJJFL3M42V7PC24QLWBFCDRVHQ7AH2ZX235B44CUY4QQYZCIA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718208198 (34h15m17.501548287s) [noise=true , address=212.102.52.213:4331 , piece_id=E6TKWX5TC4RPER7RD3V7XDZFJUBXB5Z2DNBMIFCSWSNOGHHXUWNA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718532437 (34h15m17.501872536s) [noise=true , address=212.102.52.213:4332 , piece_id=QWOVHF52QDFKFIQUD3N6DOGRAZZXMFF66GE7GOO6LPC225MJMYWA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718878607 (34h15m17.502218706s) [noise=true , address=212.102.52.214:4360 , piece_id=4O462KAS5NDNF2OS56LIM23LZUMDFF6PPX3DNS2J4YOVS72FI5NQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719174882 (34h15m17.502514971s) [noise=true , address=212.102.52.214:4346 , piece_id=M77OWJXNJDC7PQPIWF7ETB7SXA4MIT2S6B5R6F56YYGWVC33HIMQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719492419 (34h15m17.502832518s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719784156 (34h15m17.503124255s) [noise=true , address=212.102.52.215:4389 , piece_id=ZWMP5HZ46SCGWGYG5YFUOBAWIJYH7SC7LMXP2WRCDN56VHY7MMOA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.720031868 (34h15m17.503371957s) [noise=true , address=212.102.52.215:4374 , piece_id=5PJXH7J3GPQANUTHRNASWS7IIOPK6ZCEYTQV7HJCHNDFUTFXLLYA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:32.784571496 (34h15m18.567911595s) [upload=32801]: Next returned nil segment May 26 12:19:32.784582568 (34h15m18.567922667s) [upload=32801]: Waiting for error group managing segments... May 26 12:19:33.062237028 (34h15m18.845577127s) [noise=true , address=212.102.52.217:4422 , piece_id=5GSTTHDL5KJLLOEEKPRDR4ALMQRJS7TR3OWRRBPWI4W6MW6PTLBA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.064059716 (34h15m18.847399815s) [noise=true , address=212.102.52.214:4348 , piece_id=ODTUOV7TRRSO5EONFHQSKIEE6P2ZXZVHTYOF52P3Z6OYYZH6AH3A, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.069664922 (34h15m18.853005011s) [noise=true , address=212.102.52.217:4440 , piece_id=ZEKBZTSKD54RTDEMPDFAQF6HNNHMFILY7NUXTTBACEDFRXDUXCIA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.075595288 (34h15m18.858935387s) [noise=true , address=212.102.52.213:4332 , piece_id=QWOVHF52QDFKFIQUD3N6DOGRAZZXMFF66GE7GOO6LPC225MJMYWA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.076790227 (34h15m18.860130326s) [noise=true , address=212.102.52.216:4413 , piece_id=E4JSJJFL3M42V7PC24QLWBFCDRVHQ7AH2ZX235B44CUY4QQYZCIA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.078552991 (34h15m18.86189309s) [noise=true , address=212.102.52.216:4393 , piece_id=PEPRXU3OY327CCBWLLK2MWGPETCKZ4OURWEWA65UYRPOV6J46WFA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.110167946 (34h15m18.893508085s) [noise=true , address=212.102.52.214:4346 , piece_id=M77OWJXNJDC7PQPIWF7ETB7SXA4MIT2S6B5R6F56YYGWVC33HIMQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.110318544 (34h15m18.893658633s) [noise=true , address=212.102.52.213:4331 , piece_id=E6TKWX5TC4RPER7RD3V7XDZFJUBXB5Z2DNBMIFCSWSNOGHHXUWNA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.111555875 (34h15m18.894895974s) [noise=true , address=212.102.52.214:4360 , piece_id=4O462KAS5NDNF2OS56LIM23LZUMDFF6PPX3DNS2J4YOVS72FI5NQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.111803587 (34h15m18.895143676s) [noise=true , address=212.102.52.215:4389 , piece_id=ZWMP5HZ46SCGWGYG5YFUOBAWIJYH7SC7LMXP2WRCDN56VHY7MMOA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.114217373 (34h15m18.897557472s) [noise=true , address=212.102.52.216:4411 , piece_id=XVTGPIXYPVJCVGQXAKSVZXH6CAJZUZM6BU2XLRHQY5HVHCUTOL4Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.116598127 (34h15m18.899938226s) [noise=true , address=212.102.52.215:4382 , piece_id=K4HENFKKVM6U2OFDX5RDRT4RQF76YRXQ6YT3R7W2IDRMUQM7RJKQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.117364549 (34h15m18.900704638s) [noise=true , address=212.102.52.215:4374 , piece_id=5PJXH7J3GPQANUTHRNASWS7IIOPK6ZCEYTQV7HJCHNDFUTFXLLYA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.118288161 (34h15m18.90162826s) [noise=true , address=212.102.52.217:4435 , piece_id=B6XPVKZCMSCTYFXH6PLHYJZFZMCDEP34IC4NTLRNB7BJKBU2GY3Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.118389785 (34h15m18.901729894s) [noise=true , address=212.102.52.214:4351 , piece_id=HPEPPDU2RQL4EOB5IPV6V27RBKC7TCBBAQJ76P54IWDUKVZEK5KQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.121953905 (34h15m18.905294004s) [noise=true , address=212.102.52.217:4423 , piece_id=Y545RC3YMIHHHSNS5OSA2SXTXJFZ5HDI6OF6J5JF5N4N6IQ3MI6Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.121969375 (34h15m18.905309544s) [seg_pos={0 0}, upload=32801]: Satisfied cohort requirements after 16 pieces May 26 12:19:33.122163295 (34h15m18.905503394s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJ3Cc6SDXz1kVAonxneo6cmqGJSyarDuB7mnLpk3jptn72B97): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122184926 (34h15m18.905525025s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122219532 (34h15m18.905559641s) [noise=true , address=212.102.52.213:4341 , piece_id=ZYQH7GINHGIDJAP7VYYWZV4UHEUNYBJ6OSF6WQWHOOQY3MVOVFLQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K65J7VCBmysqtxarNThUGarMstzQxGicA9LN4EbXhyDSR64mh): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122231184 (34h15m18.905571323s) [noise=true , address=212.102.52.213:4341 , piece_id=ZYQH7GINHGIDJAP7VYYWZV4UHEUNYBJ6OSF6WQWHOOQY3MVOVFLQ, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122440644 (34h15m18.905780743s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ba2xzEg4HQRMyHzTfny9mKtSRRrs9upRgRdax4U3RWwG8w7g7): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122448329 (34h15m18.905788428s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122460963 (34h15m18.905801052s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tz4zmQwQuZRv11trxzYvGvc7UHKHaz9edHsd6KPeK3V4usmUr): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122468277 (34h15m18.905808376s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122484839 (34h15m18.905824928s) [seg_pos={0 0}, upload=32801]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:19:33.122574470 (34h15m18.905914569s) [upload=32801]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:19:33.122580351 (34h15m18.90592048s) [upload=32801]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:20:00.406268993 (34h15m46.189609092s) [upload=32801]: Done uploading segments... May 26 12:20:00.406311565 (34h15m46.189651664s) [upload=32801]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m3.109944906s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...................X......X.................................] duration: 4.254926785s trace: https://jaeger.dev.storj.io/trace/212a008cd4977242 FAIL (2026-05-26 12:18:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 11:53:52.802227335 (33h49m38.585567434s) [upload=32397]: Starting upload May 26 11:53:52.802261710 (33h49m38.585601799s) [upload=32397]: Done starting upload May 26 11:53:52.802318218 (33h49m38.585658317s) [upload=32397]: Uploading segments... May 26 11:53:52.802509853 (33h49m38.585849962s) [upload=32397]: Got next segment. Inline: false May 26 11:53:52.802535192 (33h49m38.585875291s) [upload=32397]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 11:53:52.802538969 (33h49m38.585879068s) [upload=32397]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 11:54:32.191523004 (33h50m17.974863103s) [upload=32397]: Next segment err: context deadline exceeded May 26 11:54:32.191778802 (33h50m17.975118901s) [upload=32397]: Done uploading segments... May 26 11:54:32.191812175 (33h50m17.975152274s) [upload=32397]: Upload finished. err: context deadline exceeded Duration: 4.254938357s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [X...................X......X................................] duration: 4.13549278s trace: https://jaeger.dev.storj.io/trace/212a008cd4977242 FAIL (2026-05-26 12:17:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 11:53:52.802227335 (33h49m38.585567434s) [upload=32397]: Starting upload May 26 11:53:52.802261710 (33h49m38.585601799s) [upload=32397]: Done starting upload May 26 11:53:52.802318218 (33h49m38.585658317s) [upload=32397]: Uploading segments... May 26 11:53:52.802509853 (33h49m38.585849962s) [upload=32397]: Got next segment. Inline: false May 26 11:53:52.802535192 (33h49m38.585875291s) [upload=32397]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 11:53:52.802538969 (33h49m38.585879068s) [upload=32397]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 11:54:32.191523004 (33h50m17.974863103s) [upload=32397]: Next segment err: context deadline exceeded May 26 11:54:32.191778802 (33h50m17.975118901s) [upload=32397]: Done uploading segments... May 26 11:54:32.191812175 (33h50m17.975152274s) [upload=32397]: Upload finished. err: context deadline exceeded Duration: 4.135512749s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.X...................X......X...............................] duration: 4.118384689s trace: https://jaeger.dev.storj.io/trace/212a008cd4977242 FAIL (2026-05-26 12:17:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 11:53:52.802227335 (33h49m38.585567434s) [upload=32397]: Starting upload May 26 11:53:52.802261710 (33h49m38.585601799s) [upload=32397]: Done starting upload May 26 11:53:52.802318218 (33h49m38.585658317s) [upload=32397]: Uploading segments... May 26 11:53:52.802509853 (33h49m38.585849962s) [upload=32397]: Got next segment. Inline: false May 26 11:53:52.802535192 (33h49m38.585875291s) [upload=32397]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 11:53:52.802538969 (33h49m38.585879068s) [upload=32397]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 11:54:32.191523004 (33h50m17.974863103s) [upload=32397]: Next segment err: context deadline exceeded May 26 11:54:32.191778802 (33h50m17.975118901s) [upload=32397]: Done uploading segments... May 26 11:54:32.191812175 (33h50m17.975152274s) [upload=32397]: Upload finished. err: context deadline exceeded Duration: 4.118405067s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [..X...................X......X..............................] duration: 6.724369761s trace: https://jaeger.dev.storj.io/trace/212a008cd4977242 FAIL (2026-05-26 12:16:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 11:53:52.802227335 (33h49m38.585567434s) [upload=32397]: Starting upload May 26 11:53:52.802261710 (33h49m38.585601799s) [upload=32397]: Done starting upload May 26 11:53:52.802318218 (33h49m38.585658317s) [upload=32397]: Uploading segments... May 26 11:53:52.802509853 (33h49m38.585849962s) [upload=32397]: Got next segment. Inline: false May 26 11:53:52.802535192 (33h49m38.585875291s) [upload=32397]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 11:53:52.802538969 (33h49m38.585879068s) [upload=32397]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 11:54:32.191523004 (33h50m17.974863103s) [upload=32397]: Next segment err: context deadline exceeded May 26 11:54:32.191778802 (33h50m17.975118901s) [upload=32397]: Done uploading segments... May 26 11:54:32.191812175 (33h50m17.975152274s) [upload=32397]: Upload finished. err: context deadline exceeded Duration: 6.724384238s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [...X...................X......X.............................] duration: 4.33793701s trace: https://jaeger.dev.storj.io/trace/212a008cd4977242 FAIL (2026-05-26 12:15:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 11:53:52.802227335 (33h49m38.585567434s) [upload=32397]: Starting upload May 26 11:53:52.802261710 (33h49m38.585601799s) [upload=32397]: Done starting upload May 26 11:53:52.802318218 (33h49m38.585658317s) [upload=32397]: Uploading segments... May 26 11:53:52.802509853 (33h49m38.585849962s) [upload=32397]: Got next segment. Inline: false May 26 11:53:52.802535192 (33h49m38.585875291s) [upload=32397]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 11:53:52.802538969 (33h49m38.585879068s) [upload=32397]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 11:54:32.191523004 (33h50m17.974863103s) [upload=32397]: Next segment err: context deadline exceeded May 26 11:54:32.191778802 (33h50m17.975118901s) [upload=32397]: Done uploading segments... May 26 11:54:32.191812175 (33h50m17.975152274s) [upload=32397]: Upload finished. err: context deadline exceeded Duration: 4.337950666s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [....X...................X......X............................] duration: 3.993134619s trace: https://jaeger.dev.storj.io/trace/212a008cd4977242 FAIL (2026-05-26 12:14:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 11:53:52.802227335 (33h49m38.585567434s) [upload=32397]: Starting upload May 26 11:53:52.802261710 (33h49m38.585601799s) [upload=32397]: Done starting upload May 26 11:53:52.802318218 (33h49m38.585658317s) [upload=32397]: Uploading segments... May 26 11:53:52.802509853 (33h49m38.585849962s) [upload=32397]: Got next segment. Inline: false May 26 11:53:52.802535192 (33h49m38.585875291s) [upload=32397]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 11:53:52.802538969 (33h49m38.585879068s) [upload=32397]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 11:54:32.191523004 (33h50m17.974863103s) [upload=32397]: Next segment err: context deadline exceeded May 26 11:54:32.191778802 (33h50m17.975118901s) [upload=32397]: Done uploading segments... May 26 11:54:32.191812175 (33h50m17.975152274s) [upload=32397]: Upload finished. err: context deadline exceeded Duration: 3.993158062s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.....X...................X......X...........................] duration: 4.185418908s trace: https://jaeger.dev.storj.io/trace/212a008cd4977242 FAIL (2026-05-26 12:14:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 11:53:52.802227335 (33h49m38.585567434s) [upload=32397]: Starting upload May 26 11:53:52.802261710 (33h49m38.585601799s) [upload=32397]: Done starting upload May 26 11:53:52.802318218 (33h49m38.585658317s) [upload=32397]: Uploading segments... May 26 11:53:52.802509853 (33h49m38.585849962s) [upload=32397]: Got next segment. Inline: false May 26 11:53:52.802535192 (33h49m38.585875291s) [upload=32397]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 11:53:52.802538969 (33h49m38.585879068s) [upload=32397]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 11:54:32.191523004 (33h50m17.974863103s) [upload=32397]: Next segment err: context deadline exceeded May 26 11:54:32.191778802 (33h50m17.975118901s) [upload=32397]: Done uploading segments... May 26 11:54:32.191812175 (33h50m17.975152274s) [upload=32397]: Upload finished. err: context deadline exceeded Duration: 4.185433075s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [......X...................X......X..........................] duration: 50.505105733s trace: https://jaeger.dev.storj.io/trace/212a008cd4977242 FAIL (2026-05-26 12:13:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 11:53:52.802227335 (33h49m38.585567434s) [upload=32397]: Starting upload May 26 11:53:52.802261710 (33h49m38.585601799s) [upload=32397]: Done starting upload May 26 11:53:52.802318218 (33h49m38.585658317s) [upload=32397]: Uploading segments... May 26 11:53:52.802509853 (33h49m38.585849962s) [upload=32397]: Got next segment. Inline: false May 26 11:53:52.802535192 (33h49m38.585875291s) [upload=32397]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 11:53:52.802538969 (33h49m38.585879068s) [upload=32397]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 11:54:32.191523004 (33h50m17.974863103s) [upload=32397]: Next segment err: context deadline exceeded May 26 11:54:32.191778802 (33h50m17.975118901s) [upload=32397]: Done uploading segments... May 26 11:54:32.191812175 (33h50m17.975152274s) [upload=32397]: Upload finished. err: context deadline exceeded Duration: 50.505118167s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.......X...................X......X.........................] duration: 7.130046586s trace: https://jaeger.dev.storj.io/trace/212a008cd4977242 FAIL (2026-05-26 12:12:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 11:53:52.802227335 (33h49m38.585567434s) [upload=32397]: Starting upload May 26 11:53:52.802261710 (33h49m38.585601799s) [upload=32397]: Done starting upload May 26 11:53:52.802318218 (33h49m38.585658317s) [upload=32397]: Uploading segments... May 26 11:53:52.802509853 (33h49m38.585849962s) [upload=32397]: Got next segment. Inline: false May 26 11:53:52.802535192 (33h49m38.585875291s) [upload=32397]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 11:53:52.802538969 (33h49m38.585879068s) [upload=32397]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 11:54:32.191523004 (33h50m17.974863103s) [upload=32397]: Next segment err: context deadline exceeded May 26 11:54:32.191778802 (33h50m17.975118901s) [upload=32397]: Done uploading segments... May 26 11:54:32.191812175 (33h50m17.975152274s) [upload=32397]: Upload finished. err: context deadline exceeded Duration: 7.130068398s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [........X...................X......X........................] duration: 3.9091943s trace: https://jaeger.dev.storj.io/trace/212a008cd4977242 FAIL (2026-05-26 12:11:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 11:53:52.802227335 (33h49m38.585567434s) [upload=32397]: Starting upload May 26 11:53:52.802261710 (33h49m38.585601799s) [upload=32397]: Done starting upload May 26 11:53:52.802318218 (33h49m38.585658317s) [upload=32397]: Uploading segments... May 26 11:53:52.802509853 (33h49m38.585849962s) [upload=32397]: Got next segment. Inline: false May 26 11:53:52.802535192 (33h49m38.585875291s) [upload=32397]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 11:53:52.802538969 (33h49m38.585879068s) [upload=32397]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 11:54:32.191523004 (33h50m17.974863103s) [upload=32397]: Next segment err: context deadline exceeded May 26 11:54:32.191778802 (33h50m17.975118901s) [upload=32397]: Done uploading segments... May 26 11:54:32.191812175 (33h50m17.975152274s) [upload=32397]: Upload finished. err: context deadline exceeded Duration: 3.90921625s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.........X...................X......X.......................] duration: 4.0705651s trace: https://jaeger.dev.storj.io/trace/212a008cd4977242 FAIL (2026-05-26 12:11:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 11:53:52.802227335 (33h49m38.585567434s) [upload=32397]: Starting upload May 26 11:53:52.802261710 (33h49m38.585601799s) [upload=32397]: Done starting upload May 26 11:53:52.802318218 (33h49m38.585658317s) [upload=32397]: Uploading segments... May 26 11:53:52.802509853 (33h49m38.585849962s) [upload=32397]: Got next segment. Inline: false May 26 11:53:52.802535192 (33h49m38.585875291s) [upload=32397]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 11:53:52.802538969 (33h49m38.585879068s) [upload=32397]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 11:54:32.191523004 (33h50m17.974863103s) [upload=32397]: Next segment err: context deadline exceeded May 26 11:54:32.191778802 (33h50m17.975118901s) [upload=32397]: Done uploading segments... May 26 11:54:32.191812175 (33h50m17.975152274s) [upload=32397]: Upload finished. err: context deadline exceeded Duration: 4.070585147s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [..........X...................X......X......................] duration: 4.12063552s trace: https://jaeger.dev.storj.io/trace/212a008cd4977242 FAIL (2026-05-26 12:10:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 11:53:52.802227335 (33h49m38.585567434s) [upload=32397]: Starting upload May 26 11:53:52.802261710 (33h49m38.585601799s) [upload=32397]: Done starting upload May 26 11:53:52.802318218 (33h49m38.585658317s) [upload=32397]: Uploading segments... May 26 11:53:52.802509853 (33h49m38.585849962s) [upload=32397]: Got next segment. Inline: false May 26 11:53:52.802535192 (33h49m38.585875291s) [upload=32397]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 11:53:52.802538969 (33h49m38.585879068s) [upload=32397]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 11:54:32.191523004 (33h50m17.974863103s) [upload=32397]: Next segment err: context deadline exceeded May 26 11:54:32.191778802 (33h50m17.975118901s) [upload=32397]: Done uploading segments... May 26 11:54:32.191812175 (33h50m17.975152274s) [upload=32397]: Upload finished. err: context deadline exceeded Duration: 4.120657633s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [...........X...................X......X.....................] duration: 4.006286121s trace: https://jaeger.dev.storj.io/trace/212a008cd4977242 FAIL (2026-05-26 12:10:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 11:53:52.802227335 (33h49m38.585567434s) [upload=32397]: Starting upload May 26 11:53:52.802261710 (33h49m38.585601799s) [upload=32397]: Done starting upload May 26 11:53:52.802318218 (33h49m38.585658317s) [upload=32397]: Uploading segments... May 26 11:53:52.802509853 (33h49m38.585849962s) [upload=32397]: Got next segment. Inline: false May 26 11:53:52.802535192 (33h49m38.585875291s) [upload=32397]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 11:53:52.802538969 (33h49m38.585879068s) [upload=32397]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 11:54:32.191523004 (33h50m17.974863103s) [upload=32397]: Next segment err: context deadline exceeded May 26 11:54:32.191778802 (33h50m17.975118901s) [upload=32397]: Done uploading segments... May 26 11:54:32.191812175 (33h50m17.975152274s) [upload=32397]: Upload finished. err: context deadline exceeded Duration: 4.006305969s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [............X...................X......X....................] duration: 5.186997105s trace: https://jaeger.dev.storj.io/trace/212a008cd4977242 FAIL (2026-05-26 12:09:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 11:53:52.802227335 (33h49m38.585567434s) [upload=32397]: Starting upload May 26 11:53:52.802261710 (33h49m38.585601799s) [upload=32397]: Done starting upload May 26 11:53:52.802318218 (33h49m38.585658317s) [upload=32397]: Uploading segments... May 26 11:53:52.802509853 (33h49m38.585849962s) [upload=32397]: Got next segment. Inline: false May 26 11:53:52.802535192 (33h49m38.585875291s) [upload=32397]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 11:53:52.802538969 (33h49m38.585879068s) [upload=32397]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 11:54:32.191523004 (33h50m17.974863103s) [upload=32397]: Next segment err: context deadline exceeded May 26 11:54:32.191778802 (33h50m17.975118901s) [upload=32397]: Done uploading segments... May 26 11:54:32.191812175 (33h50m17.975152274s) [upload=32397]: Upload finished. err: context deadline exceeded Duration: 5.187008116s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.999516084s trace: https://jaeger.dev.storj.io/trace/1f80eefb3d29cbe3 FAIL (2026-05-26 12:09:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.999537244s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.927236748s trace: https://jaeger.dev.storj.io/trace/1f80eefb3d29cbe3 FAIL (2026-05-26 12:09:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.92725415s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)