Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure

Orbiter Check History

Showing 50 of 710747 reports (Page 271 of 14215)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................]
duration:
5.592438324s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:48:23 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 5.592472709s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................]
duration:
6.292380508s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:47:43 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 6.292406697s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration:
5.789066782s
trace:
https://jaeger.dev.storj.io/trace/77c8413fbffe335b
FAIL (2026-04-16 17:47:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.789116118s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................]
duration:
6.473867207s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:47:03 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 6.473893639s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................]
duration:
6.744017018s
trace:
https://jaeger.dev.storj.io/trace/77c8413fbffe335b
FAIL (2026-04-16 17:46:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.744040194s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................]
duration:
5.800918579s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:46:27 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 5.800944929s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................]
duration:
6.699993362s
trace:
https://jaeger.dev.storj.io/trace/77c8413fbffe335b
FAIL (2026-04-16 17:46:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.700020734s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................]
duration:
6.753794749s
trace:
https://jaeger.dev.storj.io/trace/77c8413fbffe335b
FAIL (2026-04-16 17:45:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.75389408s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................]
duration:
6.319822287s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:45:36 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 6.319846184s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................]
duration:
5.733025839s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:45:10 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 5.733053744s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration:
6.706258248s
trace:
https://jaeger.dev.storj.io/trace/77c8413fbffe335b
FAIL (2026-04-16 17:44:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.706307623s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................]
duration:
5.48837677s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:44:53 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 5.488398812s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................]
duration:
5.564940913s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:44:04 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 5.564961284s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
6.670054697s
trace:
https://jaeger.dev.storj.io/trace/77c8413fbffe335b
FAIL (2026-04-16 17:43:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.670083593s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration:
6.691590242s
trace:
https://jaeger.dev.storj.io/trace/77c8413fbffe335b
FAIL (2026-04-16 17:43:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.691619179s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................]
duration:
5.408273393s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:43:12 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 5.408295404s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................]
duration:
6.701896483s
trace:
https://jaeger.dev.storj.io/trace/77c8413fbffe335b
FAIL (2026-04-16 17:42:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.701919747s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................]
duration:
6.721398926s
trace:
https://jaeger.dev.storj.io/trace/77c8413fbffe335b
FAIL (2026-04-16 17:42:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.72142232s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................]
duration:
5.42161636s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:42:17 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 5.421644233s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................]
duration:
6.386800441s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:41:30 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 6.386827523s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................]
duration:
5.937245977s
trace:
https://jaeger.dev.storj.io/trace/77c8413fbffe335b
FAIL (2026-04-16 17:41:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.937273921s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................]
duration:
5.796752117s
trace:
https://jaeger.dev.storj.io/trace/77c8413fbffe335b
FAIL (2026-04-16 17:40:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.79681054s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................]
duration:
6.227189572s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:40:19 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 6.227217415s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................]
duration:
5.69835676s
trace:
https://jaeger.dev.storj.io/trace/77c8413fbffe335b
FAIL (2026-04-16 17:40:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.698409232s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................]
duration:
5.669749205s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:39:49 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 5.669772951s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
2 out of 60 is failed (threshold=3) [X............X..............................................]
duration:
5.718266247s
trace:
https://jaeger.dev.storj.io/trace/77c8413fbffe335b
FAIL (2026-04-16 17:39:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.71829346s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................]
duration:
6.340998618s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:39:05 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 6.341015322s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
2 out of 60 is failed (threshold=3) [.X............X.............................................]
duration:
5.793931221s
trace:
https://jaeger.dev.storj.io/trace/77c8413fbffe335b
FAIL (2026-04-16 17:38:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.793970266s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
2 out of 60 is failed (threshold=3) [..X............X............................................]
duration:
5.686769289s
trace:
https://jaeger.dev.storj.io/trace/77c8413fbffe335b
FAIL (2026-04-16 17:38:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.686792092s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................]
duration:
5.48863913s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:38:04 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 5.488658536s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
2 out of 60 is failed (threshold=3) [...X............X...........................................]
duration:
5.634529024s
trace:
https://jaeger.dev.storj.io/trace/77c8413fbffe335b
FAIL (2026-04-16 17:37:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.63455275s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................]
duration:
5.481649407s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:37:44 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 5.481675988s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................]
duration:
6.3176018s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:37:18 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 6.317642529s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
2 out of 60 is failed (threshold=3) [....X............X..........................................]
duration:
5.635762435s
trace:
https://jaeger.dev.storj.io/trace/77c8413fbffe335b
FAIL (2026-04-16 17:37:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.635785049s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
2 out of 60 is failed (threshold=3) [.....X............X.........................................]
duration:
5.756024893s
trace:
https://jaeger.dev.storj.io/trace/77c8413fbffe335b
FAIL (2026-04-16 17:36:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.756051765s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................]
duration:
5.699095152s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:36:28 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 5.699117896s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................]
duration:
5.639004453s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:35:35 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 5.639134916s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
2 out of 60 is failed (threshold=3) [......X............X........................................]
duration:
5.586909854s
trace:
https://jaeger.dev.storj.io/trace/77c8413fbffe335b
FAIL (2026-04-16 17:35:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.58693793s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................]
duration:
5.852237918s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:34:46 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 5.85226515s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
2 out of 60 is failed (threshold=3) [.......X............X.......................................]
duration:
5.652338909s
trace:
https://jaeger.dev.storj.io/trace/77c8413fbffe335b
FAIL (2026-04-16 17:34:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.652363176s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................]
duration:
5.682879568s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:34:02 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 5.682926168s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................]
duration:
5.413287473s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:33:35 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 5.413313513s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
2 out of 60 is failed (threshold=3) [........X............X......................................]
duration:
5.753507126s
trace:
https://jaeger.dev.storj.io/trace/77c8413fbffe335b
FAIL (2026-04-16 17:33:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.753539269s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
2 out of 60 is failed (threshold=3) [.........X............X.....................................]
duration:
5.851543883s
trace:
https://jaeger.dev.storj.io/trace/77c8413fbffe335b
FAIL (2026-04-16 17:33:05 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.851570364s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................]
duration:
6.299400804s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:32:40 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 6.299420252s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................]
duration:
5.784636462s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:32:25 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 5.78465618s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................]
duration:
5.533488684s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:31:59 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 5.533513462s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
2 out of 60 is failed (threshold=3) [..........X............X....................................]
duration:
5.97647312s
trace:
https://jaeger.dev.storj.io/trace/77c8413fbffe335b
FAIL (2026-04-16 17:31:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.976501114s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration:
6.326921077s
trace:
https://jaeger.dev.storj.io/trace/18375dfb88f56bd8
FAIL (2026-04-16 17:31:28 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece...
Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment
Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments...
Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479    , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736    , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928    , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058  , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992  , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070  , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307  , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135    , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767     , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599     , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566   , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819   , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851     , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821   , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil>
Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces
Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924   , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895   , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344   , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF
Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold
Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments...
Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil>
Duration: 6.326942758s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
2 out of 60 is failed (threshold=3) [...........X............X...................................]
duration:
5.831976295s
trace:
https://jaeger.dev.storj.io/trace/77c8413fbffe335b
FAIL (2026-04-16 17:30:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.832017646s core uplink us-select-1 us1-placement-20