Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.413287473s trace: https://jaeger.dev.storj.io/trace/18375dfb88f56bd8 FAIL (2026-04-16 17:33:35 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== 7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments... Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928 , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments... Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil> Duration: 5.413313513s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [........X............X......................................] duration: 5.753507126s trace: https://jaeger.dev.storj.io/trace/77c8413fbffe335b FAIL (2026-04-16 17:33:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.753539269s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.........X............X.....................................] duration: 5.851543883s trace: https://jaeger.dev.storj.io/trace/77c8413fbffe335b FAIL (2026-04-16 17:33:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.851570364s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 6.299400804s trace: https://jaeger.dev.storj.io/trace/18375dfb88f56bd8 FAIL (2026-04-16 17:32:40 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== 7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments... Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928 , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments... Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil> Duration: 6.299420252s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.784636462s trace: https://jaeger.dev.storj.io/trace/18375dfb88f56bd8 FAIL (2026-04-16 17:32:25 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== 7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments... Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928 , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments... Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil> Duration: 5.78465618s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.533488684s trace: https://jaeger.dev.storj.io/trace/18375dfb88f56bd8 FAIL (2026-04-16 17:31:59 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== 7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments... Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928 , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments... Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil> Duration: 5.533513462s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..........X............X....................................] duration: 5.97647312s trace: https://jaeger.dev.storj.io/trace/77c8413fbffe335b FAIL (2026-04-16 17:31:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.976501114s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 6.326921077s trace: https://jaeger.dev.storj.io/trace/18375dfb88f56bd8 FAIL (2026-04-16 17:31:28 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== 7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments... Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928 , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments... Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil> Duration: 6.326942758s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...........X............X...................................] duration: 5.831976295s trace: https://jaeger.dev.storj.io/trace/77c8413fbffe335b FAIL (2026-04-16 17:30:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.832017646s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [............X............X..................................] duration: 5.917360625s trace: https://jaeger.dev.storj.io/trace/77c8413fbffe335b FAIL (2026-04-16 17:30:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.917402415s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.775164134s trace: https://jaeger.dev.storj.io/trace/18375dfb88f56bd8 FAIL (2026-04-16 17:30:34 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== 7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments... Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928 , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments... Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil> Duration: 5.775190273s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.............X............X.................................] duration: 5.852119884s trace: https://jaeger.dev.storj.io/trace/77c8413fbffe335b FAIL (2026-04-16 17:30:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.852153789s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.71466896s trace: https://jaeger.dev.storj.io/trace/18375dfb88f56bd8 FAIL (2026-04-16 17:29:40 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== 7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments... Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928 , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments... Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil> Duration: 5.714694328s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..............X............X................................] duration: 5.893620201s trace: https://jaeger.dev.storj.io/trace/77c8413fbffe335b FAIL (2026-04-16 17:29:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.893636583s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.792699442s trace: https://jaeger.dev.storj.io/trace/18375dfb88f56bd8 FAIL (2026-04-16 17:28:49 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== 7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments... Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928 , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments... Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil> Duration: 5.792712887s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...............X............X...............................] duration: 5.696003915s trace: https://jaeger.dev.storj.io/trace/77c8413fbffe335b FAIL (2026-04-16 17:28:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.696030326s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [X...........................................................] duration: 3.417727847s trace: https://jaeger.dev.storj.io/trace/2123f2dfdcb344b8 FAIL (2026-04-16 17:28:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.417753998s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.531011742s trace: https://jaeger.dev.storj.io/trace/18375dfb88f56bd8 FAIL (2026-04-16 17:28:12 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== 7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments... Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928 , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments... Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil> Duration: 5.531037783s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [XX..........................................................] duration: 3.380852624s trace: https://jaeger.dev.storj.io/trace/2123f2dfdcb344b8 FAIL (2026-04-16 17:27:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.380872843s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [................X............X..............................] duration: 5.755329927s trace: https://jaeger.dev.storj.io/trace/77c8413fbffe335b FAIL (2026-04-16 17:27:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.755355055s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 6.572663423s trace: https://jaeger.dev.storj.io/trace/18375dfb88f56bd8 FAIL (2026-04-16 17:27:02 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== 7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments... Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928 , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments... Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil> Duration: 6.572687039s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.................X............X.............................] duration: 5.675943104s trace: https://jaeger.dev.storj.io/trace/77c8413fbffe335b FAIL (2026-04-16 17:26:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.675970147s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.XX.........................................................] duration: 3.924977881s trace: https://jaeger.dev.storj.io/trace/2123f2dfdcb344b8 FAIL (2026-04-16 17:26:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.925050522s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.829300838s trace: https://jaeger.dev.storj.io/trace/18375dfb88f56bd8 FAIL (2026-04-16 17:26:40 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== 7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments... Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928 , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments... Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil> Duration: 5.829322131s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..XX........................................................] duration: 3.887443971s trace: https://jaeger.dev.storj.io/trace/2123f2dfdcb344b8 FAIL (2026-04-16 17:26:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.88746882s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.50398934s trace: https://jaeger.dev.storj.io/trace/18375dfb88f56bd8 FAIL (2026-04-16 17:26:08 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== 7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments... Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928 , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments... Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil> Duration: 6.504021681s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..................X............X............................] duration: 8.415725028s trace: https://jaeger.dev.storj.io/trace/77c8413fbffe335b FAIL (2026-04-16 17:25:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.41575708s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...XX.......................................................] duration: 3.96726134s trace: https://jaeger.dev.storj.io/trace/2123f2dfdcb344b8 FAIL (2026-04-16 17:25:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.967286168s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.757832797s trace: https://jaeger.dev.storj.io/trace/18375dfb88f56bd8 FAIL (2026-04-16 17:25:16 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== 7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments... Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928 , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments... Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil> Duration: 5.757858819s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...................X............X...........................] duration: 6.772391185s trace: https://jaeger.dev.storj.io/trace/77c8413fbffe335b FAIL (2026-04-16 17:24:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.772426072s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [X...XX......................................................] duration: 3.969317935s trace: https://jaeger.dev.storj.io/trace/2123f2dfdcb344b8 FAIL (2026-04-16 17:24:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.969362391s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 6.354682183s trace: https://jaeger.dev.storj.io/trace/18375dfb88f56bd8 FAIL (2026-04-16 17:24:06 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== 7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments... Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928 , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments... Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil> Duration: 6.354712121s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [....................X............X..........................] duration: 14.4216048s trace: https://jaeger.dev.storj.io/trace/77c8413fbffe335b FAIL (2026-04-16 17:23:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 14.421637002s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.X...XX.....................................................] duration: 3.978384907s trace: https://jaeger.dev.storj.io/trace/2123f2dfdcb344b8 FAIL (2026-04-16 17:23:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.978429875s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 6.493639105s trace: https://jaeger.dev.storj.io/trace/18375dfb88f56bd8 FAIL (2026-04-16 17:23:10 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== 7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments... Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928 , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments... Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil> Duration: 6.49367217s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [..X...XX....................................................] duration: 4.142698928s trace: https://jaeger.dev.storj.io/trace/2123f2dfdcb344b8 FAIL (2026-04-16 17:22:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.142716231s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.894943236s trace: https://jaeger.dev.storj.io/trace/18375dfb88f56bd8 FAIL (2026-04-16 17:22:50 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== 7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments... Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928 , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments... Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil> Duration: 5.894973224s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.....................X............X.........................] duration: 6.853171661s trace: https://jaeger.dev.storj.io/trace/77c8413fbffe335b FAIL (2026-04-16 17:22:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.853208613s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.601479116s trace: https://jaeger.dev.storj.io/trace/18375dfb88f56bd8 FAIL (2026-04-16 17:22:33 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== 7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments... Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928 , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments... Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil> Duration: 5.601523172s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [......................X............X........................] duration: 6.862015847s trace: https://jaeger.dev.storj.io/trace/77c8413fbffe335b FAIL (2026-04-16 17:21:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.86203788s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [...X...XX...................................................] duration: 3.922441056s trace: https://jaeger.dev.storj.io/trace/2123f2dfdcb344b8 FAIL (2026-04-16 17:21:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.922467107s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.592878188s trace: https://jaeger.dev.storj.io/trace/18375dfb88f56bd8 FAIL (2026-04-16 17:21:22 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== 7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments... Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928 , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments... Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil> Duration: 5.592900241s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [....X...XX..................................................] duration: 3.813588562s trace: https://jaeger.dev.storj.io/trace/2123f2dfdcb344b8 FAIL (2026-04-16 17:21:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.81361374s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.......................X............X.......................] duration: 7.11874214s trace: https://jaeger.dev.storj.io/trace/77c8413fbffe335b FAIL (2026-04-16 17:20:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.118786055s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [........................X............X......................] duration: 7.728718769s trace: https://jaeger.dev.storj.io/trace/77c8413fbffe335b FAIL (2026-04-16 17:20:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.728749459s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 6.464985558s trace: https://jaeger.dev.storj.io/trace/18375dfb88f56bd8 FAIL (2026-04-16 17:20:21 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== 7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments... Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928 , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments... Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil> Duration: 6.465015105s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.....X...XX.................................................] duration: 3.96207515s trace: https://jaeger.dev.storj.io/trace/2123f2dfdcb344b8 FAIL (2026-04-16 17:19:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.962104797s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 6.865153508s trace: https://jaeger.dev.storj.io/trace/18375dfb88f56bd8 FAIL (2026-04-16 17:19:43 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== 7:16:46.081029334 (217h30m32.900265358s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081083489 (217h30m32.900319513s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081456298 (217h30m32.900692322s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081466939 (217h30m32.900702953s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081769944 (217h30m32.901005968s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.081912458 (217h30m32.901148482s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082262003 (217h30m32.901498027s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082276170 (217h30m32.901512194s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082505273 (217h30m32.901741297s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082600978 (217h30m32.901837002s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082839959 (217h30m32.902075983s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.082846150 (217h30m32.902082174s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083155087 (217h30m32.902391121s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083523107 (217h30m32.902759131s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.083775504 (217h30m32.903011528s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084662686 (217h30m32.90389871s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:46.084937728 (217h30m32.904173752s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Uploading piece... Apr 16 17:16:47.424854215 (217h30m34.244090239s) [upload=208834]: Next returned nil segment Apr 16 17:16:47.424865816 (217h30m34.244101841s) [upload=208834]: Waiting for error group managing segments... Apr 16 17:16:47.799082116 (217h30m34.61831814s) [noise=true , address=64.49.13.139:4479 , piece_id=FF7AVM74DIB7OYLNZ56LL4NWWFJJO563X4RUK7LIAOM7YZN5DDZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.801436239 (217h30m34.620672263s) [noise=true , address=167.17.72.69:4736 , piece_id=WSQO2M6ETUBUUBE5Z5PNZUDR7EXM32RDHQZ3LLTOSDXTDMJTVQZA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.810010497 (217h30m34.629246521s) [noise=true , address=64.49.13.154:4928 , piece_id=7MMECETHEJFOHADBHLUHMEY7F5UZKCAIRHLEJTJRS3RL3CDR735Q, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.812039633 (217h30m34.631275657s) [noise=true , address=193.149.164.68:4058 , piece_id=OIZKVQCUTTKJK7ZGHVOEZ2TNEMJGXYY7Q6V2ELEW3TYBSKI3WZUA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.820798548 (217h30m34.640034572s) [noise=true , address=193.149.164.66:4992 , piece_id=NBZQCWZPS2PD3GIPQR3YHBMSSHYHC3BC6PHKOXHHJGW77BS6IQKQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.828887439 (217h30m34.648123463s) [noise=true , address=193.149.164.69:4070 , piece_id=BVGUYBOO6NSTQDHQP5DXXMJ2YIU4RNNYHCPWN3HUGIYOMZEIQI7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:47.864253936 (217h30m34.68348995s) [noise=true , address=193.149.164.71:4307 , piece_id=QHRURA7HRYWVJDU27M3LY6CSSVW6GGGO5YNV6XK2CWMQWV7RNCUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.025537038 (217h30m34.844773052s) [noise=true , address=45.91.116.11:4135 , piece_id=CPNEROHHCRNJWY2JWX3TWGY33S2SYSXGCDEYTRYNR5MB23TSJLHQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.053622572 (217h30m34.872858596s) [noise=true , address=77.90.31.16:4767 , piece_id=NGTRYN5FII3Y5AVUN3E2ILOYNOEYB56EUMUWZSQUMVIFLM3KFPUQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.065380986 (217h30m34.88461701s) [noise=true , address=77.90.31.12:4599 , piece_id=NVDWJEQHGESRQKYXD2LQTKXFOPI4AM7RHBAUWLXT3QGK6HDGR3JQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.068532819 (217h30m34.887768843s) [noise=true , address=145.79.227.23:4566 , piece_id=LH6BXHZB62NMT4GCMDRIEJ4OVWY27SJZTHPJXZBH6JL6NTKZQOWQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.311905833 (217h30m35.131141857s) [noise=true , address=145.79.227.13:4819 , piece_id=FJA33FA4V3VPELIKUKF73YRFKDR5LB3V2BQ5NN7MC5EHB5YY7FJQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.576595107 (217h30m35.395831131s) [noise=true , address=77.90.31.19:4851 , piece_id=P6JHQRMIGTO7KRCXM5X2ITV62FZ6RKTDJBJP6PPGM6QEKE3JPOMQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989423685 (217h30m35.808659709s) [noise=true , address=145.79.227.31:4821 , piece_id=ZVRZR72HVC5LJO2DLZ6QSGXHH2TOX2YJJSPEWPNFUA3CO24JQKSQ, seg_pos={0 0}, upload=208834]: Done uploading piece. err: <nil> Apr 16 17:16:48.989447893 (217h30m35.808683917s) [seg_pos={0 0}, upload=208834]: Satisfied cohort requirements after 14 pieces Apr 16 17:16:48.989690200 (217h30m35.808926224s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19TbrQjuN1EhBNVtha9EcKPSCAWyttfmHpec6QeF1S5zW6DRZs): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989701261 (217h30m35.808937335s) [noise=true , address=145.79.227.34:4924 , piece_id=A5FDZDUFBDRBQJRAQO7474Z6F25VIVOUL7F3DL3ST7IAEOX6B36A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.989728694 (217h30m35.808964718s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.989739746 (217h30m35.80897578s) [noise=true , address=145.79.227.33:4895 , piece_id=QHFHU7VWTEIRBEMVKZU7KC5J4ELOYHTBLWJITNEBJFZNIQWGIBFA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990059763 (217h30m35.809295807s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127WWD5hr1ZBkRLCHz3jb7kpqqnxPS6VuZ1MyQDmitFbhTSbJNK): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990068490 (217h30m35.809304515s) [noise=true , address=145.79.227.49:4344 , piece_id=PAOVGRW67H5DOCLQSHW7LISO756LANOUFULRBEVLPKRW32BGJJPA, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990085573 (217h30m35.809321607s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: expected piece hash; context canceled; EOF Apr 16 17:16:48.990094029 (217h30m35.809330053s) [noise=true , address=193.149.164.143:4701 , piece_id=N7YBA6A52QNU4MQPGVWPVSKJKIG4HCAO34YDPXPM4VOF4JV5FS7A, seg_pos={0 0}, upload=208834]: Long tail cancellation due to optimal threshold Apr 16 17:16:48.990111162 (217h30m35.809347187s) [seg_pos={0 0}, upload=208834]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Apr 16 17:16:48.990184183 (217h30m35.809420218s) [upload=208834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 16 17:16:48.990189854 (217h30m35.809425868s) [upload=208834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 16 17:16:49.284680986 (217h30m36.10391701s) [upload=208834]: Done uploading segments... Apr 16 17:16:49.284697357 (217h30m36.103933381s) [upload=208834]: Upload finished. err: <nil> Duration: 6.865184558s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [......X...XX................................................] duration: 4.120211668s trace: https://jaeger.dev.storj.io/trace/2123f2dfdcb344b8 FAIL (2026-04-16 17:19:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.120242909s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.........................X............X.....................] duration: 7.019886341s trace: https://jaeger.dev.storj.io/trace/77c8413fbffe335b FAIL (2026-04-16 17:19:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.019968339s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)