Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure

Orbiter Check History

Showing 50 of 903247 reports (Page 2555 of 18065)
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
3 out of 60 is failed (threshold=3) [.............X..................X...................X.......]
duration:
6.501575657s
trace:
https://jaeger.dev.storj.io/trace/2d2d09316081b818
FAIL (2026-05-26 00:30:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.501588112s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
2 out of 60 is failed (threshold=3) [............................X..X............................]
duration:
4.002611785s
trace:
https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef
FAIL (2026-05-26 00:30:48 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment
May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments...
May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347  , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390  , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353  , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386  , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382  , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces
May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments...
May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil>
Duration: 4.002636814s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
3 out of 60 is failed (threshold=3) [..............X..................X...................X......]
duration:
44.253248789s
trace:
https://jaeger.dev.storj.io/trace/2d2d09316081b818
FAIL (2026-05-26 00:30:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 44.25330639s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [.....X..............X.......................................]
duration:
3.868495909s
trace:
https://jaeger.dev.storj.io/trace/3bd7a1328937f878
FAIL (2026-05-26 00:30:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.868508092s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
2 out of 60 is failed (threshold=3) [.............................X..X...........................]
duration:
4.262030445s
trace:
https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef
FAIL (2026-05-26 00:30:24 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment
May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments...
May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347  , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390  , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353  , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386  , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382  , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces
May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments...
May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil>
Duration: 4.262054751s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
2 out of 60 is failed (threshold=3) [..............................X..X..........................]
duration:
10.279055203s
trace:
https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef
FAIL (2026-05-26 00:29:56 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment
May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments...
May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347  , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390  , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353  , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386  , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382  , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces
May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments...
May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil>
Duration: 10.279074569s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
3 out of 60 is failed (threshold=3) [...............X..................X...................X.....]
duration:
6.418758191s
trace:
https://jaeger.dev.storj.io/trace/2d2d09316081b818
FAIL (2026-05-26 00:29:33 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.41878373s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [......X..............X......................................]
duration:
3.782199793s
trace:
https://jaeger.dev.storj.io/trace/3bd7a1328937f878
FAIL (2026-05-26 00:29:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.782247152s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
4 out of 60 is failed (threshold=3) [X...............X..................X...................X....]
duration:
37.412318853s
trace:
https://jaeger.dev.storj.io/trace/2d2d09316081b818
FAIL (2026-05-26 00:29:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 37.412355915s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
2 out of 60 is failed (threshold=3) [...............................X..X.........................]
duration:
3.893014876s
trace:
https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef
FAIL (2026-05-26 00:29:06 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment
May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments...
May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347  , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390  , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353  , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386  , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382  , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces
May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments...
May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil>
Duration: 3.893053728s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [.......X..............X.....................................]
duration:
3.842826973s
trace:
https://jaeger.dev.storj.io/trace/3bd7a1328937f878
FAIL (2026-05-26 00:28:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.842851291s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
2 out of 60 is failed (threshold=3) [................................X..X........................]
duration:
4.186863778s
trace:
https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef
FAIL (2026-05-26 00:28:46 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment
May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments...
May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347  , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390  , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353  , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386  , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382  , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces
May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments...
May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil>
Duration: 4.186887704s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
4 out of 60 is failed (threshold=3) [.X...............X..................X...................X...]
duration:
6.639141126s
trace:
https://jaeger.dev.storj.io/trace/2d2d09316081b818
FAIL (2026-05-26 00:28:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.639161957s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
2 out of 60 is failed (threshold=3) [.................................X..X.......................]
duration:
3.937073181s
trace:
https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef
FAIL (2026-05-26 00:27:56 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment
May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments...
May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347  , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390  , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353  , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386  , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382  , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces
May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments...
May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil>
Duration: 3.937095815s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [........X..............X....................................]
duration:
3.700821871s
trace:
https://jaeger.dev.storj.io/trace/3bd7a1328937f878
FAIL (2026-05-26 00:27:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.700841147s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
5 out of 60 is failed (threshold=3) [X.X...............X..................X...................X..]
duration:
28.579577755s
trace:
https://jaeger.dev.storj.io/trace/2d2d09316081b818
FAIL (2026-05-26 00:27:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 28.579599548s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [.........X..............X...................................]
duration:
3.888100885s
trace:
https://jaeger.dev.storj.io/trace/3bd7a1328937f878
FAIL (2026-05-26 00:26:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.888115011s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
2 out of 60 is failed (threshold=3) [..................................X..X......................]
duration:
7.028335286s
trace:
https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef
FAIL (2026-05-26 00:26:56 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment
May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments...
May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347  , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390  , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353  , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386  , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382  , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces
May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments...
May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil>
Duration: 7.028347499s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [..........X..............X..................................]
duration:
4.714050851s
trace:
https://jaeger.dev.storj.io/trace/3bd7a1328937f878
FAIL (2026-05-26 00:26:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 4.714068466s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
2 out of 60 is failed (threshold=3) [...................................X..X.....................]
duration:
4.217732586s
trace:
https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef
FAIL (2026-05-26 00:25:57 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment
May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments...
May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347  , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390  , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353  , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386  , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382  , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces
May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments...
May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil>
Duration: 4.217753616s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
6 out of 60 is failed (threshold=3) [XX.X...............X..................X...................X.]
duration:
14.726714741s
trace:
https://jaeger.dev.storj.io/trace/2d2d09316081b818
FAIL (2026-05-26 00:25:56 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 14.726734168s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [...........X..............X.................................]
duration:
3.707958846s
trace:
https://jaeger.dev.storj.io/trace/3bd7a1328937f878
FAIL (2026-05-26 00:25:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.707999635s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
6 out of 60 is failed (threshold=3) [.XX.X...............X..................X...................X]
duration:
1m0.001291648s
trace:
https://jaeger.dev.storj.io/trace/2d2d09316081b818
FAIL (2026-05-26 00:25:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.001333367s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [............X..............X................................]
duration:
5.000896604s
trace:
https://jaeger.dev.storj.io/trace/3bd7a1328937f878
FAIL (2026-05-26 00:25:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000921781s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
2 out of 60 is failed (threshold=3) [....................................X..X....................]
duration:
4.134816772s
trace:
https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef
FAIL (2026-05-26 00:24:56 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment
May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments...
May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347  , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390  , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353  , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386  , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382  , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces
May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments...
May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil>
Duration: 4.134895592s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
2 out of 60 is failed (threshold=3) [.....................................X..X...................]
duration:
6.31508231s
trace:
https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef
FAIL (2026-05-26 00:24:36 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment
May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments...
May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347  , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390  , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353  , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386  , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382  , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces
May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments...
May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil>
Duration: 6.315102969s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [.............X..............X...............................]
duration:
3.829530273s
trace:
https://jaeger.dev.storj.io/trace/3bd7a1328937f878
FAIL (2026-05-26 00:24:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.829544941s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
5 out of 60 is failed (threshold=3) [..XX.X...............X..................X...................]
duration:
6.609979257s
trace:
https://jaeger.dev.storj.io/trace/4f326f7e35ea3a96
FAIL (2026-05-26 00:24:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.610000738s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
6 out of 60 is failed (threshold=3) [X..XX.X...............X..................X..................]
duration:
29.593207038s
trace:
https://jaeger.dev.storj.io/trace/4f326f7e35ea3a96
FAIL (2026-05-26 00:23:28 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 29.593228418s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
2 out of 60 is failed (threshold=3) [......................................X..X..................]
duration:
4.130638119s
trace:
https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef
FAIL (2026-05-26 00:23:25 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment
May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments...
May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347  , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390  , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353  , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386  , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382  , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces
May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments...
May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil>
Duration: 4.13065969s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [..............X..............X..............................]
duration:
3.763822221s
trace:
https://jaeger.dev.storj.io/trace/3bd7a1328937f878
FAIL (2026-05-26 00:23:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.76384803s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [...............X..............X.............................]
duration:
3.768332899s
trace:
https://jaeger.dev.storj.io/trace/3bd7a1328937f878
FAIL (2026-05-26 00:22:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.768355281s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
2 out of 60 is failed (threshold=3) [.......................................X..X.................]
duration:
5.209296871s
trace:
https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef
FAIL (2026-05-26 00:22:34 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment
May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments...
May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347  , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390  , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353  , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386  , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382  , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces
May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments...
May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil>
Duration: 5.209317911s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
6 out of 60 is failed (threshold=3) [.X..XX.X...............X..................X.................]
duration:
6.55698903s
trace:
https://jaeger.dev.storj.io/trace/4f326f7e35ea3a96
FAIL (2026-05-26 00:22:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.55701027s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
2 out of 60 is failed (threshold=3) [........................................X..X................]
duration:
4.336529463s
trace:
https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef
FAIL (2026-05-26 00:22:06 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment
May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments...
May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347  , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390  , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353  , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386  , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382  , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces
May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments...
May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil>
Duration: 4.336547477s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
2 out of 60 is failed (threshold=3) [.........................................X..X...............]
duration:
3.999810083s
trace:
https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef
FAIL (2026-05-26 00:21:37 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment
May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments...
May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347  , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390  , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353  , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386  , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382  , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces
May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments...
May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil>
Duration: 3.999830632s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [................X..............X............................]
duration:
3.913642312s
trace:
https://jaeger.dev.storj.io/trace/3bd7a1328937f878
FAIL (2026-05-26 00:21:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.914235023s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [.................X..............X...........................]
duration:
4.504049564s
trace:
https://jaeger.dev.storj.io/trace/3bd7a1328937f878
FAIL (2026-05-26 00:21:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 4.504072358s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
2 out of 60 is failed (threshold=3) [..........................................X..X..............]
duration:
3.961727047s
trace:
https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef
FAIL (2026-05-26 00:21:05 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment
May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments...
May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347  , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390  , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353  , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386  , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382  , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces
May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments...
May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil>
Duration: 3.961749862s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
7 out of 60 is failed (threshold=3) [X.X..XX.X...............X..................X................]
duration:
7.280421226s
trace:
https://jaeger.dev.storj.io/trace/4f326f7e35ea3a96
FAIL (2026-05-26 00:21:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.280432327s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
7 out of 60 is failed (threshold=3) [.X.X..XX.X...............X..................X...............]
duration:
50.255710652s
trace:
https://jaeger.dev.storj.io/trace/4f326f7e35ea3a96
FAIL (2026-05-26 00:20:56 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 50.255731152s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [..................X..............X..........................]
duration:
3.8481155s
trace:
https://jaeger.dev.storj.io/trace/3bd7a1328937f878
FAIL (2026-05-26 00:20:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.848128626s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
2 out of 60 is failed (threshold=3) [...........................................X..X.............]
duration:
4.125030189s
trace:
https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef
FAIL (2026-05-26 00:20:28 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment
May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments...
May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347  , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390  , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353  , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386  , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382  , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces
May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments...
May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil>
Duration: 4.125058883s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
2 out of 60 is failed (threshold=3) [............................................X..X............]
duration:
4.068730927s
trace:
https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef
FAIL (2026-05-26 00:19:45 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment
May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments...
May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347  , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390  , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353  , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386  , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382  , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces
May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments...
May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil>
Duration: 4.068744211s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
2 out of 60 is failed (threshold=3) [.............................................X..X...........]
duration:
52.252691907s
trace:
https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef
FAIL (2026-05-26 00:19:41 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece...
May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment
May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments...
May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399  , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358  , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371  , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347  , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341  , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324  , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390  , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402  , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367  , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353  , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386  , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433  , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420  , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407  , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382  , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431  , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil>
May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces
May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424  , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339  , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405  , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF
May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322  , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold
May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments...
May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil>
Duration: 52.252731812s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
7 out of 60 is failed (threshold=3) [..X.X..XX.X...............X..................X..............]
duration:
6.768260515s
trace:
https://jaeger.dev.storj.io/trace/4f326f7e35ea3a96
FAIL (2026-05-26 00:19:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.768287717s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [...................X..............X.........................]
duration:
4.059176128s
trace:
https://jaeger.dev.storj.io/trace/3bd7a1328937f878
FAIL (2026-05-26 00:19:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 4.059204002s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [....................X..............X........................]
duration:
3.765308286s
trace:
https://jaeger.dev.storj.io/trace/3bd7a1328937f878
FAIL (2026-05-26 00:19:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.765340127s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
7 out of 60 is failed (threshold=3) [...X.X..XX.X...............X..................X.............]
duration:
7.781869022s
trace:
https://jaeger.dev.storj.io/trace/4f326f7e35ea3a96
FAIL (2026-05-26 00:18:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.781892997s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
7 out of 60 is failed (threshold=3) [....X.X..XX.X...............X..................X............]
duration:
20.48742273s
trace:
https://jaeger.dev.storj.io/trace/4f326f7e35ea3a96
FAIL (2026-05-26 00:18:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 20.487432969s core uplink us-select-1 us1-placement-20