Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 8 out of 60 is failed (threshold=3) [....X..................X...................X.......X.XXX...X] duration: 1m0.000662401s trace: https://jaeger.dev.storj.io/trace/74bd92de97cd3d42 FAIL (2026-05-26 00:40:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000682138s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........X...................................................] duration: 3.747150636s trace: https://jaeger.dev.storj.io/trace/3bd7a1328937f878 FAIL (2026-05-26 00:39:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.747165545s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........X..................................................] duration: 3.889496663s trace: https://jaeger.dev.storj.io/trace/3bd7a1328937f878 FAIL (2026-05-26 00:39:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.889518424s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..................X..X......................................] duration: 4.065321623s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:39:14 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 4.065334427s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........X.................................................] duration: 3.804288511s trace: https://jaeger.dev.storj.io/trace/3bd7a1328937f878 FAIL (2026-05-26 00:38:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.804304681s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 7 out of 60 is failed (threshold=3) [.....X..................X...................X.......X.XXX...] duration: 24.937695775s trace: https://jaeger.dev.storj.io/trace/75c713c78b99eaf6 FAIL (2026-05-26 00:38:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 24.937719179s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...................X..X.....................................] duration: 4.009831533s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:38:12 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 4.009847333s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........X................................................] duration: 3.762182549s trace: https://jaeger.dev.storj.io/trace/3bd7a1328937f878 FAIL (2026-05-26 00:37:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.76220442s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 7 out of 60 is failed (threshold=3) [......X..................X...................X.......X.XXX..] duration: 6.607281039s trace: https://jaeger.dev.storj.io/trace/75c713c78b99eaf6 FAIL (2026-05-26 00:37:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.607300806s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [....................X..X....................................] duration: 3.969771239s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:37:10 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 3.96979274s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [............X...............................................] duration: 3.811148929s trace: https://jaeger.dev.storj.io/trace/3bd7a1328937f878 FAIL (2026-05-26 00:36:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.811176241s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 7 out of 60 is failed (threshold=3) [.......X..................X...................X.......X.XXX.] duration: 6.52336356s trace: https://jaeger.dev.storj.io/trace/75c713c78b99eaf6 FAIL (2026-05-26 00:36:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.523372306s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 7 out of 60 is failed (threshold=3) [........X..................X...................X.......X.XXX] duration: 1m0.001653933s trace: https://jaeger.dev.storj.io/trace/75c713c78b99eaf6 FAIL (2026-05-26 00:36:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001672668s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.....................X..X...................................] duration: 3.997375247s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:36:27 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 3.997406577s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.............X..............................................] duration: 3.817869703s trace: https://jaeger.dev.storj.io/trace/3bd7a1328937f878 FAIL (2026-05-26 00:36:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.817891413s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [......................X..X..................................] duration: 3.96844508s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:35:31 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 3.968471542s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..............X.............................................] duration: 3.646410635s trace: https://jaeger.dev.storj.io/trace/3bd7a1328937f878 FAIL (2026-05-26 00:35:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.646437876s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [.........X..................X...................X.......X.XX] duration: 1m0.001304058s trace: https://jaeger.dev.storj.io/trace/f97a7bdfadcf99b FAIL (2026-05-26 00:35:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001313506s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.......................X..X.................................] duration: 3.946400766s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:35:07 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 3.946432206s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [X..............X............................................] duration: 3.642656365s trace: https://jaeger.dev.storj.io/trace/3bd7a1328937f878 FAIL (2026-05-26 00:34:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.642682005s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [........................X..X................................] duration: 3.956389275s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:34:28 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 3.956403863s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [..........X..................X...................X.......X.X] duration: 1m0.000906343s trace: https://jaeger.dev.storj.io/trace/6488253a4670dc34 FAIL (2026-05-26 00:34:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.00091458s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.X..............X...........................................] duration: 3.738356067s trace: https://jaeger.dev.storj.io/trace/3bd7a1328937f878 FAIL (2026-05-26 00:33:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.738372999s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.........................X..X...............................] duration: 3.941061496s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:33:35 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 3.941086013s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...........X..................X...................X.......X.] duration: 41.883371317s trace: https://jaeger.dev.storj.io/trace/16391a928a7abdfd FAIL (2026-05-26 00:33:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 41.883381155s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..........................X..X..............................] duration: 4.092914019s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:32:44 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 4.09293015s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [............X..................X...................X.......X] duration: 1m0.000969637s trace: https://jaeger.dev.storj.io/trace/16391a928a7abdfd FAIL (2026-05-26 00:32:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000982223s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..X..............X..........................................] duration: 3.851616464s trace: https://jaeger.dev.storj.io/trace/3bd7a1328937f878 FAIL (2026-05-26 00:32:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.851639176s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...X..............X.........................................] duration: 4.792940653s trace: https://jaeger.dev.storj.io/trace/3bd7a1328937f878 FAIL (2026-05-26 00:32:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.792958836s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...........................X..X.............................] duration: 4.875674105s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:31:48 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 4.875689634s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [....X..............X........................................] duration: 5.000890181s trace: https://jaeger.dev.storj.io/trace/3bd7a1328937f878 FAIL (2026-05-26 00:31:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000911211s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.............X..................X...................X.......] duration: 6.501575657s trace: https://jaeger.dev.storj.io/trace/2d2d09316081b818 FAIL (2026-05-26 00:30:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.501588112s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [............................X..X............................] duration: 4.002611785s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:30:48 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 4.002636814s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..............X..................X...................X......] duration: 44.253248789s trace: https://jaeger.dev.storj.io/trace/2d2d09316081b818 FAIL (2026-05-26 00:30:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 44.25330639s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.....X..............X.......................................] duration: 3.868495909s trace: https://jaeger.dev.storj.io/trace/3bd7a1328937f878 FAIL (2026-05-26 00:30:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.868508092s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.............................X..X...........................] duration: 4.262030445s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:30:24 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 4.262054751s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..............................X..X..........................] duration: 10.279055203s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:29:56 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 10.279074569s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...............X..................X...................X.....] duration: 6.418758191s trace: https://jaeger.dev.storj.io/trace/2d2d09316081b818 FAIL (2026-05-26 00:29:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.41878373s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [......X..............X......................................] duration: 3.782199793s trace: https://jaeger.dev.storj.io/trace/3bd7a1328937f878 FAIL (2026-05-26 00:29:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.782247152s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [X...............X..................X...................X....] duration: 37.412318853s trace: https://jaeger.dev.storj.io/trace/2d2d09316081b818 FAIL (2026-05-26 00:29:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 37.412355915s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...............................X..X.........................] duration: 3.893014876s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:29:06 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 3.893053728s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.......X..............X.....................................] duration: 3.842826973s trace: https://jaeger.dev.storj.io/trace/3bd7a1328937f878 FAIL (2026-05-26 00:28:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.842851291s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [................................X..X........................] duration: 4.186863778s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:28:46 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 4.186887704s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.X...............X..................X...................X...] duration: 6.639141126s trace: https://jaeger.dev.storj.io/trace/2d2d09316081b818 FAIL (2026-05-26 00:28:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.639161957s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.................................X..X.......................] duration: 3.937073181s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:27:56 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 3.937095815s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [........X..............X....................................] duration: 3.700821871s trace: https://jaeger.dev.storj.io/trace/3bd7a1328937f878 FAIL (2026-05-26 00:27:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.700841147s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [X.X...............X..................X...................X..] duration: 28.579577755s trace: https://jaeger.dev.storj.io/trace/2d2d09316081b818 FAIL (2026-05-26 00:27:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 28.579599548s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.........X..............X...................................] duration: 3.888100885s trace: https://jaeger.dev.storj.io/trace/3bd7a1328937f878 FAIL (2026-05-26 00:26:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.888115011s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..................................X..X......................] duration: 7.028335286s trace: https://jaeger.dev.storj.io/trace/54dd3f55a77d17ef FAIL (2026-05-26 00:26:56 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320420647 (22h6m37.103760746s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320702816 (22h6m37.104042915s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.320993440 (22h6m37.104333539s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321256863 (22h6m37.104596962s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321827863 (22h6m37.105167962s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.321916452 (22h6m37.105256551s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322280286 (22h6m37.105620385s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322452585 (22h6m37.105792684s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.322950865 (22h6m37.106290964s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323536944 (22h6m37.106877043s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.323731265 (22h6m37.107071364s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324123954 (22h6m37.107464053s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.324414138 (22h6m37.107754227s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.325132458 (22h6m37.108472547s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:51.327055307 (22h6m37.110395406s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Uploading piece... May 26 00:10:52.388936548 (22h6m38.172276647s) [upload=21163]: Next returned nil segment May 26 00:10:52.388980332 (22h6m38.172320431s) [upload=21163]: Waiting for error group managing segments... May 26 00:10:52.674703801 (22h6m38.4580439s) [noise=true , address=212.102.52.216:4399 , piece_id=K5B3VDSSOJYPKIQWSZA3LAIP6ECGX4UIYTLHJKLEV65EEROPAXWA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.676576304 (22h6m38.459916403s) [noise=true , address=212.102.52.214:4358 , piece_id=XYDUBDN62GKNQB3O5H2BWWROODBZKXNJVEZRXCYXTRE3XGTKPCZQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.685919140 (22h6m38.469259239s) [noise=true , address=212.102.52.215:4371 , piece_id=OJPOOTWXGORXQYWWFFOKOT33F6KJI4A2355TNSMYE4OQXRU3GM3Q, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.691062223 (22h6m38.474402322s) [noise=true , address=212.102.52.214:4347 , piece_id=OP75SIPBPG6SRO427YW5DXBI2LX3IGJYQ272EQABJCYXPJQSX3IA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.692733643 (22h6m38.476073742s) [noise=true , address=212.102.52.213:4341 , piece_id=IZ7SWWTG5TQT5L725QJU7SBWBYQ4HW2R6C4DO7C2LWEJL7UMKX3A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.695375413 (22h6m38.478715512s) [noise=true , address=212.102.52.213:4324 , piece_id=IHZCGYVL5XVHHQBTQGNXJKVDNCKGLMPPI7CMP5U5QSEC2KBKS2ZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.697960065 (22h6m38.481300164s) [noise=true , address=212.102.52.215:4390 , piece_id=E4XO5YC7J2INYSCZLMJO6VRV4DMDM4YDBYAOIHXR7NHCC5EZELKQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.699281385 (22h6m38.482621484s) [noise=true , address=212.102.52.216:4402 , piece_id=YIB3T4SMRTQJGTAVUESYSEKOEUGWYNSUUIE36NTNYCXJGBS6GZJA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.701163387 (22h6m38.484503486s) [noise=true , address=212.102.52.214:4367 , piece_id=P25PLZRCWMM5F2ZV2M6AE6KZH23PDQWYCC2KWJORUO55RG2BKAZA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.702857559 (22h6m38.486197658s) [noise=true , address=212.102.52.214:4353 , piece_id=WZG7PJO5RODWWW63G26AKA5ZAP4LUVF66AOOKRIIBUUO4IWP7GOA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.705263059 (22h6m38.488603159s) [noise=true , address=212.102.52.215:4386 , piece_id=S5YIYIWUEMKONHJACR7E7PO7U7N2FMU3GH3OO4ULB77LLLC624MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707419504 (22h6m38.490759593s) [noise=true , address=212.102.52.217:4433 , piece_id=IBUBF2KSK4XJJY3GGUU7ELHZA6QS7LENZYUKXAA24NYSSAYJQAXQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.707786013 (22h6m38.491126112s) [noise=true , address=212.102.52.217:4420 , piece_id=JDI5NNY6OJUU2DSIFYDTDVYJD2POJDFPAD3HA237DZ43E2R2MYHQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.709872454 (22h6m38.493212543s) [noise=true , address=212.102.52.216:4407 , piece_id=DWZNVQEGJ2V34UDSVXLGGBHLKVCF4QYTWLYJ5GWUUVWGVUQCDSVA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.730564756 (22h6m38.513904845s) [noise=true , address=212.102.52.215:4382 , piece_id=BAJ5RC7425LFHND3DAXX4YSESMOUIRZOH2SHWHITX4KT3OAE54YQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736735980 (22h6m38.520076079s) [noise=true , address=212.102.52.217:4431 , piece_id=P7SKOTYTIASYYKMEFKYQTDJ3ZP2CVYOYATQPEYQDG2P65ZUOPWQA, seg_pos={0 0}, upload=21163]: Done uploading piece. err: <nil> May 26 00:10:52.736752663 (22h6m38.520092762s) [seg_pos={0 0}, upload=21163]: Satisfied cohort requirements after 16 pieces May 26 00:10:52.736921284 (22h6m38.520261383s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.736929240 (22h6m38.520269339s) [noise=true , address=212.102.52.217:4424 , piece_id=56YU26BQTQY7FJUHZ7T5ISAPEYY7QAJI2Q3Z6J2MDAKYBVYACJ7A, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737040080 (22h6m38.520380179s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737054549 (22h6m38.520394678s) [noise=true , address=212.102.52.213:4339 , piece_id=MN3JN37HKGKLVKJYXMXVSMITKU4PCPH6NDD7Z5U37YZ62ZS2U4TQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737102950 (22h6m38.520443049s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1272rh1tzNBuEmXqx4MpBe7NKXPac2wuNPCEpYqFk56gTrodcU2): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737108672 (22h6m38.520448771s) [noise=true , address=212.102.52.216:4405 , piece_id=OXJTIEZ2HUNIGFLRCEM64MELMI75XZUXRMQLM4EYFIWZWQIXN7MQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737196889 (22h6m38.520536988s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 00:10:52.737201459 (22h6m38.520541558s) [noise=true , address=212.102.52.213:4322 , piece_id=KHVYCOXFDTYTYWSGQBU65FZBVLULQZW25PXAXDTGVDBCREPSKZUQ, seg_pos={0 0}, upload=21163]: Long tail cancellation due to optimal threshold May 26 00:10:52.737216567 (22h6m38.520556666s) [seg_pos={0 0}, upload=21163]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 00:10:52.737295508 (22h6m38.520635597s) [upload=21163]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 00:10:52.737299646 (22h6m38.520639745s) [upload=21163]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 00:11:00.530433246 (22h6m46.313773355s) [upload=21163]: Done uploading segments... May 26 00:11:00.530455227 (22h6m46.313795347s) [upload=21163]: Upload finished. err: <nil> Duration: 7.028347499s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..........X..............X..................................] duration: 4.714050851s trace: https://jaeger.dev.storj.io/trace/3bd7a1328937f878 FAIL (2026-05-26 00:26:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.714068466s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)