Orbiter History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 3.914792916s trace: https://jaeger.dev.storj.io/trace/5c964271d20d5817 FAIL (2026-05-25 22:41:46 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PZBYA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016526591 (19h56m17.79986668s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016942624 (19h56m17.800282723s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017345213 (19h56m17.800685312s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017704899 (19h56m17.801044998s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017945076 (19h56m17.801285175s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018092017 (19h56m17.801432116s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018464699 (19h56m17.801804798s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018555913 (19h56m17.801896012s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018953491 (19h56m17.80229359s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019244447 (19h56m17.802584546s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019258222 (19h56m17.802598321s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019539188 (19h56m17.802879287s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019830494 (19h56m17.803170593s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020110528 (19h56m17.803450627s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020441400 (19h56m17.803781499s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:33.078323480 (19h56m18.861663579s) [upload=19092]: Next returned nil segment May 25 22:00:33.078333228 (19h56m18.861673327s) [upload=19092]: Waiting for error group managing segments... May 25 22:00:33.362737910 (19h56m19.146078009s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.366505599 (19h56m19.149845698s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369025236 (19h56m19.152365335s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369736344 (19h56m19.153076443s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373386979 (19h56m19.156727128s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373749210 (19h56m19.15708931s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.376611661 (19h56m19.159951792s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385293187 (19h56m19.168633286s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385441840 (19h56m19.16878196s) [noise=true , address=212.102.52.214:4365 , piece_id=IIR5IJNAE76RYZ6YWVZ4Z67ZGKENSNRHDPNRVO3PDJXQC6YPZBYA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386502284 (19h56m19.169842383s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386550555 (19h56m19.169890654s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.387214632 (19h56m19.170554731s) [noise=true , address=212.102.52.214:4349 , piece_id=E4MU3EUSQ3MTS6THBGHYE2NP2TL42WH677WVCLZZRNCIHSMJF7GA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.389717318 (19h56m19.173057417s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391350674 (19h56m19.174690773s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391666748 (19h56m19.175006847s) [noise=true , address=212.102.52.217:4430 , piece_id=RIKS76WYCYE4AXJDZDBVHSCIHDWDRWH6WWMNAAQGJVSJQIEGMZEQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392934657 (19h56m19.176274756s) [noise=true , address=212.102.52.215:4376 , piece_id=IBG6TFEQKRLK56QA7Z4X5TYMQSOXHQ27CJXVKIP2FCYBQZW6DZLA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392943844 (19h56m19.176283933s) [seg_pos={0 0}, upload=19092]: Satisfied cohort requirements after 16 pieces May 25 22:00:33.393089582 (19h56m19.176429682s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ohfhnBX7MWrCCdmn8rKNQjksDizY9K7ar6Htz3BVTrsPPkMYn): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393096245 (19h56m19.176436334s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393196536 (19h56m19.176536625s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Px3pe9nYbzRQ9tb2RDpL3ZGKViv6rTTm8AvhVcofGfrUWg5bk): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393202889 (19h56m19.176542988s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393278763 (19h56m19.176618862s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i3YC1eLBhg5PiyPZhHFwFLprKxqgwo37862bYcYNsrB8rLdUG): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393288602 (19h56m19.176628701s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393314181 (19h56m19.17665428s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393319532 (19h56m19.176659621s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393341573 (19h56m19.176681662s) [seg_pos={0 0}, upload=19092]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 22:00:33.393400305 (19h56m19.176740444s) [upload=19092]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 22:00:33.393406276 (19h56m19.176746395s) [upload=19092]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 22:00:53.238873899 (19h56m39.022213998s) [upload=19092]: Done uploading segments... May 25 22:00:53.238893697 (19h56m39.022233796s) [upload=19092]: Upload finished. err: <nil> Duration: 3.914818776s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [.................X............XX..........X.................] duration: 3.687725034s trace: https://jaeger.dev.storj.io/trace/e2041c22ff5061f FAIL (2026-05-25 22:41:35 UTC) orbiter warning: context deadline exceeded Duration: 3.687750242s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 14 out of 60 is failed (threshold=3) [......X..X..XXX.XXX.........XX........XX.X........X.........] duration: 6.627369234s trace: https://jaeger.dev.storj.io/trace/48ee0d1111a97208 FAIL (2026-05-25 22:41:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.627397146s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.352589502s trace: https://jaeger.dev.storj.io/trace/5c964271d20d5817 FAIL (2026-05-25 22:41:21 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PZBYA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016526591 (19h56m17.79986668s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016942624 (19h56m17.800282723s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017345213 (19h56m17.800685312s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017704899 (19h56m17.801044998s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017945076 (19h56m17.801285175s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018092017 (19h56m17.801432116s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018464699 (19h56m17.801804798s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018555913 (19h56m17.801896012s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018953491 (19h56m17.80229359s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019244447 (19h56m17.802584546s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019258222 (19h56m17.802598321s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019539188 (19h56m17.802879287s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019830494 (19h56m17.803170593s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020110528 (19h56m17.803450627s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020441400 (19h56m17.803781499s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:33.078323480 (19h56m18.861663579s) [upload=19092]: Next returned nil segment May 25 22:00:33.078333228 (19h56m18.861673327s) [upload=19092]: Waiting for error group managing segments... May 25 22:00:33.362737910 (19h56m19.146078009s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.366505599 (19h56m19.149845698s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369025236 (19h56m19.152365335s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369736344 (19h56m19.153076443s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373386979 (19h56m19.156727128s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373749210 (19h56m19.15708931s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.376611661 (19h56m19.159951792s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385293187 (19h56m19.168633286s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385441840 (19h56m19.16878196s) [noise=true , address=212.102.52.214:4365 , piece_id=IIR5IJNAE76RYZ6YWVZ4Z67ZGKENSNRHDPNRVO3PDJXQC6YPZBYA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386502284 (19h56m19.169842383s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386550555 (19h56m19.169890654s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.387214632 (19h56m19.170554731s) [noise=true , address=212.102.52.214:4349 , piece_id=E4MU3EUSQ3MTS6THBGHYE2NP2TL42WH677WVCLZZRNCIHSMJF7GA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.389717318 (19h56m19.173057417s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391350674 (19h56m19.174690773s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391666748 (19h56m19.175006847s) [noise=true , address=212.102.52.217:4430 , piece_id=RIKS76WYCYE4AXJDZDBVHSCIHDWDRWH6WWMNAAQGJVSJQIEGMZEQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392934657 (19h56m19.176274756s) [noise=true , address=212.102.52.215:4376 , piece_id=IBG6TFEQKRLK56QA7Z4X5TYMQSOXHQ27CJXVKIP2FCYBQZW6DZLA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392943844 (19h56m19.176283933s) [seg_pos={0 0}, upload=19092]: Satisfied cohort requirements after 16 pieces May 25 22:00:33.393089582 (19h56m19.176429682s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ohfhnBX7MWrCCdmn8rKNQjksDizY9K7ar6Htz3BVTrsPPkMYn): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393096245 (19h56m19.176436334s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393196536 (19h56m19.176536625s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Px3pe9nYbzRQ9tb2RDpL3ZGKViv6rTTm8AvhVcofGfrUWg5bk): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393202889 (19h56m19.176542988s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393278763 (19h56m19.176618862s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i3YC1eLBhg5PiyPZhHFwFLprKxqgwo37862bYcYNsrB8rLdUG): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393288602 (19h56m19.176628701s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393314181 (19h56m19.17665428s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393319532 (19h56m19.176659621s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393341573 (19h56m19.176681662s) [seg_pos={0 0}, upload=19092]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 22:00:33.393400305 (19h56m19.176740444s) [upload=19092]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 22:00:33.393406276 (19h56m19.176746395s) [upload=19092]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 22:00:53.238873899 (19h56m39.022213998s) [upload=19092]: Done uploading segments... May 25 22:00:53.238893697 (19h56m39.022233796s) [upload=19092]: Upload finished. err: <nil> Duration: 5.352612766s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 3.97567165s trace: https://jaeger.dev.storj.io/trace/5c964271d20d5817 FAIL (2026-05-25 22:40:59 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PZBYA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016526591 (19h56m17.79986668s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016942624 (19h56m17.800282723s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017345213 (19h56m17.800685312s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017704899 (19h56m17.801044998s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017945076 (19h56m17.801285175s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018092017 (19h56m17.801432116s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018464699 (19h56m17.801804798s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018555913 (19h56m17.801896012s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018953491 (19h56m17.80229359s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019244447 (19h56m17.802584546s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019258222 (19h56m17.802598321s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019539188 (19h56m17.802879287s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019830494 (19h56m17.803170593s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020110528 (19h56m17.803450627s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020441400 (19h56m17.803781499s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:33.078323480 (19h56m18.861663579s) [upload=19092]: Next returned nil segment May 25 22:00:33.078333228 (19h56m18.861673327s) [upload=19092]: Waiting for error group managing segments... May 25 22:00:33.362737910 (19h56m19.146078009s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.366505599 (19h56m19.149845698s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369025236 (19h56m19.152365335s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369736344 (19h56m19.153076443s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373386979 (19h56m19.156727128s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373749210 (19h56m19.15708931s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.376611661 (19h56m19.159951792s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385293187 (19h56m19.168633286s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385441840 (19h56m19.16878196s) [noise=true , address=212.102.52.214:4365 , piece_id=IIR5IJNAE76RYZ6YWVZ4Z67ZGKENSNRHDPNRVO3PDJXQC6YPZBYA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386502284 (19h56m19.169842383s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386550555 (19h56m19.169890654s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.387214632 (19h56m19.170554731s) [noise=true , address=212.102.52.214:4349 , piece_id=E4MU3EUSQ3MTS6THBGHYE2NP2TL42WH677WVCLZZRNCIHSMJF7GA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.389717318 (19h56m19.173057417s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391350674 (19h56m19.174690773s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391666748 (19h56m19.175006847s) [noise=true , address=212.102.52.217:4430 , piece_id=RIKS76WYCYE4AXJDZDBVHSCIHDWDRWH6WWMNAAQGJVSJQIEGMZEQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392934657 (19h56m19.176274756s) [noise=true , address=212.102.52.215:4376 , piece_id=IBG6TFEQKRLK56QA7Z4X5TYMQSOXHQ27CJXVKIP2FCYBQZW6DZLA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392943844 (19h56m19.176283933s) [seg_pos={0 0}, upload=19092]: Satisfied cohort requirements after 16 pieces May 25 22:00:33.393089582 (19h56m19.176429682s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ohfhnBX7MWrCCdmn8rKNQjksDizY9K7ar6Htz3BVTrsPPkMYn): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393096245 (19h56m19.176436334s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393196536 (19h56m19.176536625s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Px3pe9nYbzRQ9tb2RDpL3ZGKViv6rTTm8AvhVcofGfrUWg5bk): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393202889 (19h56m19.176542988s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393278763 (19h56m19.176618862s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i3YC1eLBhg5PiyPZhHFwFLprKxqgwo37862bYcYNsrB8rLdUG): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393288602 (19h56m19.176628701s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393314181 (19h56m19.17665428s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393319532 (19h56m19.176659621s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393341573 (19h56m19.176681662s) [seg_pos={0 0}, upload=19092]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 22:00:33.393400305 (19h56m19.176740444s) [upload=19092]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 22:00:33.393406276 (19h56m19.176746395s) [upload=19092]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 22:00:53.238873899 (19h56m39.022213998s) [upload=19092]: Done uploading segments... May 25 22:00:53.238893697 (19h56m39.022233796s) [upload=19092]: Upload finished. err: <nil> Duration: 3.975692811s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 14 out of 60 is failed (threshold=3) [.......X..X..XXX.XXX.........XX........XX.X........X........] duration: 6.447404966s trace: https://jaeger.dev.storj.io/trace/48ee0d1111a97208 FAIL (2026-05-25 22:40:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.447512s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 3.993454069s trace: https://jaeger.dev.storj.io/trace/5c964271d20d5817 FAIL (2026-05-25 22:40:43 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PZBYA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016526591 (19h56m17.79986668s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016942624 (19h56m17.800282723s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017345213 (19h56m17.800685312s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017704899 (19h56m17.801044998s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017945076 (19h56m17.801285175s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018092017 (19h56m17.801432116s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018464699 (19h56m17.801804798s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018555913 (19h56m17.801896012s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018953491 (19h56m17.80229359s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019244447 (19h56m17.802584546s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019258222 (19h56m17.802598321s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019539188 (19h56m17.802879287s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019830494 (19h56m17.803170593s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020110528 (19h56m17.803450627s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020441400 (19h56m17.803781499s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:33.078323480 (19h56m18.861663579s) [upload=19092]: Next returned nil segment May 25 22:00:33.078333228 (19h56m18.861673327s) [upload=19092]: Waiting for error group managing segments... May 25 22:00:33.362737910 (19h56m19.146078009s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.366505599 (19h56m19.149845698s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369025236 (19h56m19.152365335s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369736344 (19h56m19.153076443s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373386979 (19h56m19.156727128s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373749210 (19h56m19.15708931s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.376611661 (19h56m19.159951792s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385293187 (19h56m19.168633286s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385441840 (19h56m19.16878196s) [noise=true , address=212.102.52.214:4365 , piece_id=IIR5IJNAE76RYZ6YWVZ4Z67ZGKENSNRHDPNRVO3PDJXQC6YPZBYA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386502284 (19h56m19.169842383s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386550555 (19h56m19.169890654s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.387214632 (19h56m19.170554731s) [noise=true , address=212.102.52.214:4349 , piece_id=E4MU3EUSQ3MTS6THBGHYE2NP2TL42WH677WVCLZZRNCIHSMJF7GA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.389717318 (19h56m19.173057417s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391350674 (19h56m19.174690773s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391666748 (19h56m19.175006847s) [noise=true , address=212.102.52.217:4430 , piece_id=RIKS76WYCYE4AXJDZDBVHSCIHDWDRWH6WWMNAAQGJVSJQIEGMZEQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392934657 (19h56m19.176274756s) [noise=true , address=212.102.52.215:4376 , piece_id=IBG6TFEQKRLK56QA7Z4X5TYMQSOXHQ27CJXVKIP2FCYBQZW6DZLA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392943844 (19h56m19.176283933s) [seg_pos={0 0}, upload=19092]: Satisfied cohort requirements after 16 pieces May 25 22:00:33.393089582 (19h56m19.176429682s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ohfhnBX7MWrCCdmn8rKNQjksDizY9K7ar6Htz3BVTrsPPkMYn): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393096245 (19h56m19.176436334s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393196536 (19h56m19.176536625s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Px3pe9nYbzRQ9tb2RDpL3ZGKViv6rTTm8AvhVcofGfrUWg5bk): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393202889 (19h56m19.176542988s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393278763 (19h56m19.176618862s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i3YC1eLBhg5PiyPZhHFwFLprKxqgwo37862bYcYNsrB8rLdUG): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393288602 (19h56m19.176628701s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393314181 (19h56m19.17665428s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393319532 (19h56m19.176659621s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393341573 (19h56m19.176681662s) [seg_pos={0 0}, upload=19092]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 22:00:33.393400305 (19h56m19.176740444s) [upload=19092]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 22:00:33.393406276 (19h56m19.176746395s) [upload=19092]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 22:00:53.238873899 (19h56m39.022213998s) [upload=19092]: Done uploading segments... May 25 22:00:53.238893697 (19h56m39.022233796s) [upload=19092]: Upload finished. err: <nil> Duration: 3.993473827s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [..................X............XX..........X................] duration: 3.593753926s trace: https://jaeger.dev.storj.io/trace/e2041c22ff5061f FAIL (2026-05-25 22:40:28 UTC) orbiter warning: context deadline exceeded Duration: 3.593769466s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 14 out of 60 is failed (threshold=3) [........X..X..XXX.XXX.........XX........XX.X........X.......] duration: 10.834209256s trace: https://jaeger.dev.storj.io/trace/48ee0d1111a97208 FAIL (2026-05-25 22:40:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 10.834231598s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [...................X............XX..........X...............] duration: 3.807073777s trace: https://jaeger.dev.storj.io/trace/e2041c22ff5061f FAIL (2026-05-25 22:40:09 UTC) orbiter warning: context deadline exceeded Duration: 3.807087773s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 4.201222997s trace: https://jaeger.dev.storj.io/trace/5c964271d20d5817 FAIL (2026-05-25 22:40:05 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PZBYA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016526591 (19h56m17.79986668s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016942624 (19h56m17.800282723s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017345213 (19h56m17.800685312s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017704899 (19h56m17.801044998s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017945076 (19h56m17.801285175s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018092017 (19h56m17.801432116s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018464699 (19h56m17.801804798s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018555913 (19h56m17.801896012s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018953491 (19h56m17.80229359s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019244447 (19h56m17.802584546s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019258222 (19h56m17.802598321s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019539188 (19h56m17.802879287s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019830494 (19h56m17.803170593s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020110528 (19h56m17.803450627s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020441400 (19h56m17.803781499s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:33.078323480 (19h56m18.861663579s) [upload=19092]: Next returned nil segment May 25 22:00:33.078333228 (19h56m18.861673327s) [upload=19092]: Waiting for error group managing segments... May 25 22:00:33.362737910 (19h56m19.146078009s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.366505599 (19h56m19.149845698s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369025236 (19h56m19.152365335s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369736344 (19h56m19.153076443s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373386979 (19h56m19.156727128s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373749210 (19h56m19.15708931s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.376611661 (19h56m19.159951792s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385293187 (19h56m19.168633286s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385441840 (19h56m19.16878196s) [noise=true , address=212.102.52.214:4365 , piece_id=IIR5IJNAE76RYZ6YWVZ4Z67ZGKENSNRHDPNRVO3PDJXQC6YPZBYA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386502284 (19h56m19.169842383s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386550555 (19h56m19.169890654s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.387214632 (19h56m19.170554731s) [noise=true , address=212.102.52.214:4349 , piece_id=E4MU3EUSQ3MTS6THBGHYE2NP2TL42WH677WVCLZZRNCIHSMJF7GA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.389717318 (19h56m19.173057417s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391350674 (19h56m19.174690773s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391666748 (19h56m19.175006847s) [noise=true , address=212.102.52.217:4430 , piece_id=RIKS76WYCYE4AXJDZDBVHSCIHDWDRWH6WWMNAAQGJVSJQIEGMZEQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392934657 (19h56m19.176274756s) [noise=true , address=212.102.52.215:4376 , piece_id=IBG6TFEQKRLK56QA7Z4X5TYMQSOXHQ27CJXVKIP2FCYBQZW6DZLA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392943844 (19h56m19.176283933s) [seg_pos={0 0}, upload=19092]: Satisfied cohort requirements after 16 pieces May 25 22:00:33.393089582 (19h56m19.176429682s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ohfhnBX7MWrCCdmn8rKNQjksDizY9K7ar6Htz3BVTrsPPkMYn): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393096245 (19h56m19.176436334s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393196536 (19h56m19.176536625s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Px3pe9nYbzRQ9tb2RDpL3ZGKViv6rTTm8AvhVcofGfrUWg5bk): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393202889 (19h56m19.176542988s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393278763 (19h56m19.176618862s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i3YC1eLBhg5PiyPZhHFwFLprKxqgwo37862bYcYNsrB8rLdUG): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393288602 (19h56m19.176628701s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393314181 (19h56m19.17665428s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393319532 (19h56m19.176659621s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393341573 (19h56m19.176681662s) [seg_pos={0 0}, upload=19092]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 22:00:33.393400305 (19h56m19.176740444s) [upload=19092]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 22:00:33.393406276 (19h56m19.176746395s) [upload=19092]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 22:00:53.238873899 (19h56m39.022213998s) [upload=19092]: Done uploading segments... May 25 22:00:53.238893697 (19h56m39.022233796s) [upload=19092]: Upload finished. err: <nil> Duration: 4.201242303s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 32.545942704s trace: https://jaeger.dev.storj.io/trace/5c964271d20d5817 FAIL (2026-05-25 22:39:52 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PZBYA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016526591 (19h56m17.79986668s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016942624 (19h56m17.800282723s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017345213 (19h56m17.800685312s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017704899 (19h56m17.801044998s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017945076 (19h56m17.801285175s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018092017 (19h56m17.801432116s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018464699 (19h56m17.801804798s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018555913 (19h56m17.801896012s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018953491 (19h56m17.80229359s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019244447 (19h56m17.802584546s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019258222 (19h56m17.802598321s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019539188 (19h56m17.802879287s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019830494 (19h56m17.803170593s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020110528 (19h56m17.803450627s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020441400 (19h56m17.803781499s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:33.078323480 (19h56m18.861663579s) [upload=19092]: Next returned nil segment May 25 22:00:33.078333228 (19h56m18.861673327s) [upload=19092]: Waiting for error group managing segments... May 25 22:00:33.362737910 (19h56m19.146078009s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.366505599 (19h56m19.149845698s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369025236 (19h56m19.152365335s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369736344 (19h56m19.153076443s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373386979 (19h56m19.156727128s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373749210 (19h56m19.15708931s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.376611661 (19h56m19.159951792s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385293187 (19h56m19.168633286s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385441840 (19h56m19.16878196s) [noise=true , address=212.102.52.214:4365 , piece_id=IIR5IJNAE76RYZ6YWVZ4Z67ZGKENSNRHDPNRVO3PDJXQC6YPZBYA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386502284 (19h56m19.169842383s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386550555 (19h56m19.169890654s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.387214632 (19h56m19.170554731s) [noise=true , address=212.102.52.214:4349 , piece_id=E4MU3EUSQ3MTS6THBGHYE2NP2TL42WH677WVCLZZRNCIHSMJF7GA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.389717318 (19h56m19.173057417s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391350674 (19h56m19.174690773s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391666748 (19h56m19.175006847s) [noise=true , address=212.102.52.217:4430 , piece_id=RIKS76WYCYE4AXJDZDBVHSCIHDWDRWH6WWMNAAQGJVSJQIEGMZEQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392934657 (19h56m19.176274756s) [noise=true , address=212.102.52.215:4376 , piece_id=IBG6TFEQKRLK56QA7Z4X5TYMQSOXHQ27CJXVKIP2FCYBQZW6DZLA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392943844 (19h56m19.176283933s) [seg_pos={0 0}, upload=19092]: Satisfied cohort requirements after 16 pieces May 25 22:00:33.393089582 (19h56m19.176429682s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ohfhnBX7MWrCCdmn8rKNQjksDizY9K7ar6Htz3BVTrsPPkMYn): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393096245 (19h56m19.176436334s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393196536 (19h56m19.176536625s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Px3pe9nYbzRQ9tb2RDpL3ZGKViv6rTTm8AvhVcofGfrUWg5bk): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393202889 (19h56m19.176542988s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393278763 (19h56m19.176618862s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i3YC1eLBhg5PiyPZhHFwFLprKxqgwo37862bYcYNsrB8rLdUG): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393288602 (19h56m19.176628701s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393314181 (19h56m19.17665428s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393319532 (19h56m19.176659621s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393341573 (19h56m19.176681662s) [seg_pos={0 0}, upload=19092]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 22:00:33.393400305 (19h56m19.176740444s) [upload=19092]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 22:00:33.393406276 (19h56m19.176746395s) [upload=19092]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 22:00:53.238873899 (19h56m39.022213998s) [upload=19092]: Done uploading segments... May 25 22:00:53.238893697 (19h56m39.022233796s) [upload=19092]: Upload finished. err: <nil> Duration: 32.545961742s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 14 out of 60 is failed (threshold=3) [.........X..X..XXX.XXX.........XX........XX.X........X......] duration: 6.635733412s trace: https://jaeger.dev.storj.io/trace/48ee0d1111a97208 FAIL (2026-05-25 22:39:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.635751685s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [....................X............XX..........X..............] duration: 3.879096735s trace: https://jaeger.dev.storj.io/trace/e2041c22ff5061f FAIL (2026-05-25 22:39:44 UTC) orbiter warning: context deadline exceeded Duration: 3.879113867s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 14 out of 60 is failed (threshold=3) [..........X..X..XXX.XXX.........XX........XX.X........X.....] duration: 17.881969832s trace: https://jaeger.dev.storj.io/trace/48ee0d1111a97208 FAIL (2026-05-25 22:38:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 17.881986094s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 4.096289793s trace: https://jaeger.dev.storj.io/trace/5c964271d20d5817 FAIL (2026-05-25 22:38:50 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PZBYA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016526591 (19h56m17.79986668s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016942624 (19h56m17.800282723s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017345213 (19h56m17.800685312s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017704899 (19h56m17.801044998s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017945076 (19h56m17.801285175s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018092017 (19h56m17.801432116s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018464699 (19h56m17.801804798s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018555913 (19h56m17.801896012s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018953491 (19h56m17.80229359s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019244447 (19h56m17.802584546s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019258222 (19h56m17.802598321s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019539188 (19h56m17.802879287s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019830494 (19h56m17.803170593s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020110528 (19h56m17.803450627s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020441400 (19h56m17.803781499s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:33.078323480 (19h56m18.861663579s) [upload=19092]: Next returned nil segment May 25 22:00:33.078333228 (19h56m18.861673327s) [upload=19092]: Waiting for error group managing segments... May 25 22:00:33.362737910 (19h56m19.146078009s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.366505599 (19h56m19.149845698s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369025236 (19h56m19.152365335s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369736344 (19h56m19.153076443s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373386979 (19h56m19.156727128s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373749210 (19h56m19.15708931s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.376611661 (19h56m19.159951792s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385293187 (19h56m19.168633286s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385441840 (19h56m19.16878196s) [noise=true , address=212.102.52.214:4365 , piece_id=IIR5IJNAE76RYZ6YWVZ4Z67ZGKENSNRHDPNRVO3PDJXQC6YPZBYA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386502284 (19h56m19.169842383s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386550555 (19h56m19.169890654s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.387214632 (19h56m19.170554731s) [noise=true , address=212.102.52.214:4349 , piece_id=E4MU3EUSQ3MTS6THBGHYE2NP2TL42WH677WVCLZZRNCIHSMJF7GA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.389717318 (19h56m19.173057417s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391350674 (19h56m19.174690773s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391666748 (19h56m19.175006847s) [noise=true , address=212.102.52.217:4430 , piece_id=RIKS76WYCYE4AXJDZDBVHSCIHDWDRWH6WWMNAAQGJVSJQIEGMZEQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392934657 (19h56m19.176274756s) [noise=true , address=212.102.52.215:4376 , piece_id=IBG6TFEQKRLK56QA7Z4X5TYMQSOXHQ27CJXVKIP2FCYBQZW6DZLA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392943844 (19h56m19.176283933s) [seg_pos={0 0}, upload=19092]: Satisfied cohort requirements after 16 pieces May 25 22:00:33.393089582 (19h56m19.176429682s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ohfhnBX7MWrCCdmn8rKNQjksDizY9K7ar6Htz3BVTrsPPkMYn): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393096245 (19h56m19.176436334s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393196536 (19h56m19.176536625s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Px3pe9nYbzRQ9tb2RDpL3ZGKViv6rTTm8AvhVcofGfrUWg5bk): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393202889 (19h56m19.176542988s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393278763 (19h56m19.176618862s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i3YC1eLBhg5PiyPZhHFwFLprKxqgwo37862bYcYNsrB8rLdUG): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393288602 (19h56m19.176628701s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393314181 (19h56m19.17665428s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393319532 (19h56m19.176659621s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393341573 (19h56m19.176681662s) [seg_pos={0 0}, upload=19092]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 22:00:33.393400305 (19h56m19.176740444s) [upload=19092]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 22:00:33.393406276 (19h56m19.176746395s) [upload=19092]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 22:00:53.238873899 (19h56m39.022213998s) [upload=19092]: Done uploading segments... May 25 22:00:53.238893697 (19h56m39.022233796s) [upload=19092]: Upload finished. err: <nil> Duration: 4.09631963s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [.....................X............XX..........X.............] duration: 4.584269619s trace: https://jaeger.dev.storj.io/trace/e2041c22ff5061f FAIL (2026-05-25 22:38:38 UTC) orbiter warning: context deadline exceeded Duration: 4.584292323s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 14 out of 60 is failed (threshold=3) [...........X..X..XXX.XXX.........XX........XX.X........X....] duration: 31.928183118s trace: https://jaeger.dev.storj.io/trace/48ee0d1111a97208 FAIL (2026-05-25 22:38:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 31.928200903s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [......................X............XX..........X............] duration: 3.781921074s trace: https://jaeger.dev.storj.io/trace/e2041c22ff5061f FAIL (2026-05-25 22:38:05 UTC) orbiter warning: context deadline exceeded Duration: 3.781940393s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 4.02509784s trace: https://jaeger.dev.storj.io/trace/5c964271d20d5817 FAIL (2026-05-25 22:37:37 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PZBYA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016526591 (19h56m17.79986668s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016942624 (19h56m17.800282723s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017345213 (19h56m17.800685312s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017704899 (19h56m17.801044998s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017945076 (19h56m17.801285175s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018092017 (19h56m17.801432116s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018464699 (19h56m17.801804798s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018555913 (19h56m17.801896012s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018953491 (19h56m17.80229359s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019244447 (19h56m17.802584546s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019258222 (19h56m17.802598321s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019539188 (19h56m17.802879287s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019830494 (19h56m17.803170593s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020110528 (19h56m17.803450627s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020441400 (19h56m17.803781499s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:33.078323480 (19h56m18.861663579s) [upload=19092]: Next returned nil segment May 25 22:00:33.078333228 (19h56m18.861673327s) [upload=19092]: Waiting for error group managing segments... May 25 22:00:33.362737910 (19h56m19.146078009s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.366505599 (19h56m19.149845698s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369025236 (19h56m19.152365335s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369736344 (19h56m19.153076443s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373386979 (19h56m19.156727128s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373749210 (19h56m19.15708931s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.376611661 (19h56m19.159951792s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385293187 (19h56m19.168633286s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385441840 (19h56m19.16878196s) [noise=true , address=212.102.52.214:4365 , piece_id=IIR5IJNAE76RYZ6YWVZ4Z67ZGKENSNRHDPNRVO3PDJXQC6YPZBYA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386502284 (19h56m19.169842383s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386550555 (19h56m19.169890654s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.387214632 (19h56m19.170554731s) [noise=true , address=212.102.52.214:4349 , piece_id=E4MU3EUSQ3MTS6THBGHYE2NP2TL42WH677WVCLZZRNCIHSMJF7GA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.389717318 (19h56m19.173057417s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391350674 (19h56m19.174690773s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391666748 (19h56m19.175006847s) [noise=true , address=212.102.52.217:4430 , piece_id=RIKS76WYCYE4AXJDZDBVHSCIHDWDRWH6WWMNAAQGJVSJQIEGMZEQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392934657 (19h56m19.176274756s) [noise=true , address=212.102.52.215:4376 , piece_id=IBG6TFEQKRLK56QA7Z4X5TYMQSOXHQ27CJXVKIP2FCYBQZW6DZLA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392943844 (19h56m19.176283933s) [seg_pos={0 0}, upload=19092]: Satisfied cohort requirements after 16 pieces May 25 22:00:33.393089582 (19h56m19.176429682s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ohfhnBX7MWrCCdmn8rKNQjksDizY9K7ar6Htz3BVTrsPPkMYn): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393096245 (19h56m19.176436334s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393196536 (19h56m19.176536625s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Px3pe9nYbzRQ9tb2RDpL3ZGKViv6rTTm8AvhVcofGfrUWg5bk): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393202889 (19h56m19.176542988s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393278763 (19h56m19.176618862s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i3YC1eLBhg5PiyPZhHFwFLprKxqgwo37862bYcYNsrB8rLdUG): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393288602 (19h56m19.176628701s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393314181 (19h56m19.17665428s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393319532 (19h56m19.176659621s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393341573 (19h56m19.176681662s) [seg_pos={0 0}, upload=19092]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 22:00:33.393400305 (19h56m19.176740444s) [upload=19092]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 22:00:33.393406276 (19h56m19.176746395s) [upload=19092]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 22:00:53.238873899 (19h56m39.022213998s) [upload=19092]: Done uploading segments... May 25 22:00:53.238893697 (19h56m39.022233796s) [upload=19092]: Upload finished. err: <nil> Duration: 4.025128006s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [.......................X............XX..........X...........] duration: 3.736716812s trace: https://jaeger.dev.storj.io/trace/e2041c22ff5061f FAIL (2026-05-25 22:37:32 UTC) orbiter warning: context deadline exceeded Duration: 3.736736099s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [........................X............XX..........X..........] duration: 3.601971685s trace: https://jaeger.dev.storj.io/trace/e2041c22ff5061f FAIL (2026-05-25 22:37:16 UTC) orbiter warning: context deadline exceeded Duration: 3.601991682s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [.........................X............XX..........X.........] duration: 3.678380085s trace: https://jaeger.dev.storj.io/trace/e2041c22ff5061f FAIL (2026-05-25 22:36:58 UTC) orbiter warning: context deadline exceeded Duration: 3.678400064s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 14 out of 60 is failed (threshold=3) [............X..X..XXX.XXX.........XX........XX.X........X...] duration: 10.705786178s trace: https://jaeger.dev.storj.io/trace/48ee0d1111a97208 FAIL (2026-05-25 22:36:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 10.705810653s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 4.11443733s trace: https://jaeger.dev.storj.io/trace/5c964271d20d5817 FAIL (2026-05-25 22:36:24 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PZBYA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016526591 (19h56m17.79986668s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016942624 (19h56m17.800282723s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017345213 (19h56m17.800685312s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017704899 (19h56m17.801044998s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017945076 (19h56m17.801285175s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018092017 (19h56m17.801432116s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018464699 (19h56m17.801804798s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018555913 (19h56m17.801896012s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018953491 (19h56m17.80229359s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019244447 (19h56m17.802584546s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019258222 (19h56m17.802598321s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019539188 (19h56m17.802879287s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019830494 (19h56m17.803170593s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020110528 (19h56m17.803450627s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020441400 (19h56m17.803781499s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:33.078323480 (19h56m18.861663579s) [upload=19092]: Next returned nil segment May 25 22:00:33.078333228 (19h56m18.861673327s) [upload=19092]: Waiting for error group managing segments... May 25 22:00:33.362737910 (19h56m19.146078009s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.366505599 (19h56m19.149845698s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369025236 (19h56m19.152365335s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369736344 (19h56m19.153076443s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373386979 (19h56m19.156727128s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373749210 (19h56m19.15708931s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.376611661 (19h56m19.159951792s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385293187 (19h56m19.168633286s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385441840 (19h56m19.16878196s) [noise=true , address=212.102.52.214:4365 , piece_id=IIR5IJNAE76RYZ6YWVZ4Z67ZGKENSNRHDPNRVO3PDJXQC6YPZBYA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386502284 (19h56m19.169842383s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386550555 (19h56m19.169890654s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.387214632 (19h56m19.170554731s) [noise=true , address=212.102.52.214:4349 , piece_id=E4MU3EUSQ3MTS6THBGHYE2NP2TL42WH677WVCLZZRNCIHSMJF7GA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.389717318 (19h56m19.173057417s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391350674 (19h56m19.174690773s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391666748 (19h56m19.175006847s) [noise=true , address=212.102.52.217:4430 , piece_id=RIKS76WYCYE4AXJDZDBVHSCIHDWDRWH6WWMNAAQGJVSJQIEGMZEQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392934657 (19h56m19.176274756s) [noise=true , address=212.102.52.215:4376 , piece_id=IBG6TFEQKRLK56QA7Z4X5TYMQSOXHQ27CJXVKIP2FCYBQZW6DZLA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392943844 (19h56m19.176283933s) [seg_pos={0 0}, upload=19092]: Satisfied cohort requirements after 16 pieces May 25 22:00:33.393089582 (19h56m19.176429682s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ohfhnBX7MWrCCdmn8rKNQjksDizY9K7ar6Htz3BVTrsPPkMYn): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393096245 (19h56m19.176436334s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393196536 (19h56m19.176536625s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Px3pe9nYbzRQ9tb2RDpL3ZGKViv6rTTm8AvhVcofGfrUWg5bk): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393202889 (19h56m19.176542988s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393278763 (19h56m19.176618862s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i3YC1eLBhg5PiyPZhHFwFLprKxqgwo37862bYcYNsrB8rLdUG): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393288602 (19h56m19.176628701s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393314181 (19h56m19.17665428s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393319532 (19h56m19.176659621s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393341573 (19h56m19.176681662s) [seg_pos={0 0}, upload=19092]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 22:00:33.393400305 (19h56m19.176740444s) [upload=19092]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 22:00:33.393406276 (19h56m19.176746395s) [upload=19092]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 22:00:53.238873899 (19h56m39.022213998s) [upload=19092]: Done uploading segments... May 25 22:00:53.238893697 (19h56m39.022233796s) [upload=19092]: Upload finished. err: <nil> Duration: 4.114456647s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 14 out of 60 is failed (threshold=3) [.............X..X..XXX.XXX.........XX........XX.X........X..] duration: 13.502542411s trace: https://jaeger.dev.storj.io/trace/48ee0d1111a97208 FAIL (2026-05-25 22:36:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 13.502562839s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [..........................X............XX..........X........] duration: 3.759956697s trace: https://jaeger.dev.storj.io/trace/e2041c22ff5061f FAIL (2026-05-25 22:35:57 UTC) orbiter warning: context deadline exceeded Duration: 3.759996061s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 3.967358071s trace: https://jaeger.dev.storj.io/trace/5c964271d20d5817 FAIL (2026-05-25 22:35:44 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PZBYA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016526591 (19h56m17.79986668s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016942624 (19h56m17.800282723s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017345213 (19h56m17.800685312s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017704899 (19h56m17.801044998s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017945076 (19h56m17.801285175s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018092017 (19h56m17.801432116s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018464699 (19h56m17.801804798s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018555913 (19h56m17.801896012s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018953491 (19h56m17.80229359s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019244447 (19h56m17.802584546s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019258222 (19h56m17.802598321s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019539188 (19h56m17.802879287s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019830494 (19h56m17.803170593s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020110528 (19h56m17.803450627s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020441400 (19h56m17.803781499s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:33.078323480 (19h56m18.861663579s) [upload=19092]: Next returned nil segment May 25 22:00:33.078333228 (19h56m18.861673327s) [upload=19092]: Waiting for error group managing segments... May 25 22:00:33.362737910 (19h56m19.146078009s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.366505599 (19h56m19.149845698s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369025236 (19h56m19.152365335s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369736344 (19h56m19.153076443s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373386979 (19h56m19.156727128s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373749210 (19h56m19.15708931s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.376611661 (19h56m19.159951792s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385293187 (19h56m19.168633286s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385441840 (19h56m19.16878196s) [noise=true , address=212.102.52.214:4365 , piece_id=IIR5IJNAE76RYZ6YWVZ4Z67ZGKENSNRHDPNRVO3PDJXQC6YPZBYA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386502284 (19h56m19.169842383s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386550555 (19h56m19.169890654s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.387214632 (19h56m19.170554731s) [noise=true , address=212.102.52.214:4349 , piece_id=E4MU3EUSQ3MTS6THBGHYE2NP2TL42WH677WVCLZZRNCIHSMJF7GA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.389717318 (19h56m19.173057417s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391350674 (19h56m19.174690773s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391666748 (19h56m19.175006847s) [noise=true , address=212.102.52.217:4430 , piece_id=RIKS76WYCYE4AXJDZDBVHSCIHDWDRWH6WWMNAAQGJVSJQIEGMZEQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392934657 (19h56m19.176274756s) [noise=true , address=212.102.52.215:4376 , piece_id=IBG6TFEQKRLK56QA7Z4X5TYMQSOXHQ27CJXVKIP2FCYBQZW6DZLA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392943844 (19h56m19.176283933s) [seg_pos={0 0}, upload=19092]: Satisfied cohort requirements after 16 pieces May 25 22:00:33.393089582 (19h56m19.176429682s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ohfhnBX7MWrCCdmn8rKNQjksDizY9K7ar6Htz3BVTrsPPkMYn): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393096245 (19h56m19.176436334s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393196536 (19h56m19.176536625s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Px3pe9nYbzRQ9tb2RDpL3ZGKViv6rTTm8AvhVcofGfrUWg5bk): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393202889 (19h56m19.176542988s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393278763 (19h56m19.176618862s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i3YC1eLBhg5PiyPZhHFwFLprKxqgwo37862bYcYNsrB8rLdUG): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393288602 (19h56m19.176628701s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393314181 (19h56m19.17665428s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393319532 (19h56m19.176659621s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393341573 (19h56m19.176681662s) [seg_pos={0 0}, upload=19092]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 22:00:33.393400305 (19h56m19.176740444s) [upload=19092]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 22:00:33.393406276 (19h56m19.176746395s) [upload=19092]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 22:00:53.238873899 (19h56m39.022213998s) [upload=19092]: Done uploading segments... May 25 22:00:53.238893697 (19h56m39.022233796s) [upload=19092]: Upload finished. err: <nil> Duration: 3.967381917s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 14 out of 60 is failed (threshold=3) [..............X..X..XXX.XXX.........XX........XX.X........X.] duration: 6.717479514s trace: https://jaeger.dev.storj.io/trace/48ee0d1111a97208 FAIL (2026-05-25 22:35:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.717506375s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [...........................X............XX..........X.......] duration: 3.970576081s trace: https://jaeger.dev.storj.io/trace/e2041c22ff5061f FAIL (2026-05-25 22:35:27 UTC) orbiter warning: context deadline exceeded Duration: 3.970598374s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 14 out of 60 is failed (threshold=3) [...............X..X..XXX.XXX.........XX........XX.X........X] duration: 1m0.000842189s trace: https://jaeger.dev.storj.io/trace/48ee0d1111a97208 FAIL (2026-05-25 22:35:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000872167s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 4.179006408s trace: https://jaeger.dev.storj.io/trace/5c964271d20d5817 FAIL (2026-05-25 22:34:46 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PZBYA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016526591 (19h56m17.79986668s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016942624 (19h56m17.800282723s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017345213 (19h56m17.800685312s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017704899 (19h56m17.801044998s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017945076 (19h56m17.801285175s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018092017 (19h56m17.801432116s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018464699 (19h56m17.801804798s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018555913 (19h56m17.801896012s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018953491 (19h56m17.80229359s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019244447 (19h56m17.802584546s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019258222 (19h56m17.802598321s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019539188 (19h56m17.802879287s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019830494 (19h56m17.803170593s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020110528 (19h56m17.803450627s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020441400 (19h56m17.803781499s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:33.078323480 (19h56m18.861663579s) [upload=19092]: Next returned nil segment May 25 22:00:33.078333228 (19h56m18.861673327s) [upload=19092]: Waiting for error group managing segments... May 25 22:00:33.362737910 (19h56m19.146078009s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.366505599 (19h56m19.149845698s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369025236 (19h56m19.152365335s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369736344 (19h56m19.153076443s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373386979 (19h56m19.156727128s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373749210 (19h56m19.15708931s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.376611661 (19h56m19.159951792s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385293187 (19h56m19.168633286s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385441840 (19h56m19.16878196s) [noise=true , address=212.102.52.214:4365 , piece_id=IIR5IJNAE76RYZ6YWVZ4Z67ZGKENSNRHDPNRVO3PDJXQC6YPZBYA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386502284 (19h56m19.169842383s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386550555 (19h56m19.169890654s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.387214632 (19h56m19.170554731s) [noise=true , address=212.102.52.214:4349 , piece_id=E4MU3EUSQ3MTS6THBGHYE2NP2TL42WH677WVCLZZRNCIHSMJF7GA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.389717318 (19h56m19.173057417s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391350674 (19h56m19.174690773s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391666748 (19h56m19.175006847s) [noise=true , address=212.102.52.217:4430 , piece_id=RIKS76WYCYE4AXJDZDBVHSCIHDWDRWH6WWMNAAQGJVSJQIEGMZEQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392934657 (19h56m19.176274756s) [noise=true , address=212.102.52.215:4376 , piece_id=IBG6TFEQKRLK56QA7Z4X5TYMQSOXHQ27CJXVKIP2FCYBQZW6DZLA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392943844 (19h56m19.176283933s) [seg_pos={0 0}, upload=19092]: Satisfied cohort requirements after 16 pieces May 25 22:00:33.393089582 (19h56m19.176429682s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ohfhnBX7MWrCCdmn8rKNQjksDizY9K7ar6Htz3BVTrsPPkMYn): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393096245 (19h56m19.176436334s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393196536 (19h56m19.176536625s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Px3pe9nYbzRQ9tb2RDpL3ZGKViv6rTTm8AvhVcofGfrUWg5bk): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393202889 (19h56m19.176542988s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393278763 (19h56m19.176618862s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i3YC1eLBhg5PiyPZhHFwFLprKxqgwo37862bYcYNsrB8rLdUG): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393288602 (19h56m19.176628701s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393314181 (19h56m19.17665428s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393319532 (19h56m19.176659621s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393341573 (19h56m19.176681662s) [seg_pos={0 0}, upload=19092]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 22:00:33.393400305 (19h56m19.176740444s) [upload=19092]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 22:00:33.393406276 (19h56m19.176746395s) [upload=19092]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 22:00:53.238873899 (19h56m39.022213998s) [upload=19092]: Done uploading segments... May 25 22:00:53.238893697 (19h56m39.022233796s) [upload=19092]: Upload finished. err: <nil> Duration: 4.179034403s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [............................X............XX..........X......] duration: 3.705790125s trace: https://jaeger.dev.storj.io/trace/e2041c22ff5061f FAIL (2026-05-25 22:34:32 UTC) orbiter warning: context deadline exceeded Duration: 3.70580802s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [.............................X............XX..........X.....] duration: 3.848938364s trace: https://jaeger.dev.storj.io/trace/e2041c22ff5061f FAIL (2026-05-25 22:34:08 UTC) orbiter warning: context deadline exceeded Duration: 3.848960005s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 13 out of 60 is failed (threshold=3) [................X..X..XXX.XXX.........XX........XX.X........] duration: 29.674912524s trace: https://jaeger.dev.storj.io/trace/31e5ee91d50b28c7 FAIL (2026-05-25 22:34:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 29.67493153s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 3.945986072s trace: https://jaeger.dev.storj.io/trace/5c964271d20d5817 FAIL (2026-05-25 22:33:37 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PZBYA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016526591 (19h56m17.79986668s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016942624 (19h56m17.800282723s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017345213 (19h56m17.800685312s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017704899 (19h56m17.801044998s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017945076 (19h56m17.801285175s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018092017 (19h56m17.801432116s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018464699 (19h56m17.801804798s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018555913 (19h56m17.801896012s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018953491 (19h56m17.80229359s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019244447 (19h56m17.802584546s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019258222 (19h56m17.802598321s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019539188 (19h56m17.802879287s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019830494 (19h56m17.803170593s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020110528 (19h56m17.803450627s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020441400 (19h56m17.803781499s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:33.078323480 (19h56m18.861663579s) [upload=19092]: Next returned nil segment May 25 22:00:33.078333228 (19h56m18.861673327s) [upload=19092]: Waiting for error group managing segments... May 25 22:00:33.362737910 (19h56m19.146078009s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.366505599 (19h56m19.149845698s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369025236 (19h56m19.152365335s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369736344 (19h56m19.153076443s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373386979 (19h56m19.156727128s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373749210 (19h56m19.15708931s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.376611661 (19h56m19.159951792s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385293187 (19h56m19.168633286s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385441840 (19h56m19.16878196s) [noise=true , address=212.102.52.214:4365 , piece_id=IIR5IJNAE76RYZ6YWVZ4Z67ZGKENSNRHDPNRVO3PDJXQC6YPZBYA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386502284 (19h56m19.169842383s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386550555 (19h56m19.169890654s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.387214632 (19h56m19.170554731s) [noise=true , address=212.102.52.214:4349 , piece_id=E4MU3EUSQ3MTS6THBGHYE2NP2TL42WH677WVCLZZRNCIHSMJF7GA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.389717318 (19h56m19.173057417s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391350674 (19h56m19.174690773s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391666748 (19h56m19.175006847s) [noise=true , address=212.102.52.217:4430 , piece_id=RIKS76WYCYE4AXJDZDBVHSCIHDWDRWH6WWMNAAQGJVSJQIEGMZEQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392934657 (19h56m19.176274756s) [noise=true , address=212.102.52.215:4376 , piece_id=IBG6TFEQKRLK56QA7Z4X5TYMQSOXHQ27CJXVKIP2FCYBQZW6DZLA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392943844 (19h56m19.176283933s) [seg_pos={0 0}, upload=19092]: Satisfied cohort requirements after 16 pieces May 25 22:00:33.393089582 (19h56m19.176429682s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ohfhnBX7MWrCCdmn8rKNQjksDizY9K7ar6Htz3BVTrsPPkMYn): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393096245 (19h56m19.176436334s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393196536 (19h56m19.176536625s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Px3pe9nYbzRQ9tb2RDpL3ZGKViv6rTTm8AvhVcofGfrUWg5bk): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393202889 (19h56m19.176542988s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393278763 (19h56m19.176618862s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i3YC1eLBhg5PiyPZhHFwFLprKxqgwo37862bYcYNsrB8rLdUG): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393288602 (19h56m19.176628701s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393314181 (19h56m19.17665428s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393319532 (19h56m19.176659621s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393341573 (19h56m19.176681662s) [seg_pos={0 0}, upload=19092]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 22:00:33.393400305 (19h56m19.176740444s) [upload=19092]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 22:00:33.393406276 (19h56m19.176746395s) [upload=19092]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 22:00:53.238873899 (19h56m39.022213998s) [upload=19092]: Done uploading segments... May 25 22:00:53.238893697 (19h56m39.022233796s) [upload=19092]: Upload finished. err: <nil> Duration: 3.946029214s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [X.............................X............XX..........X....] duration: 3.570363246s trace: https://jaeger.dev.storj.io/trace/e2041c22ff5061f FAIL (2026-05-25 22:33:21 UTC) orbiter warning: context deadline exceeded Duration: 3.570383146s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 13 out of 60 is failed (threshold=3) [.................X..X..XXX.XXX.........XX........XX.X.......] duration: 6.837389946s trace: https://jaeger.dev.storj.io/trace/31e5ee91d50b28c7 FAIL (2026-05-25 22:32:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.837427155s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 4.363757196s trace: https://jaeger.dev.storj.io/trace/5c964271d20d5817 FAIL (2026-05-25 22:32:38 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PZBYA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016526591 (19h56m17.79986668s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016942624 (19h56m17.800282723s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017345213 (19h56m17.800685312s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017704899 (19h56m17.801044998s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017945076 (19h56m17.801285175s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018092017 (19h56m17.801432116s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018464699 (19h56m17.801804798s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018555913 (19h56m17.801896012s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018953491 (19h56m17.80229359s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019244447 (19h56m17.802584546s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019258222 (19h56m17.802598321s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019539188 (19h56m17.802879287s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019830494 (19h56m17.803170593s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020110528 (19h56m17.803450627s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020441400 (19h56m17.803781499s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:33.078323480 (19h56m18.861663579s) [upload=19092]: Next returned nil segment May 25 22:00:33.078333228 (19h56m18.861673327s) [upload=19092]: Waiting for error group managing segments... May 25 22:00:33.362737910 (19h56m19.146078009s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.366505599 (19h56m19.149845698s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369025236 (19h56m19.152365335s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369736344 (19h56m19.153076443s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373386979 (19h56m19.156727128s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373749210 (19h56m19.15708931s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.376611661 (19h56m19.159951792s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385293187 (19h56m19.168633286s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385441840 (19h56m19.16878196s) [noise=true , address=212.102.52.214:4365 , piece_id=IIR5IJNAE76RYZ6YWVZ4Z67ZGKENSNRHDPNRVO3PDJXQC6YPZBYA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386502284 (19h56m19.169842383s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386550555 (19h56m19.169890654s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.387214632 (19h56m19.170554731s) [noise=true , address=212.102.52.214:4349 , piece_id=E4MU3EUSQ3MTS6THBGHYE2NP2TL42WH677WVCLZZRNCIHSMJF7GA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.389717318 (19h56m19.173057417s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391350674 (19h56m19.174690773s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391666748 (19h56m19.175006847s) [noise=true , address=212.102.52.217:4430 , piece_id=RIKS76WYCYE4AXJDZDBVHSCIHDWDRWH6WWMNAAQGJVSJQIEGMZEQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392934657 (19h56m19.176274756s) [noise=true , address=212.102.52.215:4376 , piece_id=IBG6TFEQKRLK56QA7Z4X5TYMQSOXHQ27CJXVKIP2FCYBQZW6DZLA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392943844 (19h56m19.176283933s) [seg_pos={0 0}, upload=19092]: Satisfied cohort requirements after 16 pieces May 25 22:00:33.393089582 (19h56m19.176429682s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ohfhnBX7MWrCCdmn8rKNQjksDizY9K7ar6Htz3BVTrsPPkMYn): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393096245 (19h56m19.176436334s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393196536 (19h56m19.176536625s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Px3pe9nYbzRQ9tb2RDpL3ZGKViv6rTTm8AvhVcofGfrUWg5bk): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393202889 (19h56m19.176542988s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393278763 (19h56m19.176618862s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i3YC1eLBhg5PiyPZhHFwFLprKxqgwo37862bYcYNsrB8rLdUG): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393288602 (19h56m19.176628701s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393314181 (19h56m19.17665428s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393319532 (19h56m19.176659621s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393341573 (19h56m19.176681662s) [seg_pos={0 0}, upload=19092]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 22:00:33.393400305 (19h56m19.176740444s) [upload=19092]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 22:00:33.393406276 (19h56m19.176746395s) [upload=19092]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 22:00:53.238873899 (19h56m39.022213998s) [upload=19092]: Done uploading segments... May 25 22:00:53.238893697 (19h56m39.022233796s) [upload=19092]: Upload finished. err: <nil> Duration: 4.363784099s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 13 out of 60 is failed (threshold=3) [..................X..X..XXX.XXX.........XX........XX.X......] duration: 6.360805556s trace: https://jaeger.dev.storj.io/trace/31e5ee91d50b28c7 FAIL (2026-05-25 22:32:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.360825142s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [.X.............................X............XX..........X...] duration: 3.613679228s trace: https://jaeger.dev.storj.io/trace/e2041c22ff5061f FAIL (2026-05-25 22:32:10 UTC) orbiter warning: context deadline exceeded Duration: 3.613698865s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 13 out of 60 is failed (threshold=3) [...................X..X..XXX.XXX.........XX........XX.X.....] duration: 6.548572033s trace: https://jaeger.dev.storj.io/trace/31e5ee91d50b28c7 FAIL (2026-05-25 22:31:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.548581482s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 4.576420248s trace: https://jaeger.dev.storj.io/trace/5c964271d20d5817 FAIL (2026-05-25 22:31:42 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PZBYA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016526591 (19h56m17.79986668s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016942624 (19h56m17.800282723s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017345213 (19h56m17.800685312s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017704899 (19h56m17.801044998s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017945076 (19h56m17.801285175s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018092017 (19h56m17.801432116s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018464699 (19h56m17.801804798s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018555913 (19h56m17.801896012s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018953491 (19h56m17.80229359s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019244447 (19h56m17.802584546s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019258222 (19h56m17.802598321s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019539188 (19h56m17.802879287s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019830494 (19h56m17.803170593s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020110528 (19h56m17.803450627s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020441400 (19h56m17.803781499s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:33.078323480 (19h56m18.861663579s) [upload=19092]: Next returned nil segment May 25 22:00:33.078333228 (19h56m18.861673327s) [upload=19092]: Waiting for error group managing segments... May 25 22:00:33.362737910 (19h56m19.146078009s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.366505599 (19h56m19.149845698s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369025236 (19h56m19.152365335s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369736344 (19h56m19.153076443s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373386979 (19h56m19.156727128s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373749210 (19h56m19.15708931s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.376611661 (19h56m19.159951792s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385293187 (19h56m19.168633286s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385441840 (19h56m19.16878196s) [noise=true , address=212.102.52.214:4365 , piece_id=IIR5IJNAE76RYZ6YWVZ4Z67ZGKENSNRHDPNRVO3PDJXQC6YPZBYA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386502284 (19h56m19.169842383s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386550555 (19h56m19.169890654s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.387214632 (19h56m19.170554731s) [noise=true , address=212.102.52.214:4349 , piece_id=E4MU3EUSQ3MTS6THBGHYE2NP2TL42WH677WVCLZZRNCIHSMJF7GA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.389717318 (19h56m19.173057417s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391350674 (19h56m19.174690773s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391666748 (19h56m19.175006847s) [noise=true , address=212.102.52.217:4430 , piece_id=RIKS76WYCYE4AXJDZDBVHSCIHDWDRWH6WWMNAAQGJVSJQIEGMZEQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392934657 (19h56m19.176274756s) [noise=true , address=212.102.52.215:4376 , piece_id=IBG6TFEQKRLK56QA7Z4X5TYMQSOXHQ27CJXVKIP2FCYBQZW6DZLA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392943844 (19h56m19.176283933s) [seg_pos={0 0}, upload=19092]: Satisfied cohort requirements after 16 pieces May 25 22:00:33.393089582 (19h56m19.176429682s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ohfhnBX7MWrCCdmn8rKNQjksDizY9K7ar6Htz3BVTrsPPkMYn): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393096245 (19h56m19.176436334s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393196536 (19h56m19.176536625s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Px3pe9nYbzRQ9tb2RDpL3ZGKViv6rTTm8AvhVcofGfrUWg5bk): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393202889 (19h56m19.176542988s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393278763 (19h56m19.176618862s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i3YC1eLBhg5PiyPZhHFwFLprKxqgwo37862bYcYNsrB8rLdUG): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393288602 (19h56m19.176628701s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393314181 (19h56m19.17665428s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393319532 (19h56m19.176659621s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393341573 (19h56m19.176681662s) [seg_pos={0 0}, upload=19092]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 22:00:33.393400305 (19h56m19.176740444s) [upload=19092]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 22:00:33.393406276 (19h56m19.176746395s) [upload=19092]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 22:00:53.238873899 (19h56m39.022213998s) [upload=19092]: Done uploading segments... May 25 22:00:53.238893697 (19h56m39.022233796s) [upload=19092]: Upload finished. err: <nil> Duration: 4.57644245s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [..X.............................X............XX..........X..] duration: 3.636537251s trace: https://jaeger.dev.storj.io/trace/e2041c22ff5061f FAIL (2026-05-25 22:31:15 UTC) orbiter warning: context deadline exceeded Duration: 3.636564975s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 6.563761927s trace: https://jaeger.dev.storj.io/trace/5c964271d20d5817 FAIL (2026-05-25 22:30:41 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PZBYA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016526591 (19h56m17.79986668s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016942624 (19h56m17.800282723s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017345213 (19h56m17.800685312s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017704899 (19h56m17.801044998s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017945076 (19h56m17.801285175s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018092017 (19h56m17.801432116s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018464699 (19h56m17.801804798s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018555913 (19h56m17.801896012s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018953491 (19h56m17.80229359s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019244447 (19h56m17.802584546s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019258222 (19h56m17.802598321s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019539188 (19h56m17.802879287s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019830494 (19h56m17.803170593s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020110528 (19h56m17.803450627s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020441400 (19h56m17.803781499s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:33.078323480 (19h56m18.861663579s) [upload=19092]: Next returned nil segment May 25 22:00:33.078333228 (19h56m18.861673327s) [upload=19092]: Waiting for error group managing segments... May 25 22:00:33.362737910 (19h56m19.146078009s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.366505599 (19h56m19.149845698s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369025236 (19h56m19.152365335s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369736344 (19h56m19.153076443s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373386979 (19h56m19.156727128s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373749210 (19h56m19.15708931s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.376611661 (19h56m19.159951792s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385293187 (19h56m19.168633286s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385441840 (19h56m19.16878196s) [noise=true , address=212.102.52.214:4365 , piece_id=IIR5IJNAE76RYZ6YWVZ4Z67ZGKENSNRHDPNRVO3PDJXQC6YPZBYA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386502284 (19h56m19.169842383s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386550555 (19h56m19.169890654s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.387214632 (19h56m19.170554731s) [noise=true , address=212.102.52.214:4349 , piece_id=E4MU3EUSQ3MTS6THBGHYE2NP2TL42WH677WVCLZZRNCIHSMJF7GA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.389717318 (19h56m19.173057417s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391350674 (19h56m19.174690773s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391666748 (19h56m19.175006847s) [noise=true , address=212.102.52.217:4430 , piece_id=RIKS76WYCYE4AXJDZDBVHSCIHDWDRWH6WWMNAAQGJVSJQIEGMZEQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392934657 (19h56m19.176274756s) [noise=true , address=212.102.52.215:4376 , piece_id=IBG6TFEQKRLK56QA7Z4X5TYMQSOXHQ27CJXVKIP2FCYBQZW6DZLA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392943844 (19h56m19.176283933s) [seg_pos={0 0}, upload=19092]: Satisfied cohort requirements after 16 pieces May 25 22:00:33.393089582 (19h56m19.176429682s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ohfhnBX7MWrCCdmn8rKNQjksDizY9K7ar6Htz3BVTrsPPkMYn): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393096245 (19h56m19.176436334s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393196536 (19h56m19.176536625s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Px3pe9nYbzRQ9tb2RDpL3ZGKViv6rTTm8AvhVcofGfrUWg5bk): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393202889 (19h56m19.176542988s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393278763 (19h56m19.176618862s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i3YC1eLBhg5PiyPZhHFwFLprKxqgwo37862bYcYNsrB8rLdUG): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393288602 (19h56m19.176628701s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393314181 (19h56m19.17665428s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393319532 (19h56m19.176659621s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393341573 (19h56m19.176681662s) [seg_pos={0 0}, upload=19092]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 22:00:33.393400305 (19h56m19.176740444s) [upload=19092]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 22:00:33.393406276 (19h56m19.176746395s) [upload=19092]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 22:00:53.238873899 (19h56m39.022213998s) [upload=19092]: Done uploading segments... May 25 22:00:53.238893697 (19h56m39.022233796s) [upload=19092]: Upload finished. err: <nil> Duration: 6.563781204s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 13 out of 60 is failed (threshold=3) [....................X..X..XXX.XXX.........XX........XX.X....] duration: 6.792332766s trace: https://jaeger.dev.storj.io/trace/31e5ee91d50b28c7 FAIL (2026-05-25 22:30:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.792355068s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [...X.............................X............XX..........X.] duration: 3.756508575s trace: https://jaeger.dev.storj.io/trace/e2041c22ff5061f FAIL (2026-05-25 22:30:31 UTC) orbiter warning: context deadline exceeded Duration: 3.756528524s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 13 out of 60 is failed (threshold=3) [.....................X..X..XXX.XXX.........XX........XX.X...] duration: 7.491780843s trace: https://jaeger.dev.storj.io/trace/31e5ee91d50b28c7 FAIL (2026-05-25 22:30:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.49184256s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [....X.............................X............XX..........X] duration: 5.001493547s trace: https://jaeger.dev.storj.io/trace/e2041c22ff5061f FAIL (2026-05-25 22:29:39 UTC) orbiter warning: context deadline exceeded Duration: 5.001506041s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.760042978s trace: https://jaeger.dev.storj.io/trace/5c964271d20d5817 FAIL (2026-05-25 22:29:34 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== PZBYA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016526591 (19h56m17.79986668s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.016942624 (19h56m17.800282723s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017345213 (19h56m17.800685312s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017704899 (19h56m17.801044998s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.017945076 (19h56m17.801285175s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018092017 (19h56m17.801432116s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018464699 (19h56m17.801804798s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018555913 (19h56m17.801896012s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.018953491 (19h56m17.80229359s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019244447 (19h56m17.802584546s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019258222 (19h56m17.802598321s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019539188 (19h56m17.802879287s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.019830494 (19h56m17.803170593s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020110528 (19h56m17.803450627s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:32.020441400 (19h56m17.803781499s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Uploading piece... May 25 22:00:33.078323480 (19h56m18.861663579s) [upload=19092]: Next returned nil segment May 25 22:00:33.078333228 (19h56m18.861673327s) [upload=19092]: Waiting for error group managing segments... May 25 22:00:33.362737910 (19h56m19.146078009s) [noise=true , address=212.102.52.217:4435 , piece_id=UGNSVT6BMSSG4ONLIT224QXGLAMVTDTFYOBI2PTRW3NRT72EKUTA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.366505599 (19h56m19.149845698s) [noise=true , address=212.102.52.216:4398 , piece_id=PJVDU2MLBCOCPAX5ZY6UZU2A6LPOBA6BK3ESUO2YAHPUD5AHTVJA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369025236 (19h56m19.152365335s) [noise=true , address=212.102.52.215:4391 , piece_id=BIUJXSMRFAYOATOIVZ73WR236BLHIQWEYWOZZ6MFPOICNG5HJH3A, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.369736344 (19h56m19.153076443s) [noise=true , address=212.102.52.213:4324 , piece_id=PEYXUGDB5LZ5X6ZL3BFW5Y7KVHAX4XKK3SOZZ4NIF7P5DMSLNY7Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373386979 (19h56m19.156727128s) [noise=true , address=212.102.52.214:4357 , piece_id=W7O3PGV2WDB3ZRMNAXZCDIE7JJJCIBK7YRRU643FR33EXYZY4KQA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.373749210 (19h56m19.15708931s) [noise=true , address=212.102.52.213:4336 , piece_id=LYOKI76BSM6VOD6BQ4LNX6EFGIUMSSHC2IEC5CIA52N52J7ZTO2Q, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.376611661 (19h56m19.159951792s) [noise=true , address=212.102.52.213:4340 , piece_id=3U3H5IRALM7QW6A4FV2EQNPFSVT33GXJL7NYOJIW6A5T3LBZPBVQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385293187 (19h56m19.168633286s) [noise=true , address=212.102.52.217:4417 , piece_id=SNP2IHUE55IHBBPUJUGKOABHKNZ3EAQNPERP4CM6H5MNM4ZNWHUA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.385441840 (19h56m19.16878196s) [noise=true , address=212.102.52.214:4365 , piece_id=IIR5IJNAE76RYZ6YWVZ4Z67ZGKENSNRHDPNRVO3PDJXQC6YPZBYA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386502284 (19h56m19.169842383s) [noise=true , address=212.102.52.217:4420 , piece_id=LKY4ZOYCZICHV5WT5QLA6UZQ2N5JLX32CASLNHCBVV7PRV2IHRZQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.386550555 (19h56m19.169890654s) [noise=true , address=212.102.52.216:4408 , piece_id=V365XJO35CB2AT45TJTMIL7R7B42XY3GQIG5TVE3GYXAWWMXKQLQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.387214632 (19h56m19.170554731s) [noise=true , address=212.102.52.214:4349 , piece_id=E4MU3EUSQ3MTS6THBGHYE2NP2TL42WH677WVCLZZRNCIHSMJF7GA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.389717318 (19h56m19.173057417s) [noise=true , address=212.102.52.215:4374 , piece_id=Z4JJUIXBZN43BLG57VKZQV2QNTAY5D754GMSFEHVSSNXSFNYSAKA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391350674 (19h56m19.174690773s) [noise=true , address=212.102.52.214:4350 , piece_id=47OQ2QSA54PSPA6SSP7U6YWMKHNV3I2XDDGUCI73V6MLWKOTIWIA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.391666748 (19h56m19.175006847s) [noise=true , address=212.102.52.217:4430 , piece_id=RIKS76WYCYE4AXJDZDBVHSCIHDWDRWH6WWMNAAQGJVSJQIEGMZEQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392934657 (19h56m19.176274756s) [noise=true , address=212.102.52.215:4376 , piece_id=IBG6TFEQKRLK56QA7Z4X5TYMQSOXHQ27CJXVKIP2FCYBQZW6DZLA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: <nil> May 25 22:00:33.392943844 (19h56m19.176283933s) [seg_pos={0 0}, upload=19092]: Satisfied cohort requirements after 16 pieces May 25 22:00:33.393089582 (19h56m19.176429682s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ohfhnBX7MWrCCdmn8rKNQjksDizY9K7ar6Htz3BVTrsPPkMYn): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393096245 (19h56m19.176436334s) [noise=true , address=212.102.52.213:4344 , piece_id=GNBJGA4GCWLWBGI2K7THTZGVG35TDSCGRHC5UTT3MNRPSHBQX7PA, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393196536 (19h56m19.176536625s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Px3pe9nYbzRQ9tb2RDpL3ZGKViv6rTTm8AvhVcofGfrUWg5bk): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393202889 (19h56m19.176542988s) [noise=true , address=212.102.52.216:4409 , piece_id=MZEXBOHGKTUTAGNCZAPFSL4ZIWN32NI4NTF6DTL7JCI4DW7TPYSQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393278763 (19h56m19.176618862s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i3YC1eLBhg5PiyPZhHFwFLprKxqgwo37862bYcYNsrB8rLdUG): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393288602 (19h56m19.176628701s) [noise=true , address=212.102.52.215:4382 , piece_id=G2FUEPQG5VITPPR2VTA4XC6XRAPLADKO44JJUMU2XZ7POWLDC6QQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393314181 (19h56m19.17665428s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 22:00:33.393319532 (19h56m19.176659621s) [noise=true , address=212.102.52.216:4416 , piece_id=XND2VKBR3BBR56NGITX7CMIEMTC7HZ5S6Q2DBSRLY5DV6JKSQQGQ, seg_pos={0 0}, upload=19092]: Long tail cancellation due to optimal threshold May 25 22:00:33.393341573 (19h56m19.176681662s) [seg_pos={0 0}, upload=19092]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 22:00:33.393400305 (19h56m19.176740444s) [upload=19092]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 22:00:33.393406276 (19h56m19.176746395s) [upload=19092]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 22:00:53.238873899 (19h56m39.022213998s) [upload=19092]: Done uploading segments... May 25 22:00:53.238893697 (19h56m39.022233796s) [upload=19092]: Upload finished. err: <nil> Duration: 5.760069019s core uplink uk-select-1 uk1-placement-17

Orbiter Check History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)