Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..........................................X..............X..] duration: 4.844517242s trace: https://jaeger.dev.storj.io/trace/3bd7a1328937f878 FAIL (2026-05-26 00:03:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.844583558s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 4.060613472s trace: https://jaeger.dev.storj.io/trace/154f04129c3ba223 FAIL (2026-05-26 00:02:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== H5UA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.669978445 (21h21m58.453318544s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670570324 (21h21m58.453910423s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670977932 (21h21m58.454318031s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671082672 (21h21m58.454422771s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671399046 (21h21m58.454739145s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671505018 (21h21m58.454845117s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671768601 (21h21m58.4551087s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671873380 (21h21m58.455213479s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672172411 (21h21m58.45551251s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672225192 (21h21m58.455565291s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672604115 (21h21m58.455944214s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672647878 (21h21m58.455987977s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672979411 (21h21m58.45631951s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673026311 (21h21m58.45636641s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673319009 (21h21m58.456659108s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:13.747141337 (21h21m59.530481436s) [upload=20458]: Next returned nil segment May 25 23:26:13.747155513 (21h21m59.530495612s) [upload=20458]: Waiting for error group managing segments... May 25 23:26:14.031706029 (21h21m59.815046128s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034098815 (21h21m59.817438914s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034662339 (21h21m59.818002439s) [noise=true , address=212.102.52.214:4362 , piece_id=ZSAFYLTPN3ESF7KDM6RXVTPIHI2O5BJ77WJQXDRGXEIM5IUTEVMQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034708708 (21h21m59.818048807s) [noise=true , address=212.102.52.217:4419 , piece_id=3IAS5VH7QJ2SJOMUCY2B4MCNYECWLHUH3AGH6MOGM4NS6KDAH5UA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035071280 (21h21m59.818411379s) [noise=true , address=212.102.52.217:4424 , piece_id=OHAYPIY666MWXWJTMWLPWTPE3RAXI6SG6NRFZRQS7VO4GKYCOECQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035492163 (21h21m59.818832272s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.036495778 (21h21m59.819835877s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.037130078 (21h21m59.820470177s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.040472716 (21h21m59.823812815s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.042158933 (21h21m59.825499032s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045074927 (21h21m59.828415026s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045309063 (21h21m59.828649162s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046163785 (21h21m59.829503874s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046705198 (21h21m59.830045297s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.062034446 (21h21m59.845374546s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070397062 (21h21m59.853737161s) [noise=true , address=212.102.52.213:4322 , piece_id=TW24WKT2HYX65MOG6ILC2GYJPHYS5VRAEKPWGNF3MMPVJYMAZPHQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070415798 (21h21m59.853755897s) [seg_pos={0 0}, upload=20458]: Satisfied cohort requirements after 16 pieces May 25 23:26:14.070581143 (21h21m59.853921242s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VK5hn1TRuMk5ZXTat7nmjx4kXZec3RDyQ89iQrrrRzVh2xPVF): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070588727 (21h21m59.853928826s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070817384 (21h21m59.854157483s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cCanaWd2hWD8vcQCophdGPopVihkjKSuUcB7ZyqqBcK1JTvSf): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070822854 (21h21m59.854162943s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070908688 (21h21m59.854248787s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070913157 (21h21m59.854253256s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071162232 (21h21m59.854502341s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.071169757 (21h21m59.854509866s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071187790 (21h21m59.854527889s) [seg_pos={0 0}, upload=20458]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 23:26:14.071292471 (21h21m59.85463257s) [upload=20458]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 23:26:14.071297069 (21h21m59.854637168s) [upload=20458]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 23:26:38.384275645 (21h22m24.167615734s) [upload=20458]: Done uploading segments... May 25 23:26:38.384290073 (21h22m24.167630172s) [upload=20458]: Upload finished. err: <nil> Duration: 4.060637528s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [...X..X.X....................X.X..XX.X...............X......] duration: 38.029885803s trace: https://jaeger.dev.storj.io/trace/538e5c94a3d33f13 FAIL (2026-05-26 00:02:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 38.029908154s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 21.904224505s trace: https://jaeger.dev.storj.io/trace/154f04129c3ba223 FAIL (2026-05-26 00:02:23 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== H5UA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.669978445 (21h21m58.453318544s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670570324 (21h21m58.453910423s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670977932 (21h21m58.454318031s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671082672 (21h21m58.454422771s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671399046 (21h21m58.454739145s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671505018 (21h21m58.454845117s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671768601 (21h21m58.4551087s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671873380 (21h21m58.455213479s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672172411 (21h21m58.45551251s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672225192 (21h21m58.455565291s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672604115 (21h21m58.455944214s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672647878 (21h21m58.455987977s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672979411 (21h21m58.45631951s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673026311 (21h21m58.45636641s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673319009 (21h21m58.456659108s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:13.747141337 (21h21m59.530481436s) [upload=20458]: Next returned nil segment May 25 23:26:13.747155513 (21h21m59.530495612s) [upload=20458]: Waiting for error group managing segments... May 25 23:26:14.031706029 (21h21m59.815046128s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034098815 (21h21m59.817438914s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034662339 (21h21m59.818002439s) [noise=true , address=212.102.52.214:4362 , piece_id=ZSAFYLTPN3ESF7KDM6RXVTPIHI2O5BJ77WJQXDRGXEIM5IUTEVMQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034708708 (21h21m59.818048807s) [noise=true , address=212.102.52.217:4419 , piece_id=3IAS5VH7QJ2SJOMUCY2B4MCNYECWLHUH3AGH6MOGM4NS6KDAH5UA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035071280 (21h21m59.818411379s) [noise=true , address=212.102.52.217:4424 , piece_id=OHAYPIY666MWXWJTMWLPWTPE3RAXI6SG6NRFZRQS7VO4GKYCOECQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035492163 (21h21m59.818832272s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.036495778 (21h21m59.819835877s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.037130078 (21h21m59.820470177s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.040472716 (21h21m59.823812815s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.042158933 (21h21m59.825499032s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045074927 (21h21m59.828415026s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045309063 (21h21m59.828649162s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046163785 (21h21m59.829503874s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046705198 (21h21m59.830045297s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.062034446 (21h21m59.845374546s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070397062 (21h21m59.853737161s) [noise=true , address=212.102.52.213:4322 , piece_id=TW24WKT2HYX65MOG6ILC2GYJPHYS5VRAEKPWGNF3MMPVJYMAZPHQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070415798 (21h21m59.853755897s) [seg_pos={0 0}, upload=20458]: Satisfied cohort requirements after 16 pieces May 25 23:26:14.070581143 (21h21m59.853921242s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VK5hn1TRuMk5ZXTat7nmjx4kXZec3RDyQ89iQrrrRzVh2xPVF): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070588727 (21h21m59.853928826s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070817384 (21h21m59.854157483s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cCanaWd2hWD8vcQCophdGPopVihkjKSuUcB7ZyqqBcK1JTvSf): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070822854 (21h21m59.854162943s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070908688 (21h21m59.854248787s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070913157 (21h21m59.854253256s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071162232 (21h21m59.854502341s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.071169757 (21h21m59.854509866s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071187790 (21h21m59.854527889s) [seg_pos={0 0}, upload=20458]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 23:26:14.071292471 (21h21m59.85463257s) [upload=20458]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 23:26:14.071297069 (21h21m59.854637168s) [upload=20458]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 23:26:38.384275645 (21h22m24.167615734s) [upload=20458]: Done uploading segments... May 25 23:26:38.384290073 (21h22m24.167630172s) [upload=20458]: Upload finished. err: <nil> Duration: 21.904249493s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...........................................X..............X.] duration: 4.280723278s trace: https://jaeger.dev.storj.io/trace/3bd7a1328937f878 FAIL (2026-05-26 00:02:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.280740902s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [....X..X.X....................X.X..XX.X...............X.....] duration: 6.542095442s trace: https://jaeger.dev.storj.io/trace/538e5c94a3d33f13 FAIL (2026-05-26 00:01:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.54212057s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [............................................X..............X] duration: 5.001332842s trace: https://jaeger.dev.storj.io/trace/3bd7a1328937f878 FAIL (2026-05-26 00:01:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001355134s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 4.113899984s trace: https://jaeger.dev.storj.io/trace/154f04129c3ba223 FAIL (2026-05-26 00:01:34 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== H5UA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.669978445 (21h21m58.453318544s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670570324 (21h21m58.453910423s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670977932 (21h21m58.454318031s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671082672 (21h21m58.454422771s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671399046 (21h21m58.454739145s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671505018 (21h21m58.454845117s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671768601 (21h21m58.4551087s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671873380 (21h21m58.455213479s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672172411 (21h21m58.45551251s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672225192 (21h21m58.455565291s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672604115 (21h21m58.455944214s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672647878 (21h21m58.455987977s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672979411 (21h21m58.45631951s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673026311 (21h21m58.45636641s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673319009 (21h21m58.456659108s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:13.747141337 (21h21m59.530481436s) [upload=20458]: Next returned nil segment May 25 23:26:13.747155513 (21h21m59.530495612s) [upload=20458]: Waiting for error group managing segments... May 25 23:26:14.031706029 (21h21m59.815046128s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034098815 (21h21m59.817438914s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034662339 (21h21m59.818002439s) [noise=true , address=212.102.52.214:4362 , piece_id=ZSAFYLTPN3ESF7KDM6RXVTPIHI2O5BJ77WJQXDRGXEIM5IUTEVMQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034708708 (21h21m59.818048807s) [noise=true , address=212.102.52.217:4419 , piece_id=3IAS5VH7QJ2SJOMUCY2B4MCNYECWLHUH3AGH6MOGM4NS6KDAH5UA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035071280 (21h21m59.818411379s) [noise=true , address=212.102.52.217:4424 , piece_id=OHAYPIY666MWXWJTMWLPWTPE3RAXI6SG6NRFZRQS7VO4GKYCOECQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035492163 (21h21m59.818832272s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.036495778 (21h21m59.819835877s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.037130078 (21h21m59.820470177s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.040472716 (21h21m59.823812815s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.042158933 (21h21m59.825499032s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045074927 (21h21m59.828415026s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045309063 (21h21m59.828649162s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046163785 (21h21m59.829503874s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046705198 (21h21m59.830045297s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.062034446 (21h21m59.845374546s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070397062 (21h21m59.853737161s) [noise=true , address=212.102.52.213:4322 , piece_id=TW24WKT2HYX65MOG6ILC2GYJPHYS5VRAEKPWGNF3MMPVJYMAZPHQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070415798 (21h21m59.853755897s) [seg_pos={0 0}, upload=20458]: Satisfied cohort requirements after 16 pieces May 25 23:26:14.070581143 (21h21m59.853921242s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VK5hn1TRuMk5ZXTat7nmjx4kXZec3RDyQ89iQrrrRzVh2xPVF): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070588727 (21h21m59.853928826s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070817384 (21h21m59.854157483s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cCanaWd2hWD8vcQCophdGPopVihkjKSuUcB7ZyqqBcK1JTvSf): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070822854 (21h21m59.854162943s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070908688 (21h21m59.854248787s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070913157 (21h21m59.854253256s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071162232 (21h21m59.854502341s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.071169757 (21h21m59.854509866s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071187790 (21h21m59.854527889s) [seg_pos={0 0}, upload=20458]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 23:26:14.071292471 (21h21m59.85463257s) [upload=20458]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 23:26:14.071297069 (21h21m59.854637168s) [upload=20458]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 23:26:38.384275645 (21h22m24.167615734s) [upload=20458]: Done uploading segments... May 25 23:26:38.384290073 (21h22m24.167630172s) [upload=20458]: Upload finished. err: <nil> Duration: 4.113921325s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 4.492447165s trace: https://jaeger.dev.storj.io/trace/154f04129c3ba223 FAIL (2026-05-26 00:00:58 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== H5UA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.669978445 (21h21m58.453318544s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670570324 (21h21m58.453910423s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670977932 (21h21m58.454318031s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671082672 (21h21m58.454422771s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671399046 (21h21m58.454739145s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671505018 (21h21m58.454845117s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671768601 (21h21m58.4551087s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671873380 (21h21m58.455213479s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672172411 (21h21m58.45551251s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672225192 (21h21m58.455565291s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672604115 (21h21m58.455944214s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672647878 (21h21m58.455987977s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672979411 (21h21m58.45631951s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673026311 (21h21m58.45636641s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673319009 (21h21m58.456659108s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:13.747141337 (21h21m59.530481436s) [upload=20458]: Next returned nil segment May 25 23:26:13.747155513 (21h21m59.530495612s) [upload=20458]: Waiting for error group managing segments... May 25 23:26:14.031706029 (21h21m59.815046128s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034098815 (21h21m59.817438914s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034662339 (21h21m59.818002439s) [noise=true , address=212.102.52.214:4362 , piece_id=ZSAFYLTPN3ESF7KDM6RXVTPIHI2O5BJ77WJQXDRGXEIM5IUTEVMQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034708708 (21h21m59.818048807s) [noise=true , address=212.102.52.217:4419 , piece_id=3IAS5VH7QJ2SJOMUCY2B4MCNYECWLHUH3AGH6MOGM4NS6KDAH5UA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035071280 (21h21m59.818411379s) [noise=true , address=212.102.52.217:4424 , piece_id=OHAYPIY666MWXWJTMWLPWTPE3RAXI6SG6NRFZRQS7VO4GKYCOECQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035492163 (21h21m59.818832272s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.036495778 (21h21m59.819835877s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.037130078 (21h21m59.820470177s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.040472716 (21h21m59.823812815s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.042158933 (21h21m59.825499032s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045074927 (21h21m59.828415026s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045309063 (21h21m59.828649162s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046163785 (21h21m59.829503874s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046705198 (21h21m59.830045297s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.062034446 (21h21m59.845374546s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070397062 (21h21m59.853737161s) [noise=true , address=212.102.52.213:4322 , piece_id=TW24WKT2HYX65MOG6ILC2GYJPHYS5VRAEKPWGNF3MMPVJYMAZPHQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070415798 (21h21m59.853755897s) [seg_pos={0 0}, upload=20458]: Satisfied cohort requirements after 16 pieces May 25 23:26:14.070581143 (21h21m59.853921242s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VK5hn1TRuMk5ZXTat7nmjx4kXZec3RDyQ89iQrrrRzVh2xPVF): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070588727 (21h21m59.853928826s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070817384 (21h21m59.854157483s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cCanaWd2hWD8vcQCophdGPopVihkjKSuUcB7ZyqqBcK1JTvSf): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070822854 (21h21m59.854162943s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070908688 (21h21m59.854248787s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070913157 (21h21m59.854253256s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071162232 (21h21m59.854502341s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.071169757 (21h21m59.854509866s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071187790 (21h21m59.854527889s) [seg_pos={0 0}, upload=20458]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 23:26:14.071292471 (21h21m59.85463257s) [upload=20458]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 23:26:14.071297069 (21h21m59.854637168s) [upload=20458]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 23:26:38.384275645 (21h22m24.167615734s) [upload=20458]: Done uploading segments... May 25 23:26:38.384290073 (21h22m24.167630172s) [upload=20458]: Upload finished. err: <nil> Duration: 4.492466802s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.............................................X..............] duration: 3.698841782s trace: https://jaeger.dev.storj.io/trace/61118016982afaf6 FAIL (2026-05-26 00:00:58 UTC) orbiter warning: context deadline exceeded Duration: 3.698865246s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [X....X..X.X....................X.X..XX.X...............X....] duration: 6.758278299s trace: https://jaeger.dev.storj.io/trace/538e5c94a3d33f13 FAIL (2026-05-26 00:00:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.758296754s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 4.290304679s trace: https://jaeger.dev.storj.io/trace/154f04129c3ba223 FAIL (2026-05-26 00:00:33 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== H5UA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.669978445 (21h21m58.453318544s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670570324 (21h21m58.453910423s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670977932 (21h21m58.454318031s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671082672 (21h21m58.454422771s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671399046 (21h21m58.454739145s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671505018 (21h21m58.454845117s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671768601 (21h21m58.4551087s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671873380 (21h21m58.455213479s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672172411 (21h21m58.45551251s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672225192 (21h21m58.455565291s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672604115 (21h21m58.455944214s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672647878 (21h21m58.455987977s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672979411 (21h21m58.45631951s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673026311 (21h21m58.45636641s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673319009 (21h21m58.456659108s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:13.747141337 (21h21m59.530481436s) [upload=20458]: Next returned nil segment May 25 23:26:13.747155513 (21h21m59.530495612s) [upload=20458]: Waiting for error group managing segments... May 25 23:26:14.031706029 (21h21m59.815046128s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034098815 (21h21m59.817438914s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034662339 (21h21m59.818002439s) [noise=true , address=212.102.52.214:4362 , piece_id=ZSAFYLTPN3ESF7KDM6RXVTPIHI2O5BJ77WJQXDRGXEIM5IUTEVMQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034708708 (21h21m59.818048807s) [noise=true , address=212.102.52.217:4419 , piece_id=3IAS5VH7QJ2SJOMUCY2B4MCNYECWLHUH3AGH6MOGM4NS6KDAH5UA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035071280 (21h21m59.818411379s) [noise=true , address=212.102.52.217:4424 , piece_id=OHAYPIY666MWXWJTMWLPWTPE3RAXI6SG6NRFZRQS7VO4GKYCOECQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035492163 (21h21m59.818832272s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.036495778 (21h21m59.819835877s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.037130078 (21h21m59.820470177s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.040472716 (21h21m59.823812815s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.042158933 (21h21m59.825499032s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045074927 (21h21m59.828415026s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045309063 (21h21m59.828649162s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046163785 (21h21m59.829503874s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046705198 (21h21m59.830045297s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.062034446 (21h21m59.845374546s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070397062 (21h21m59.853737161s) [noise=true , address=212.102.52.213:4322 , piece_id=TW24WKT2HYX65MOG6ILC2GYJPHYS5VRAEKPWGNF3MMPVJYMAZPHQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070415798 (21h21m59.853755897s) [seg_pos={0 0}, upload=20458]: Satisfied cohort requirements after 16 pieces May 25 23:26:14.070581143 (21h21m59.853921242s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VK5hn1TRuMk5ZXTat7nmjx4kXZec3RDyQ89iQrrrRzVh2xPVF): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070588727 (21h21m59.853928826s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070817384 (21h21m59.854157483s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cCanaWd2hWD8vcQCophdGPopVihkjKSuUcB7ZyqqBcK1JTvSf): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070822854 (21h21m59.854162943s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070908688 (21h21m59.854248787s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070913157 (21h21m59.854253256s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071162232 (21h21m59.854502341s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.071169757 (21h21m59.854509866s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071187790 (21h21m59.854527889s) [seg_pos={0 0}, upload=20458]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 23:26:14.071292471 (21h21m59.85463257s) [upload=20458]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 23:26:14.071297069 (21h21m59.854637168s) [upload=20458]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 23:26:38.384275645 (21h22m24.167615734s) [upload=20458]: Done uploading segments... May 25 23:26:38.384290073 (21h22m24.167630172s) [upload=20458]: Upload finished. err: <nil> Duration: 4.290328174s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [XX....X..X.X....................X.X..XX.X...............X...] duration: 6.457961071s trace: https://jaeger.dev.storj.io/trace/538e5c94a3d33f13 FAIL (2026-05-26 00:00:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.457988913s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [.XX....X..X.X....................X.X..XX.X...............X..] duration: 6.720908702s trace: https://jaeger.dev.storj.io/trace/538e5c94a3d33f13 FAIL (2026-05-25 23:59:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.720920795s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..............................................X.............] duration: 5.001352499s trace: https://jaeger.dev.storj.io/trace/61118016982afaf6 FAIL (2026-05-25 23:59:57 UTC) orbiter warning: context deadline exceeded Duration: 5.001372207s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 12 out of 60 is failed (threshold=3) [X.XX....X..X.X....................X.X..XX.X...............X.] duration: 30.366770469s trace: https://jaeger.dev.storj.io/trace/538e5c94a3d33f13 FAIL (2026-05-25 23:59:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.366785408s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 4.076195556s trace: https://jaeger.dev.storj.io/trace/154f04129c3ba223 FAIL (2026-05-25 23:59:39 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== H5UA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.669978445 (21h21m58.453318544s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670570324 (21h21m58.453910423s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670977932 (21h21m58.454318031s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671082672 (21h21m58.454422771s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671399046 (21h21m58.454739145s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671505018 (21h21m58.454845117s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671768601 (21h21m58.4551087s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671873380 (21h21m58.455213479s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672172411 (21h21m58.45551251s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672225192 (21h21m58.455565291s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672604115 (21h21m58.455944214s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672647878 (21h21m58.455987977s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672979411 (21h21m58.45631951s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673026311 (21h21m58.45636641s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673319009 (21h21m58.456659108s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:13.747141337 (21h21m59.530481436s) [upload=20458]: Next returned nil segment May 25 23:26:13.747155513 (21h21m59.530495612s) [upload=20458]: Waiting for error group managing segments... May 25 23:26:14.031706029 (21h21m59.815046128s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034098815 (21h21m59.817438914s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034662339 (21h21m59.818002439s) [noise=true , address=212.102.52.214:4362 , piece_id=ZSAFYLTPN3ESF7KDM6RXVTPIHI2O5BJ77WJQXDRGXEIM5IUTEVMQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034708708 (21h21m59.818048807s) [noise=true , address=212.102.52.217:4419 , piece_id=3IAS5VH7QJ2SJOMUCY2B4MCNYECWLHUH3AGH6MOGM4NS6KDAH5UA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035071280 (21h21m59.818411379s) [noise=true , address=212.102.52.217:4424 , piece_id=OHAYPIY666MWXWJTMWLPWTPE3RAXI6SG6NRFZRQS7VO4GKYCOECQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035492163 (21h21m59.818832272s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.036495778 (21h21m59.819835877s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.037130078 (21h21m59.820470177s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.040472716 (21h21m59.823812815s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.042158933 (21h21m59.825499032s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045074927 (21h21m59.828415026s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045309063 (21h21m59.828649162s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046163785 (21h21m59.829503874s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046705198 (21h21m59.830045297s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.062034446 (21h21m59.845374546s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070397062 (21h21m59.853737161s) [noise=true , address=212.102.52.213:4322 , piece_id=TW24WKT2HYX65MOG6ILC2GYJPHYS5VRAEKPWGNF3MMPVJYMAZPHQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070415798 (21h21m59.853755897s) [seg_pos={0 0}, upload=20458]: Satisfied cohort requirements after 16 pieces May 25 23:26:14.070581143 (21h21m59.853921242s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VK5hn1TRuMk5ZXTat7nmjx4kXZec3RDyQ89iQrrrRzVh2xPVF): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070588727 (21h21m59.853928826s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070817384 (21h21m59.854157483s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cCanaWd2hWD8vcQCophdGPopVihkjKSuUcB7ZyqqBcK1JTvSf): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070822854 (21h21m59.854162943s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070908688 (21h21m59.854248787s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070913157 (21h21m59.854253256s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071162232 (21h21m59.854502341s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.071169757 (21h21m59.854509866s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071187790 (21h21m59.854527889s) [seg_pos={0 0}, upload=20458]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 23:26:14.071292471 (21h21m59.85463257s) [upload=20458]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 23:26:14.071297069 (21h21m59.854637168s) [upload=20458]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 23:26:38.384275645 (21h22m24.167615734s) [upload=20458]: Done uploading segments... May 25 23:26:38.384290073 (21h22m24.167630172s) [upload=20458]: Upload finished. err: <nil> Duration: 4.076217316s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 12 out of 60 is failed (threshold=3) [.X.XX....X..X.X....................X.X..XX.X...............X] duration: 1m0.00038607s trace: https://jaeger.dev.storj.io/trace/538e5c94a3d33f13 FAIL (2026-05-25 23:59:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000401098s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 5.142813583s trace: https://jaeger.dev.storj.io/trace/154f04129c3ba223 FAIL (2026-05-25 23:59:01 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== H5UA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.669978445 (21h21m58.453318544s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670570324 (21h21m58.453910423s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670977932 (21h21m58.454318031s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671082672 (21h21m58.454422771s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671399046 (21h21m58.454739145s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671505018 (21h21m58.454845117s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671768601 (21h21m58.4551087s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671873380 (21h21m58.455213479s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672172411 (21h21m58.45551251s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672225192 (21h21m58.455565291s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672604115 (21h21m58.455944214s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672647878 (21h21m58.455987977s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672979411 (21h21m58.45631951s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673026311 (21h21m58.45636641s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673319009 (21h21m58.456659108s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:13.747141337 (21h21m59.530481436s) [upload=20458]: Next returned nil segment May 25 23:26:13.747155513 (21h21m59.530495612s) [upload=20458]: Waiting for error group managing segments... May 25 23:26:14.031706029 (21h21m59.815046128s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034098815 (21h21m59.817438914s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034662339 (21h21m59.818002439s) [noise=true , address=212.102.52.214:4362 , piece_id=ZSAFYLTPN3ESF7KDM6RXVTPIHI2O5BJ77WJQXDRGXEIM5IUTEVMQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034708708 (21h21m59.818048807s) [noise=true , address=212.102.52.217:4419 , piece_id=3IAS5VH7QJ2SJOMUCY2B4MCNYECWLHUH3AGH6MOGM4NS6KDAH5UA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035071280 (21h21m59.818411379s) [noise=true , address=212.102.52.217:4424 , piece_id=OHAYPIY666MWXWJTMWLPWTPE3RAXI6SG6NRFZRQS7VO4GKYCOECQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035492163 (21h21m59.818832272s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.036495778 (21h21m59.819835877s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.037130078 (21h21m59.820470177s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.040472716 (21h21m59.823812815s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.042158933 (21h21m59.825499032s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045074927 (21h21m59.828415026s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045309063 (21h21m59.828649162s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046163785 (21h21m59.829503874s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046705198 (21h21m59.830045297s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.062034446 (21h21m59.845374546s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070397062 (21h21m59.853737161s) [noise=true , address=212.102.52.213:4322 , piece_id=TW24WKT2HYX65MOG6ILC2GYJPHYS5VRAEKPWGNF3MMPVJYMAZPHQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070415798 (21h21m59.853755897s) [seg_pos={0 0}, upload=20458]: Satisfied cohort requirements after 16 pieces May 25 23:26:14.070581143 (21h21m59.853921242s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VK5hn1TRuMk5ZXTat7nmjx4kXZec3RDyQ89iQrrrRzVh2xPVF): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070588727 (21h21m59.853928826s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070817384 (21h21m59.854157483s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cCanaWd2hWD8vcQCophdGPopVihkjKSuUcB7ZyqqBcK1JTvSf): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070822854 (21h21m59.854162943s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070908688 (21h21m59.854248787s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070913157 (21h21m59.854253256s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071162232 (21h21m59.854502341s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.071169757 (21h21m59.854509866s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071187790 (21h21m59.854527889s) [seg_pos={0 0}, upload=20458]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 23:26:14.071292471 (21h21m59.85463257s) [upload=20458]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 23:26:14.071297069 (21h21m59.854637168s) [upload=20458]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 23:26:38.384275645 (21h22m24.167615734s) [upload=20458]: Done uploading segments... May 25 23:26:38.384290073 (21h22m24.167630172s) [upload=20458]: Upload finished. err: <nil> Duration: 5.142837059s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...............................................X............] duration: 4.308089374s trace: https://jaeger.dev.storj.io/trace/61118016982afaf6 FAIL (2026-05-25 23:58:58 UTC) orbiter warning: context deadline exceeded Duration: 4.308113821s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 4.465357486s trace: https://jaeger.dev.storj.io/trace/154f04129c3ba223 FAIL (2026-05-25 23:58:04 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== H5UA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.669978445 (21h21m58.453318544s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670570324 (21h21m58.453910423s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670977932 (21h21m58.454318031s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671082672 (21h21m58.454422771s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671399046 (21h21m58.454739145s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671505018 (21h21m58.454845117s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671768601 (21h21m58.4551087s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671873380 (21h21m58.455213479s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672172411 (21h21m58.45551251s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672225192 (21h21m58.455565291s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672604115 (21h21m58.455944214s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672647878 (21h21m58.455987977s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672979411 (21h21m58.45631951s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673026311 (21h21m58.45636641s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673319009 (21h21m58.456659108s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:13.747141337 (21h21m59.530481436s) [upload=20458]: Next returned nil segment May 25 23:26:13.747155513 (21h21m59.530495612s) [upload=20458]: Waiting for error group managing segments... May 25 23:26:14.031706029 (21h21m59.815046128s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034098815 (21h21m59.817438914s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034662339 (21h21m59.818002439s) [noise=true , address=212.102.52.214:4362 , piece_id=ZSAFYLTPN3ESF7KDM6RXVTPIHI2O5BJ77WJQXDRGXEIM5IUTEVMQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034708708 (21h21m59.818048807s) [noise=true , address=212.102.52.217:4419 , piece_id=3IAS5VH7QJ2SJOMUCY2B4MCNYECWLHUH3AGH6MOGM4NS6KDAH5UA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035071280 (21h21m59.818411379s) [noise=true , address=212.102.52.217:4424 , piece_id=OHAYPIY666MWXWJTMWLPWTPE3RAXI6SG6NRFZRQS7VO4GKYCOECQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035492163 (21h21m59.818832272s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.036495778 (21h21m59.819835877s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.037130078 (21h21m59.820470177s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.040472716 (21h21m59.823812815s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.042158933 (21h21m59.825499032s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045074927 (21h21m59.828415026s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045309063 (21h21m59.828649162s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046163785 (21h21m59.829503874s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046705198 (21h21m59.830045297s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.062034446 (21h21m59.845374546s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070397062 (21h21m59.853737161s) [noise=true , address=212.102.52.213:4322 , piece_id=TW24WKT2HYX65MOG6ILC2GYJPHYS5VRAEKPWGNF3MMPVJYMAZPHQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070415798 (21h21m59.853755897s) [seg_pos={0 0}, upload=20458]: Satisfied cohort requirements after 16 pieces May 25 23:26:14.070581143 (21h21m59.853921242s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VK5hn1TRuMk5ZXTat7nmjx4kXZec3RDyQ89iQrrrRzVh2xPVF): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070588727 (21h21m59.853928826s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070817384 (21h21m59.854157483s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cCanaWd2hWD8vcQCophdGPopVihkjKSuUcB7ZyqqBcK1JTvSf): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070822854 (21h21m59.854162943s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070908688 (21h21m59.854248787s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070913157 (21h21m59.854253256s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071162232 (21h21m59.854502341s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.071169757 (21h21m59.854509866s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071187790 (21h21m59.854527889s) [seg_pos={0 0}, upload=20458]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 23:26:14.071292471 (21h21m59.85463257s) [upload=20458]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 23:26:14.071297069 (21h21m59.854637168s) [upload=20458]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 23:26:38.384275645 (21h22m24.167615734s) [upload=20458]: Done uploading segments... May 25 23:26:38.384290073 (21h22m24.167630172s) [upload=20458]: Upload finished. err: <nil> Duration: 4.465381653s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [................................................X...........] duration: 4.043664496s trace: https://jaeger.dev.storj.io/trace/61118016982afaf6 FAIL (2026-05-25 23:57:46 UTC) orbiter warning: context deadline exceeded Duration: 4.043711555s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 4.043627745s trace: https://jaeger.dev.storj.io/trace/154f04129c3ba223 FAIL (2026-05-25 23:57:43 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== H5UA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.669978445 (21h21m58.453318544s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670570324 (21h21m58.453910423s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670977932 (21h21m58.454318031s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671082672 (21h21m58.454422771s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671399046 (21h21m58.454739145s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671505018 (21h21m58.454845117s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671768601 (21h21m58.4551087s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671873380 (21h21m58.455213479s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672172411 (21h21m58.45551251s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672225192 (21h21m58.455565291s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672604115 (21h21m58.455944214s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672647878 (21h21m58.455987977s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672979411 (21h21m58.45631951s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673026311 (21h21m58.45636641s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673319009 (21h21m58.456659108s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:13.747141337 (21h21m59.530481436s) [upload=20458]: Next returned nil segment May 25 23:26:13.747155513 (21h21m59.530495612s) [upload=20458]: Waiting for error group managing segments... May 25 23:26:14.031706029 (21h21m59.815046128s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034098815 (21h21m59.817438914s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034662339 (21h21m59.818002439s) [noise=true , address=212.102.52.214:4362 , piece_id=ZSAFYLTPN3ESF7KDM6RXVTPIHI2O5BJ77WJQXDRGXEIM5IUTEVMQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034708708 (21h21m59.818048807s) [noise=true , address=212.102.52.217:4419 , piece_id=3IAS5VH7QJ2SJOMUCY2B4MCNYECWLHUH3AGH6MOGM4NS6KDAH5UA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035071280 (21h21m59.818411379s) [noise=true , address=212.102.52.217:4424 , piece_id=OHAYPIY666MWXWJTMWLPWTPE3RAXI6SG6NRFZRQS7VO4GKYCOECQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035492163 (21h21m59.818832272s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.036495778 (21h21m59.819835877s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.037130078 (21h21m59.820470177s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.040472716 (21h21m59.823812815s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.042158933 (21h21m59.825499032s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045074927 (21h21m59.828415026s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045309063 (21h21m59.828649162s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046163785 (21h21m59.829503874s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046705198 (21h21m59.830045297s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.062034446 (21h21m59.845374546s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070397062 (21h21m59.853737161s) [noise=true , address=212.102.52.213:4322 , piece_id=TW24WKT2HYX65MOG6ILC2GYJPHYS5VRAEKPWGNF3MMPVJYMAZPHQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070415798 (21h21m59.853755897s) [seg_pos={0 0}, upload=20458]: Satisfied cohort requirements after 16 pieces May 25 23:26:14.070581143 (21h21m59.853921242s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VK5hn1TRuMk5ZXTat7nmjx4kXZec3RDyQ89iQrrrRzVh2xPVF): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070588727 (21h21m59.853928826s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070817384 (21h21m59.854157483s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cCanaWd2hWD8vcQCophdGPopVihkjKSuUcB7ZyqqBcK1JTvSf): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070822854 (21h21m59.854162943s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070908688 (21h21m59.854248787s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070913157 (21h21m59.854253256s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071162232 (21h21m59.854502341s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.071169757 (21h21m59.854509866s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071187790 (21h21m59.854527889s) [seg_pos={0 0}, upload=20458]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 23:26:14.071292471 (21h21m59.85463257s) [upload=20458]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 23:26:14.071297069 (21h21m59.854637168s) [upload=20458]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 23:26:38.384275645 (21h22m24.167615734s) [upload=20458]: Done uploading segments... May 25 23:26:38.384290073 (21h22m24.167630172s) [upload=20458]: Upload finished. err: <nil> Duration: 4.043641963s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [..X.XX....X..X.X....................X.X..XX.X...............] duration: 6.506849849s trace: https://jaeger.dev.storj.io/trace/20510f10ce4ee74b FAIL (2026-05-25 23:57:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.50687126s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 3.996045073s trace: https://jaeger.dev.storj.io/trace/154f04129c3ba223 FAIL (2026-05-25 23:56:50 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== H5UA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.669978445 (21h21m58.453318544s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670570324 (21h21m58.453910423s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670977932 (21h21m58.454318031s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671082672 (21h21m58.454422771s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671399046 (21h21m58.454739145s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671505018 (21h21m58.454845117s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671768601 (21h21m58.4551087s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671873380 (21h21m58.455213479s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672172411 (21h21m58.45551251s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672225192 (21h21m58.455565291s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672604115 (21h21m58.455944214s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672647878 (21h21m58.455987977s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672979411 (21h21m58.45631951s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673026311 (21h21m58.45636641s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673319009 (21h21m58.456659108s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:13.747141337 (21h21m59.530481436s) [upload=20458]: Next returned nil segment May 25 23:26:13.747155513 (21h21m59.530495612s) [upload=20458]: Waiting for error group managing segments... May 25 23:26:14.031706029 (21h21m59.815046128s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034098815 (21h21m59.817438914s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034662339 (21h21m59.818002439s) [noise=true , address=212.102.52.214:4362 , piece_id=ZSAFYLTPN3ESF7KDM6RXVTPIHI2O5BJ77WJQXDRGXEIM5IUTEVMQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034708708 (21h21m59.818048807s) [noise=true , address=212.102.52.217:4419 , piece_id=3IAS5VH7QJ2SJOMUCY2B4MCNYECWLHUH3AGH6MOGM4NS6KDAH5UA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035071280 (21h21m59.818411379s) [noise=true , address=212.102.52.217:4424 , piece_id=OHAYPIY666MWXWJTMWLPWTPE3RAXI6SG6NRFZRQS7VO4GKYCOECQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035492163 (21h21m59.818832272s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.036495778 (21h21m59.819835877s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.037130078 (21h21m59.820470177s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.040472716 (21h21m59.823812815s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.042158933 (21h21m59.825499032s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045074927 (21h21m59.828415026s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045309063 (21h21m59.828649162s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046163785 (21h21m59.829503874s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046705198 (21h21m59.830045297s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.062034446 (21h21m59.845374546s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070397062 (21h21m59.853737161s) [noise=true , address=212.102.52.213:4322 , piece_id=TW24WKT2HYX65MOG6ILC2GYJPHYS5VRAEKPWGNF3MMPVJYMAZPHQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070415798 (21h21m59.853755897s) [seg_pos={0 0}, upload=20458]: Satisfied cohort requirements after 16 pieces May 25 23:26:14.070581143 (21h21m59.853921242s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VK5hn1TRuMk5ZXTat7nmjx4kXZec3RDyQ89iQrrrRzVh2xPVF): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070588727 (21h21m59.853928826s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070817384 (21h21m59.854157483s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cCanaWd2hWD8vcQCophdGPopVihkjKSuUcB7ZyqqBcK1JTvSf): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070822854 (21h21m59.854162943s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070908688 (21h21m59.854248787s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070913157 (21h21m59.854253256s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071162232 (21h21m59.854502341s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.071169757 (21h21m59.854509866s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071187790 (21h21m59.854527889s) [seg_pos={0 0}, upload=20458]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 23:26:14.071292471 (21h21m59.85463257s) [upload=20458]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 23:26:14.071297069 (21h21m59.854637168s) [upload=20458]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 23:26:38.384275645 (21h22m24.167615734s) [upload=20458]: Done uploading segments... May 25 23:26:38.384290073 (21h22m24.167630172s) [upload=20458]: Upload finished. err: <nil> Duration: 3.996063588s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [...X.XX....X..X.X....................X.X..XX.X..............] duration: 6.419023721s trace: https://jaeger.dev.storj.io/trace/20510f10ce4ee74b FAIL (2026-05-25 23:56:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.419046414s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.................................................X..........] duration: 3.994151442s trace: https://jaeger.dev.storj.io/trace/61118016982afaf6 FAIL (2026-05-25 23:56:36 UTC) orbiter warning: context deadline exceeded Duration: 3.994176388s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 6.439457064s trace: https://jaeger.dev.storj.io/trace/154f04129c3ba223 FAIL (2026-05-25 23:56:29 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== H5UA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.669978445 (21h21m58.453318544s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670570324 (21h21m58.453910423s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670977932 (21h21m58.454318031s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671082672 (21h21m58.454422771s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671399046 (21h21m58.454739145s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671505018 (21h21m58.454845117s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671768601 (21h21m58.4551087s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671873380 (21h21m58.455213479s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672172411 (21h21m58.45551251s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672225192 (21h21m58.455565291s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672604115 (21h21m58.455944214s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672647878 (21h21m58.455987977s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672979411 (21h21m58.45631951s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673026311 (21h21m58.45636641s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673319009 (21h21m58.456659108s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:13.747141337 (21h21m59.530481436s) [upload=20458]: Next returned nil segment May 25 23:26:13.747155513 (21h21m59.530495612s) [upload=20458]: Waiting for error group managing segments... May 25 23:26:14.031706029 (21h21m59.815046128s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034098815 (21h21m59.817438914s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034662339 (21h21m59.818002439s) [noise=true , address=212.102.52.214:4362 , piece_id=ZSAFYLTPN3ESF7KDM6RXVTPIHI2O5BJ77WJQXDRGXEIM5IUTEVMQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034708708 (21h21m59.818048807s) [noise=true , address=212.102.52.217:4419 , piece_id=3IAS5VH7QJ2SJOMUCY2B4MCNYECWLHUH3AGH6MOGM4NS6KDAH5UA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035071280 (21h21m59.818411379s) [noise=true , address=212.102.52.217:4424 , piece_id=OHAYPIY666MWXWJTMWLPWTPE3RAXI6SG6NRFZRQS7VO4GKYCOECQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035492163 (21h21m59.818832272s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.036495778 (21h21m59.819835877s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.037130078 (21h21m59.820470177s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.040472716 (21h21m59.823812815s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.042158933 (21h21m59.825499032s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045074927 (21h21m59.828415026s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045309063 (21h21m59.828649162s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046163785 (21h21m59.829503874s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046705198 (21h21m59.830045297s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.062034446 (21h21m59.845374546s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070397062 (21h21m59.853737161s) [noise=true , address=212.102.52.213:4322 , piece_id=TW24WKT2HYX65MOG6ILC2GYJPHYS5VRAEKPWGNF3MMPVJYMAZPHQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070415798 (21h21m59.853755897s) [seg_pos={0 0}, upload=20458]: Satisfied cohort requirements after 16 pieces May 25 23:26:14.070581143 (21h21m59.853921242s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VK5hn1TRuMk5ZXTat7nmjx4kXZec3RDyQ89iQrrrRzVh2xPVF): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070588727 (21h21m59.853928826s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070817384 (21h21m59.854157483s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cCanaWd2hWD8vcQCophdGPopVihkjKSuUcB7ZyqqBcK1JTvSf): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070822854 (21h21m59.854162943s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070908688 (21h21m59.854248787s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070913157 (21h21m59.854253256s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071162232 (21h21m59.854502341s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.071169757 (21h21m59.854509866s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071187790 (21h21m59.854527889s) [seg_pos={0 0}, upload=20458]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 23:26:14.071292471 (21h21m59.85463257s) [upload=20458]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 23:26:14.071297069 (21h21m59.854637168s) [upload=20458]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 23:26:38.384275645 (21h22m24.167615734s) [upload=20458]: Done uploading segments... May 25 23:26:38.384290073 (21h22m24.167630172s) [upload=20458]: Upload finished. err: <nil> Duration: 6.439480009s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..................................................X.........] duration: 3.693088546s trace: https://jaeger.dev.storj.io/trace/61118016982afaf6 FAIL (2026-05-25 23:56:17 UTC) orbiter warning: context deadline exceeded Duration: 3.693110888s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [....X.XX....X..X.X....................X.X..XX.X.............] duration: 6.659804276s trace: https://jaeger.dev.storj.io/trace/20510f10ce4ee74b FAIL (2026-05-25 23:56:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.65982152s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...................................................X........] duration: 3.655697597s trace: https://jaeger.dev.storj.io/trace/61118016982afaf6 FAIL (2026-05-25 23:55:41 UTC) orbiter warning: context deadline exceeded Duration: 3.655743715s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 3.989949925s trace: https://jaeger.dev.storj.io/trace/154f04129c3ba223 FAIL (2026-05-25 23:55:39 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== H5UA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.669978445 (21h21m58.453318544s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670570324 (21h21m58.453910423s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670977932 (21h21m58.454318031s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671082672 (21h21m58.454422771s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671399046 (21h21m58.454739145s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671505018 (21h21m58.454845117s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671768601 (21h21m58.4551087s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671873380 (21h21m58.455213479s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672172411 (21h21m58.45551251s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672225192 (21h21m58.455565291s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672604115 (21h21m58.455944214s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672647878 (21h21m58.455987977s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672979411 (21h21m58.45631951s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673026311 (21h21m58.45636641s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673319009 (21h21m58.456659108s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:13.747141337 (21h21m59.530481436s) [upload=20458]: Next returned nil segment May 25 23:26:13.747155513 (21h21m59.530495612s) [upload=20458]: Waiting for error group managing segments... May 25 23:26:14.031706029 (21h21m59.815046128s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034098815 (21h21m59.817438914s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034662339 (21h21m59.818002439s) [noise=true , address=212.102.52.214:4362 , piece_id=ZSAFYLTPN3ESF7KDM6RXVTPIHI2O5BJ77WJQXDRGXEIM5IUTEVMQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034708708 (21h21m59.818048807s) [noise=true , address=212.102.52.217:4419 , piece_id=3IAS5VH7QJ2SJOMUCY2B4MCNYECWLHUH3AGH6MOGM4NS6KDAH5UA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035071280 (21h21m59.818411379s) [noise=true , address=212.102.52.217:4424 , piece_id=OHAYPIY666MWXWJTMWLPWTPE3RAXI6SG6NRFZRQS7VO4GKYCOECQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035492163 (21h21m59.818832272s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.036495778 (21h21m59.819835877s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.037130078 (21h21m59.820470177s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.040472716 (21h21m59.823812815s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.042158933 (21h21m59.825499032s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045074927 (21h21m59.828415026s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045309063 (21h21m59.828649162s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046163785 (21h21m59.829503874s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046705198 (21h21m59.830045297s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.062034446 (21h21m59.845374546s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070397062 (21h21m59.853737161s) [noise=true , address=212.102.52.213:4322 , piece_id=TW24WKT2HYX65MOG6ILC2GYJPHYS5VRAEKPWGNF3MMPVJYMAZPHQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070415798 (21h21m59.853755897s) [seg_pos={0 0}, upload=20458]: Satisfied cohort requirements after 16 pieces May 25 23:26:14.070581143 (21h21m59.853921242s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VK5hn1TRuMk5ZXTat7nmjx4kXZec3RDyQ89iQrrrRzVh2xPVF): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070588727 (21h21m59.853928826s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070817384 (21h21m59.854157483s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cCanaWd2hWD8vcQCophdGPopVihkjKSuUcB7ZyqqBcK1JTvSf): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070822854 (21h21m59.854162943s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070908688 (21h21m59.854248787s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070913157 (21h21m59.854253256s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071162232 (21h21m59.854502341s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.071169757 (21h21m59.854509866s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071187790 (21h21m59.854527889s) [seg_pos={0 0}, upload=20458]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 23:26:14.071292471 (21h21m59.85463257s) [upload=20458]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 23:26:14.071297069 (21h21m59.854637168s) [upload=20458]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 23:26:38.384275645 (21h22m24.167615734s) [upload=20458]: Done uploading segments... May 25 23:26:38.384290073 (21h22m24.167630172s) [upload=20458]: Upload finished. err: <nil> Duration: 3.989970524s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [.....X.XX....X..X.X....................X.X..XX.X............] duration: 6.448908547s trace: https://jaeger.dev.storj.io/trace/20510f10ce4ee74b FAIL (2026-05-25 23:55:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.448928424s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.667656564s trace: https://jaeger.dev.storj.io/trace/154f04129c3ba223 FAIL (2026-05-25 23:55:16 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== H5UA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.669978445 (21h21m58.453318544s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670570324 (21h21m58.453910423s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670977932 (21h21m58.454318031s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671082672 (21h21m58.454422771s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671399046 (21h21m58.454739145s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671505018 (21h21m58.454845117s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671768601 (21h21m58.4551087s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671873380 (21h21m58.455213479s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672172411 (21h21m58.45551251s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672225192 (21h21m58.455565291s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672604115 (21h21m58.455944214s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672647878 (21h21m58.455987977s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672979411 (21h21m58.45631951s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673026311 (21h21m58.45636641s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673319009 (21h21m58.456659108s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:13.747141337 (21h21m59.530481436s) [upload=20458]: Next returned nil segment May 25 23:26:13.747155513 (21h21m59.530495612s) [upload=20458]: Waiting for error group managing segments... May 25 23:26:14.031706029 (21h21m59.815046128s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034098815 (21h21m59.817438914s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034662339 (21h21m59.818002439s) [noise=true , address=212.102.52.214:4362 , piece_id=ZSAFYLTPN3ESF7KDM6RXVTPIHI2O5BJ77WJQXDRGXEIM5IUTEVMQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034708708 (21h21m59.818048807s) [noise=true , address=212.102.52.217:4419 , piece_id=3IAS5VH7QJ2SJOMUCY2B4MCNYECWLHUH3AGH6MOGM4NS6KDAH5UA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035071280 (21h21m59.818411379s) [noise=true , address=212.102.52.217:4424 , piece_id=OHAYPIY666MWXWJTMWLPWTPE3RAXI6SG6NRFZRQS7VO4GKYCOECQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035492163 (21h21m59.818832272s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.036495778 (21h21m59.819835877s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.037130078 (21h21m59.820470177s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.040472716 (21h21m59.823812815s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.042158933 (21h21m59.825499032s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045074927 (21h21m59.828415026s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045309063 (21h21m59.828649162s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046163785 (21h21m59.829503874s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046705198 (21h21m59.830045297s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.062034446 (21h21m59.845374546s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070397062 (21h21m59.853737161s) [noise=true , address=212.102.52.213:4322 , piece_id=TW24WKT2HYX65MOG6ILC2GYJPHYS5VRAEKPWGNF3MMPVJYMAZPHQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070415798 (21h21m59.853755897s) [seg_pos={0 0}, upload=20458]: Satisfied cohort requirements after 16 pieces May 25 23:26:14.070581143 (21h21m59.853921242s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VK5hn1TRuMk5ZXTat7nmjx4kXZec3RDyQ89iQrrrRzVh2xPVF): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070588727 (21h21m59.853928826s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070817384 (21h21m59.854157483s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cCanaWd2hWD8vcQCophdGPopVihkjKSuUcB7ZyqqBcK1JTvSf): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070822854 (21h21m59.854162943s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070908688 (21h21m59.854248787s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070913157 (21h21m59.854253256s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071162232 (21h21m59.854502341s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.071169757 (21h21m59.854509866s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071187790 (21h21m59.854527889s) [seg_pos={0 0}, upload=20458]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 23:26:14.071292471 (21h21m59.85463257s) [upload=20458]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 23:26:14.071297069 (21h21m59.854637168s) [upload=20458]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 23:26:38.384275645 (21h22m24.167615734s) [upload=20458]: Done uploading segments... May 25 23:26:38.384290073 (21h22m24.167630172s) [upload=20458]: Upload finished. err: <nil> Duration: 5.667685881s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....................................................X.......] duration: 3.636151017s trace: https://jaeger.dev.storj.io/trace/61118016982afaf6 FAIL (2026-05-25 23:55:03 UTC) orbiter warning: context deadline exceeded Duration: 3.636222252s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....................................................X......] duration: 3.683418434s trace: https://jaeger.dev.storj.io/trace/61118016982afaf6 FAIL (2026-05-25 23:54:38 UTC) orbiter warning: context deadline exceeded Duration: 3.683439885s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [......X.XX....X..X.X....................X.X..XX.X...........] duration: 6.529296203s trace: https://jaeger.dev.storj.io/trace/20510f10ce4ee74b FAIL (2026-05-25 23:54:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.529319339s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......................................................X.....] duration: 3.864578835s trace: https://jaeger.dev.storj.io/trace/61118016982afaf6 FAIL (2026-05-25 23:54:18 UTC) orbiter warning: context deadline exceeded Duration: 3.86459717s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 4.058586672s trace: https://jaeger.dev.storj.io/trace/154f04129c3ba223 FAIL (2026-05-25 23:54:17 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== H5UA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.669978445 (21h21m58.453318544s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670570324 (21h21m58.453910423s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670977932 (21h21m58.454318031s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671082672 (21h21m58.454422771s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671399046 (21h21m58.454739145s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671505018 (21h21m58.454845117s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671768601 (21h21m58.4551087s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671873380 (21h21m58.455213479s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672172411 (21h21m58.45551251s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672225192 (21h21m58.455565291s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672604115 (21h21m58.455944214s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672647878 (21h21m58.455987977s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672979411 (21h21m58.45631951s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673026311 (21h21m58.45636641s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673319009 (21h21m58.456659108s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:13.747141337 (21h21m59.530481436s) [upload=20458]: Next returned nil segment May 25 23:26:13.747155513 (21h21m59.530495612s) [upload=20458]: Waiting for error group managing segments... May 25 23:26:14.031706029 (21h21m59.815046128s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034098815 (21h21m59.817438914s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034662339 (21h21m59.818002439s) [noise=true , address=212.102.52.214:4362 , piece_id=ZSAFYLTPN3ESF7KDM6RXVTPIHI2O5BJ77WJQXDRGXEIM5IUTEVMQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034708708 (21h21m59.818048807s) [noise=true , address=212.102.52.217:4419 , piece_id=3IAS5VH7QJ2SJOMUCY2B4MCNYECWLHUH3AGH6MOGM4NS6KDAH5UA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035071280 (21h21m59.818411379s) [noise=true , address=212.102.52.217:4424 , piece_id=OHAYPIY666MWXWJTMWLPWTPE3RAXI6SG6NRFZRQS7VO4GKYCOECQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035492163 (21h21m59.818832272s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.036495778 (21h21m59.819835877s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.037130078 (21h21m59.820470177s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.040472716 (21h21m59.823812815s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.042158933 (21h21m59.825499032s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045074927 (21h21m59.828415026s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045309063 (21h21m59.828649162s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046163785 (21h21m59.829503874s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046705198 (21h21m59.830045297s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.062034446 (21h21m59.845374546s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070397062 (21h21m59.853737161s) [noise=true , address=212.102.52.213:4322 , piece_id=TW24WKT2HYX65MOG6ILC2GYJPHYS5VRAEKPWGNF3MMPVJYMAZPHQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070415798 (21h21m59.853755897s) [seg_pos={0 0}, upload=20458]: Satisfied cohort requirements after 16 pieces May 25 23:26:14.070581143 (21h21m59.853921242s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VK5hn1TRuMk5ZXTat7nmjx4kXZec3RDyQ89iQrrrRzVh2xPVF): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070588727 (21h21m59.853928826s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070817384 (21h21m59.854157483s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cCanaWd2hWD8vcQCophdGPopVihkjKSuUcB7ZyqqBcK1JTvSf): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070822854 (21h21m59.854162943s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070908688 (21h21m59.854248787s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070913157 (21h21m59.854253256s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071162232 (21h21m59.854502341s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.071169757 (21h21m59.854509866s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071187790 (21h21m59.854527889s) [seg_pos={0 0}, upload=20458]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 23:26:14.071292471 (21h21m59.85463257s) [upload=20458]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 23:26:14.071297069 (21h21m59.854637168s) [upload=20458]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 23:26:38.384275645 (21h22m24.167615734s) [upload=20458]: Done uploading segments... May 25 23:26:38.384290073 (21h22m24.167630172s) [upload=20458]: Upload finished. err: <nil> Duration: 4.058615087s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [.......X.XX....X..X.X....................X.X..XX.X..........] duration: 6.546705521s trace: https://jaeger.dev.storj.io/trace/20510f10ce4ee74b FAIL (2026-05-25 23:54:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.546719107s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......................................................X....] duration: 3.943648089s trace: https://jaeger.dev.storj.io/trace/61118016982afaf6 FAIL (2026-05-25 23:53:47 UTC) orbiter warning: context deadline exceeded Duration: 3.943665743s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [........X.XX....X..X.X....................X.X..XX.X.........] duration: 6.672505298s trace: https://jaeger.dev.storj.io/trace/20510f10ce4ee74b FAIL (2026-05-25 23:53:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.672524636s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 4.063580147s trace: https://jaeger.dev.storj.io/trace/154f04129c3ba223 FAIL (2026-05-25 23:53:18 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== H5UA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.669978445 (21h21m58.453318544s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670570324 (21h21m58.453910423s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670977932 (21h21m58.454318031s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671082672 (21h21m58.454422771s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671399046 (21h21m58.454739145s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671505018 (21h21m58.454845117s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671768601 (21h21m58.4551087s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671873380 (21h21m58.455213479s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672172411 (21h21m58.45551251s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672225192 (21h21m58.455565291s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672604115 (21h21m58.455944214s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672647878 (21h21m58.455987977s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672979411 (21h21m58.45631951s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673026311 (21h21m58.45636641s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673319009 (21h21m58.456659108s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:13.747141337 (21h21m59.530481436s) [upload=20458]: Next returned nil segment May 25 23:26:13.747155513 (21h21m59.530495612s) [upload=20458]: Waiting for error group managing segments... May 25 23:26:14.031706029 (21h21m59.815046128s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034098815 (21h21m59.817438914s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034662339 (21h21m59.818002439s) [noise=true , address=212.102.52.214:4362 , piece_id=ZSAFYLTPN3ESF7KDM6RXVTPIHI2O5BJ77WJQXDRGXEIM5IUTEVMQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034708708 (21h21m59.818048807s) [noise=true , address=212.102.52.217:4419 , piece_id=3IAS5VH7QJ2SJOMUCY2B4MCNYECWLHUH3AGH6MOGM4NS6KDAH5UA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035071280 (21h21m59.818411379s) [noise=true , address=212.102.52.217:4424 , piece_id=OHAYPIY666MWXWJTMWLPWTPE3RAXI6SG6NRFZRQS7VO4GKYCOECQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035492163 (21h21m59.818832272s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.036495778 (21h21m59.819835877s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.037130078 (21h21m59.820470177s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.040472716 (21h21m59.823812815s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.042158933 (21h21m59.825499032s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045074927 (21h21m59.828415026s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045309063 (21h21m59.828649162s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046163785 (21h21m59.829503874s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046705198 (21h21m59.830045297s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.062034446 (21h21m59.845374546s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070397062 (21h21m59.853737161s) [noise=true , address=212.102.52.213:4322 , piece_id=TW24WKT2HYX65MOG6ILC2GYJPHYS5VRAEKPWGNF3MMPVJYMAZPHQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070415798 (21h21m59.853755897s) [seg_pos={0 0}, upload=20458]: Satisfied cohort requirements after 16 pieces May 25 23:26:14.070581143 (21h21m59.853921242s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VK5hn1TRuMk5ZXTat7nmjx4kXZec3RDyQ89iQrrrRzVh2xPVF): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070588727 (21h21m59.853928826s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070817384 (21h21m59.854157483s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cCanaWd2hWD8vcQCophdGPopVihkjKSuUcB7ZyqqBcK1JTvSf): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070822854 (21h21m59.854162943s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070908688 (21h21m59.854248787s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070913157 (21h21m59.854253256s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071162232 (21h21m59.854502341s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.071169757 (21h21m59.854509866s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071187790 (21h21m59.854527889s) [seg_pos={0 0}, upload=20458]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 23:26:14.071292471 (21h21m59.85463257s) [upload=20458]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 23:26:14.071297069 (21h21m59.854637168s) [upload=20458]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 23:26:38.384275645 (21h22m24.167615734s) [upload=20458]: Done uploading segments... May 25 23:26:38.384290073 (21h22m24.167630172s) [upload=20458]: Upload finished. err: <nil> Duration: 4.06360807s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........................................................X...] duration: 3.698376841s trace: https://jaeger.dev.storj.io/trace/61118016982afaf6 FAIL (2026-05-25 23:52:52 UTC) orbiter warning: context deadline exceeded Duration: 3.698415676s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 4.051658631s trace: https://jaeger.dev.storj.io/trace/154f04129c3ba223 FAIL (2026-05-25 23:52:41 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== H5UA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.669978445 (21h21m58.453318544s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670570324 (21h21m58.453910423s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670977932 (21h21m58.454318031s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671082672 (21h21m58.454422771s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671399046 (21h21m58.454739145s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671505018 (21h21m58.454845117s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671768601 (21h21m58.4551087s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671873380 (21h21m58.455213479s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672172411 (21h21m58.45551251s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672225192 (21h21m58.455565291s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672604115 (21h21m58.455944214s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672647878 (21h21m58.455987977s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672979411 (21h21m58.45631951s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673026311 (21h21m58.45636641s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673319009 (21h21m58.456659108s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:13.747141337 (21h21m59.530481436s) [upload=20458]: Next returned nil segment May 25 23:26:13.747155513 (21h21m59.530495612s) [upload=20458]: Waiting for error group managing segments... May 25 23:26:14.031706029 (21h21m59.815046128s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034098815 (21h21m59.817438914s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034662339 (21h21m59.818002439s) [noise=true , address=212.102.52.214:4362 , piece_id=ZSAFYLTPN3ESF7KDM6RXVTPIHI2O5BJ77WJQXDRGXEIM5IUTEVMQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034708708 (21h21m59.818048807s) [noise=true , address=212.102.52.217:4419 , piece_id=3IAS5VH7QJ2SJOMUCY2B4MCNYECWLHUH3AGH6MOGM4NS6KDAH5UA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035071280 (21h21m59.818411379s) [noise=true , address=212.102.52.217:4424 , piece_id=OHAYPIY666MWXWJTMWLPWTPE3RAXI6SG6NRFZRQS7VO4GKYCOECQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035492163 (21h21m59.818832272s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.036495778 (21h21m59.819835877s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.037130078 (21h21m59.820470177s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.040472716 (21h21m59.823812815s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.042158933 (21h21m59.825499032s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045074927 (21h21m59.828415026s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045309063 (21h21m59.828649162s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046163785 (21h21m59.829503874s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046705198 (21h21m59.830045297s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.062034446 (21h21m59.845374546s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070397062 (21h21m59.853737161s) [noise=true , address=212.102.52.213:4322 , piece_id=TW24WKT2HYX65MOG6ILC2GYJPHYS5VRAEKPWGNF3MMPVJYMAZPHQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070415798 (21h21m59.853755897s) [seg_pos={0 0}, upload=20458]: Satisfied cohort requirements after 16 pieces May 25 23:26:14.070581143 (21h21m59.853921242s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VK5hn1TRuMk5ZXTat7nmjx4kXZec3RDyQ89iQrrrRzVh2xPVF): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070588727 (21h21m59.853928826s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070817384 (21h21m59.854157483s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cCanaWd2hWD8vcQCophdGPopVihkjKSuUcB7ZyqqBcK1JTvSf): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070822854 (21h21m59.854162943s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070908688 (21h21m59.854248787s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070913157 (21h21m59.854253256s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071162232 (21h21m59.854502341s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.071169757 (21h21m59.854509866s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071187790 (21h21m59.854527889s) [seg_pos={0 0}, upload=20458]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 23:26:14.071292471 (21h21m59.85463257s) [upload=20458]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 23:26:14.071297069 (21h21m59.854637168s) [upload=20458]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 23:26:38.384275645 (21h22m24.167615734s) [upload=20458]: Done uploading segments... May 25 23:26:38.384290073 (21h22m24.167630172s) [upload=20458]: Upload finished. err: <nil> Duration: 4.051692714s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [.........X.XX....X..X.X....................X.X..XX.X........] duration: 6.838336787s trace: https://jaeger.dev.storj.io/trace/20510f10ce4ee74b FAIL (2026-05-25 23:52:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.838346175s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 12 out of 60 is failed (threshold=3) [X.........X.XX....X..X.X....................X.X..XX.X.......] duration: 46.241659498s trace: https://jaeger.dev.storj.io/trace/20510f10ce4ee74b FAIL (2026-05-25 23:52:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 46.241679976s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........................................................X..] duration: 4.856162188s trace: https://jaeger.dev.storj.io/trace/61118016982afaf6 FAIL (2026-05-25 23:52:29 UTC) orbiter warning: context deadline exceeded Duration: 4.856185482s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 3.977922224s trace: https://jaeger.dev.storj.io/trace/154f04129c3ba223 FAIL (2026-05-25 23:52:16 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== H5UA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.669978445 (21h21m58.453318544s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670570324 (21h21m58.453910423s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.670977932 (21h21m58.454318031s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671082672 (21h21m58.454422771s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671399046 (21h21m58.454739145s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671505018 (21h21m58.454845117s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671768601 (21h21m58.4551087s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.671873380 (21h21m58.455213479s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672172411 (21h21m58.45551251s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672225192 (21h21m58.455565291s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672604115 (21h21m58.455944214s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672647878 (21h21m58.455987977s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.672979411 (21h21m58.45631951s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673026311 (21h21m58.45636641s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:12.673319009 (21h21m58.456659108s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Uploading piece... May 25 23:26:13.747141337 (21h21m59.530481436s) [upload=20458]: Next returned nil segment May 25 23:26:13.747155513 (21h21m59.530495612s) [upload=20458]: Waiting for error group managing segments... May 25 23:26:14.031706029 (21h21m59.815046128s) [noise=true , address=212.102.52.213:4334 , piece_id=TMEOBZ5ZZQRVYSI2MX47UN3WZCXPTNO466DTWCN4FELUUN2VEYDA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034098815 (21h21m59.817438914s) [noise=true , address=212.102.52.216:4409 , piece_id=D65YC4OFDAUR2PRJHXPJNML7HI6XO3RURGIHDHZUF5KS5QTJO2TQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034662339 (21h21m59.818002439s) [noise=true , address=212.102.52.214:4362 , piece_id=ZSAFYLTPN3ESF7KDM6RXVTPIHI2O5BJ77WJQXDRGXEIM5IUTEVMQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.034708708 (21h21m59.818048807s) [noise=true , address=212.102.52.217:4419 , piece_id=3IAS5VH7QJ2SJOMUCY2B4MCNYECWLHUH3AGH6MOGM4NS6KDAH5UA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035071280 (21h21m59.818411379s) [noise=true , address=212.102.52.217:4424 , piece_id=OHAYPIY666MWXWJTMWLPWTPE3RAXI6SG6NRFZRQS7VO4GKYCOECQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.035492163 (21h21m59.818832272s) [noise=true , address=212.102.52.217:4435 , piece_id=52SDHCU6EYU7XE5P26JBEBD3WDBZJS2K7T4UEITQY76LYQ7CWOFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.036495778 (21h21m59.819835877s) [noise=true , address=212.102.52.215:4369 , piece_id=7U5BJDB4RNP2VJWT5LMMI37B2FARBL6FB4TNTQ4BYCHOJ6XPNILA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.037130078 (21h21m59.820470177s) [noise=true , address=212.102.52.214:4353 , piece_id=PGJXAO27LI563LSACTWLNGDDTLWPF2KOKSF6YBZY7YGPMD7C66IQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.040472716 (21h21m59.823812815s) [noise=true , address=212.102.52.216:4396 , piece_id=MM46S6QCH6X7LEUCBZWF3LM4C7C45WV6OEUY5CVVJ7QPTJJMC4VA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.042158933 (21h21m59.825499032s) [noise=true , address=212.102.52.214:4365 , piece_id=WLGBUXLDUT2BVURAHW7EN3ZBRE7AAAE3NO4LHWGT2DPUUYXR5M5Q, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045074927 (21h21m59.828415026s) [noise=true , address=212.102.52.217:4439 , piece_id=SI3MH3CMRPJOJVUGU2KZBW6LTE7OBTGM5QZ6NG5J77DOXBJYLDHA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.045309063 (21h21m59.828649162s) [noise=true , address=212.102.52.215:4384 , piece_id=OIWVKV3EPC5OTSU36PSFDMKIBUM63VL3ILYIJUNC6VIK4BBP4IMA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046163785 (21h21m59.829503874s) [noise=true , address=212.102.52.214:4346 , piece_id=2LVJNXGQ27JYREAYEHZOAOJCJMZ4P7Q3OHVJ6SMR2BPXTZW25UCQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.046705198 (21h21m59.830045297s) [noise=true , address=212.102.52.213:4328 , piece_id=BJMKGMFRF7TC3UJDBYPDGQRR2I5T23XQIHZIESYTTRYNAYCYXNVA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.062034446 (21h21m59.845374546s) [noise=true , address=212.102.52.213:4343 , piece_id=IUD6WGNSWDSRXWNS5UBGQA7AS4EQO5M2V4C7WXNEHMJVKOZADU3A, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070397062 (21h21m59.853737161s) [noise=true , address=212.102.52.213:4322 , piece_id=TW24WKT2HYX65MOG6ILC2GYJPHYS5VRAEKPWGNF3MMPVJYMAZPHQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: <nil> May 25 23:26:14.070415798 (21h21m59.853755897s) [seg_pos={0 0}, upload=20458]: Satisfied cohort requirements after 16 pieces May 25 23:26:14.070581143 (21h21m59.853921242s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VK5hn1TRuMk5ZXTat7nmjx4kXZec3RDyQ89iQrrrRzVh2xPVF): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070588727 (21h21m59.853928826s) [noise=true , address=212.102.52.215:4388 , piece_id=34VBVPZJSEKHER4HKH4X4TESNLCPDWNBP6GH4ICDSDWHBAEX3AEQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070817384 (21h21m59.854157483s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cCanaWd2hWD8vcQCophdGPopVihkjKSuUcB7ZyqqBcK1JTvSf): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070822854 (21h21m59.854162943s) [noise=true , address=212.102.52.216:4411 , piece_id=PAKM6TQQJ2A5M2PO5REFGZ4EVXTK67QXCANGMCVADZKRPC6VHBFQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.070908688 (21h21m59.854248787s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.070913157 (21h21m59.854253256s) [noise=true , address=212.102.52.216:4397 , piece_id=RERO53Z3UUNEKZ47V7VN7SSU3LR5OFVEOFFSEZDYKL7NECDBHYWQ, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071162232 (21h21m59.854502341s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 25 23:26:14.071169757 (21h21m59.854509866s) [noise=true , address=212.102.52.215:4378 , piece_id=76YH63TUZZXDVYCO3VZAWO4WTBBAEXV4V2F53TYJWGP6AGOESNQA, seg_pos={0 0}, upload=20458]: Long tail cancellation due to optimal threshold May 25 23:26:14.071187790 (21h21m59.854527889s) [seg_pos={0 0}, upload=20458]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 23:26:14.071292471 (21h21m59.85463257s) [upload=20458]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 23:26:14.071297069 (21h21m59.854637168s) [upload=20458]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 23:26:38.384275645 (21h22m24.167615734s) [upload=20458]: Done uploading segments... May 25 23:26:38.384290073 (21h22m24.167630172s) [upload=20458]: Upload finished. err: <nil> Duration: 3.977943924s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........................................................X.] duration: 3.707574028s trace: https://jaeger.dev.storj.io/trace/61118016982afaf6 FAIL (2026-05-25 23:52:00 UTC) orbiter warning: context deadline exceeded Duration: 3.707601281s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)