Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..X.........................................................] duration: 3.711368043s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:23:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.711388612s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...X........................................................] duration: 3.679854364s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:22:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.679864642s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 6 out of 60 is failed (threshold=3) [......X..............X...X....X.........X.......X...........] duration: 3.997428266s trace: https://jaeger.dev.storj.io/trace/1321cf158342be9d FAIL (2026-05-26 10:22:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== XCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427018428 (32h8m41.210358527s) [noise=true , address=212.102.52.213:4334 , piece_id=ZWXHBNCMW7MEFYRM6SXFRKG2GIBZ5ZFLM2SWVDB7MEC6VO5KOCNQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427311697 (32h8m41.210651797s) [noise=true , address=212.102.52.217:4418 , piece_id=MSRUBKKWVUA5TO3T6K3ZXZRVOAXXI2SV7NG745HGWRZCYJZPQE4A, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427732831 (32h8m41.21107293s) [noise=true , address=212.102.52.216:4405 , piece_id=PFKQTBP6RN4YR4QYDEQQ3NQZQR5OPGWZJC73RBMMMQEXX54XSOBQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.428258494 (32h8m41.211598594s) [noise=true , address=212.102.52.216:4400 , piece_id=Z6K5X5RXBACRU5XSF7HGGKSU36RKXRIW2ZKCRISS3BA4G263TRQQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.429342422 (32h8m41.212682521s) [noise=true , address=212.102.52.214:4361 , piece_id=25CKSDWDXDQJMSLFBKA325YMHZIGDCI3MTVELOLHX2WDODTZ4G4Q, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.429548004 (32h8m41.212888103s) [noise=true , address=212.102.52.215:4387 , piece_id=KS33ZTOBOV44QBFP7PA2YFB233WUSPTHTSXVUPX7IX4MDPJQWRTQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.430337871 (32h8m41.21367797s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.430838096 (32h8m41.214178195s) [noise=true , address=212.102.52.215:4370 , piece_id=G4KPC43PMM4KBBYPINQ6LNJFP3NTB64EOULKDLNHZWNRUSHWN6LA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.431382174 (32h8m41.214722273s) [noise=true , address=212.102.52.216:4401 , piece_id=VYX7MEZWRAY5QIR77P5DB747OGZ3WARGQGXI6Q35M5SEQ4OAILYA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.432365170 (32h8m41.215705269s) [noise=true , address=212.102.52.214:4356 , piece_id=EQRJBTEKQE53XRWUB5UCBJWMI5TI5CHI76VS7ESVDU6ENYNJNNOQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.435150415 (32h8m41.218490514s) [noise=true , address=212.102.52.215:4381 , piece_id=2YAZGZDGQJJV6E24Y44RJXAIAZ3RMISLRX6O43LCIMLZCG3CM6UQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.437499377 (32h8m41.220839466s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.439247412 (32h8m41.222587511s) [noise=true , address=212.102.52.217:4419 , piece_id=PFWQMUXSAX6C7YUJUGEYBGWDUTBTQC7F7KPL2ZNJE24ZR63KG2RQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.440309829 (32h8m41.223649928s) [noise=true , address=212.102.52.217:4439 , piece_id=V236RZC26VCPLCY5Q7TTMA6R2PRT4CER6VTTFMIDQSFSEVWTW2IA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.440619900 (32h8m41.22396s) [noise=true , address=212.102.52.217:4433 , piece_id=67DJP7FXERAPOUDXCYSWUMGN4T6THOPCVGXUELTP7FTWLKCBVRHA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:56.505315534 (32h8m42.288655633s) [upload=30773]: Next returned nil segment May 26 10:12:56.505326887 (32h8m42.288666976s) [upload=30773]: Waiting for error group managing segments... May 26 10:12:56.786132791 (32h8m42.56947289s) [noise=true , address=212.102.52.217:4418 , piece_id=MSRUBKKWVUA5TO3T6K3ZXZRVOAXXI2SV7NG745HGWRZCYJZPQE4A, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.793687145 (32h8m42.577027244s) [noise=true , address=212.102.52.217:4419 , piece_id=PFWQMUXSAX6C7YUJUGEYBGWDUTBTQC7F7KPL2ZNJE24ZR63KG2RQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.794583265 (32h8m42.577923354s) [noise=true , address=212.102.52.217:4439 , piece_id=V236RZC26VCPLCY5Q7TTMA6R2PRT4CER6VTTFMIDQSFSEVWTW2IA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795374805 (32h8m42.578714934s) [noise=true , address=212.102.52.213:4329 , piece_id=VCE7AJFHTXECGW6IQ3T4XMCISQVDRM7KVXDIJJFUNFQTTFBO6NIQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795566350 (32h8m42.57890645s) [noise=true , address=212.102.52.213:4332 , piece_id=ZS2NROQDSVY52Q5EETXC2C7LQOSG35KDZO5IRZUX6ZSEYKSHYTFQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795768947 (32h8m42.579109046s) [noise=true , address=212.102.52.213:4333 , piece_id=7FHEGSQNAV7WU3LZSQ24CWD7NXOLPI7H5MHDDX5FJFIJZLTQEFSQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.796537273 (32h8m42.579877362s) [noise=true , address=212.102.52.213:4334 , piece_id=ZWXHBNCMW7MEFYRM6SXFRKG2GIBZ5ZFLM2SWVDB7MEC6VO5KOCNQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.797374871 (32h8m42.58071497s) [noise=true , address=212.102.52.215:4370 , piece_id=G4KPC43PMM4KBBYPINQ6LNJFP3NTB64EOULKDLNHZWNRUSHWN6LA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.797853234 (32h8m42.581193333s) [noise=true , address=212.102.52.217:4433 , piece_id=67DJP7FXERAPOUDXCYSWUMGN4T6THOPCVGXUELTP7FTWLKCBVRHA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.800043733 (32h8m42.583383832s) [noise=true , address=212.102.52.215:4381 , piece_id=2YAZGZDGQJJV6E24Y44RJXAIAZ3RMISLRX6O43LCIMLZCG3CM6UQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.802311351 (32h8m42.58565144s) [noise=true , address=212.102.52.215:4387 , piece_id=KS33ZTOBOV44QBFP7PA2YFB233WUSPTHTSXVUPX7IX4MDPJQWRTQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.803925611 (32h8m42.58726571s) [noise=true , address=212.102.52.216:4405 , piece_id=PFKQTBP6RN4YR4QYDEQQ3NQZQR5OPGWZJC73RBMMMQEXX54XSOBQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.809985033 (32h8m42.593325132s) [noise=true , address=212.102.52.214:4361 , piece_id=25CKSDWDXDQJMSLFBKA325YMHZIGDCI3MTVELOLHX2WDODTZ4G4Q, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.813255723 (32h8m42.596595822s) [noise=true , address=212.102.52.216:4400 , piece_id=Z6K5X5RXBACRU5XSF7HGGKSU36RKXRIW2ZKCRISS3BA4G263TRQQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814265039 (32h8m42.597605138s) [noise=true , address=212.102.52.216:4401 , piece_id=VYX7MEZWRAY5QIR77P5DB747OGZ3WARGQGXI6Q35M5SEQ4OAILYA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814932904 (32h8m42.598273023s) [noise=true , address=212.102.52.214:4356 , piece_id=EQRJBTEKQE53XRWUB5UCBJWMI5TI5CHI76VS7ESVDU6ENYNJNNOQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814944145 (32h8m42.598284244s) [seg_pos={0 0}, upload=30773]: Satisfied cohort requirements after 16 pieces May 26 10:12:56.815185655 (32h8m42.598525754s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ufZvREiiPSyPZ7fvKWVEcCn3E84nCiu6aYxe9n6wP4kKf43hY): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815193560 (32h8m42.598533659s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815219931 (32h8m42.59856003s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BiVenoRJiFZVtT6vhvPQLfz3pScWYJ1r2X9CLRg2F2jc8MALC): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815232726 (32h8m42.598572855s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815417979 (32h8m42.598758068s) [noise=true , address=212.102.52.214:4366 , piece_id=JOJAZM7P2L3CAVI3DE4TS5XG65AHLG5IOZM2X5DAXH7K5TPULX4A, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MbNn3rECMrMhp1uJJRHy8v3DZkKaBEcZGwPMGumvPUvvKu5gM): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815423409 (32h8m42.598763508s) [noise=true , address=212.102.52.214:4366 , piece_id=JOJAZM7P2L3CAVI3DE4TS5XG65AHLG5IOZM2X5DAXH7K5TPULX4A, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815511197 (32h8m42.598851296s) [noise=true , address=212.102.52.214:4362 , piece_id=2OKRG7ZMPJYL7D4OEXZHKVKYNXCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815519633 (32h8m42.598859732s) [noise=true , address=212.102.52.214:4362 , piece_id=2OKRG7ZMPJYL7D4OEXZHKVKYNXCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815536816 (32h8m42.598876915s) [seg_pos={0 0}, upload=30773]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 10:12:56.815619714 (32h8m42.598959813s) [upload=30773]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 10:12:56.815623582 (32h8m42.598963681s) [upload=30773]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 10:13:38.419790892 (32h9m24.203130991s) [upload=30773]: Done uploading segments... May 26 10:13:38.419850966 (32h9m24.203191065s) [upload=30773]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.997451401s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....X.......................................................] duration: 3.756767011s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:22:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.756778995s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 6 out of 60 is failed (threshold=3) [.......X..............X...X....X.........X.......X..........] duration: 4.104119029s trace: https://jaeger.dev.storj.io/trace/1321cf158342be9d FAIL (2026-05-26 10:21:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== XCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427018428 (32h8m41.210358527s) [noise=true , address=212.102.52.213:4334 , piece_id=ZWXHBNCMW7MEFYRM6SXFRKG2GIBZ5ZFLM2SWVDB7MEC6VO5KOCNQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427311697 (32h8m41.210651797s) [noise=true , address=212.102.52.217:4418 , piece_id=MSRUBKKWVUA5TO3T6K3ZXZRVOAXXI2SV7NG745HGWRZCYJZPQE4A, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427732831 (32h8m41.21107293s) [noise=true , address=212.102.52.216:4405 , piece_id=PFKQTBP6RN4YR4QYDEQQ3NQZQR5OPGWZJC73RBMMMQEXX54XSOBQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.428258494 (32h8m41.211598594s) [noise=true , address=212.102.52.216:4400 , piece_id=Z6K5X5RXBACRU5XSF7HGGKSU36RKXRIW2ZKCRISS3BA4G263TRQQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.429342422 (32h8m41.212682521s) [noise=true , address=212.102.52.214:4361 , piece_id=25CKSDWDXDQJMSLFBKA325YMHZIGDCI3MTVELOLHX2WDODTZ4G4Q, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.429548004 (32h8m41.212888103s) [noise=true , address=212.102.52.215:4387 , piece_id=KS33ZTOBOV44QBFP7PA2YFB233WUSPTHTSXVUPX7IX4MDPJQWRTQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.430337871 (32h8m41.21367797s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.430838096 (32h8m41.214178195s) [noise=true , address=212.102.52.215:4370 , piece_id=G4KPC43PMM4KBBYPINQ6LNJFP3NTB64EOULKDLNHZWNRUSHWN6LA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.431382174 (32h8m41.214722273s) [noise=true , address=212.102.52.216:4401 , piece_id=VYX7MEZWRAY5QIR77P5DB747OGZ3WARGQGXI6Q35M5SEQ4OAILYA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.432365170 (32h8m41.215705269s) [noise=true , address=212.102.52.214:4356 , piece_id=EQRJBTEKQE53XRWUB5UCBJWMI5TI5CHI76VS7ESVDU6ENYNJNNOQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.435150415 (32h8m41.218490514s) [noise=true , address=212.102.52.215:4381 , piece_id=2YAZGZDGQJJV6E24Y44RJXAIAZ3RMISLRX6O43LCIMLZCG3CM6UQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.437499377 (32h8m41.220839466s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.439247412 (32h8m41.222587511s) [noise=true , address=212.102.52.217:4419 , piece_id=PFWQMUXSAX6C7YUJUGEYBGWDUTBTQC7F7KPL2ZNJE24ZR63KG2RQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.440309829 (32h8m41.223649928s) [noise=true , address=212.102.52.217:4439 , piece_id=V236RZC26VCPLCY5Q7TTMA6R2PRT4CER6VTTFMIDQSFSEVWTW2IA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.440619900 (32h8m41.22396s) [noise=true , address=212.102.52.217:4433 , piece_id=67DJP7FXERAPOUDXCYSWUMGN4T6THOPCVGXUELTP7FTWLKCBVRHA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:56.505315534 (32h8m42.288655633s) [upload=30773]: Next returned nil segment May 26 10:12:56.505326887 (32h8m42.288666976s) [upload=30773]: Waiting for error group managing segments... May 26 10:12:56.786132791 (32h8m42.56947289s) [noise=true , address=212.102.52.217:4418 , piece_id=MSRUBKKWVUA5TO3T6K3ZXZRVOAXXI2SV7NG745HGWRZCYJZPQE4A, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.793687145 (32h8m42.577027244s) [noise=true , address=212.102.52.217:4419 , piece_id=PFWQMUXSAX6C7YUJUGEYBGWDUTBTQC7F7KPL2ZNJE24ZR63KG2RQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.794583265 (32h8m42.577923354s) [noise=true , address=212.102.52.217:4439 , piece_id=V236RZC26VCPLCY5Q7TTMA6R2PRT4CER6VTTFMIDQSFSEVWTW2IA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795374805 (32h8m42.578714934s) [noise=true , address=212.102.52.213:4329 , piece_id=VCE7AJFHTXECGW6IQ3T4XMCISQVDRM7KVXDIJJFUNFQTTFBO6NIQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795566350 (32h8m42.57890645s) [noise=true , address=212.102.52.213:4332 , piece_id=ZS2NROQDSVY52Q5EETXC2C7LQOSG35KDZO5IRZUX6ZSEYKSHYTFQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795768947 (32h8m42.579109046s) [noise=true , address=212.102.52.213:4333 , piece_id=7FHEGSQNAV7WU3LZSQ24CWD7NXOLPI7H5MHDDX5FJFIJZLTQEFSQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.796537273 (32h8m42.579877362s) [noise=true , address=212.102.52.213:4334 , piece_id=ZWXHBNCMW7MEFYRM6SXFRKG2GIBZ5ZFLM2SWVDB7MEC6VO5KOCNQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.797374871 (32h8m42.58071497s) [noise=true , address=212.102.52.215:4370 , piece_id=G4KPC43PMM4KBBYPINQ6LNJFP3NTB64EOULKDLNHZWNRUSHWN6LA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.797853234 (32h8m42.581193333s) [noise=true , address=212.102.52.217:4433 , piece_id=67DJP7FXERAPOUDXCYSWUMGN4T6THOPCVGXUELTP7FTWLKCBVRHA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.800043733 (32h8m42.583383832s) [noise=true , address=212.102.52.215:4381 , piece_id=2YAZGZDGQJJV6E24Y44RJXAIAZ3RMISLRX6O43LCIMLZCG3CM6UQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.802311351 (32h8m42.58565144s) [noise=true , address=212.102.52.215:4387 , piece_id=KS33ZTOBOV44QBFP7PA2YFB233WUSPTHTSXVUPX7IX4MDPJQWRTQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.803925611 (32h8m42.58726571s) [noise=true , address=212.102.52.216:4405 , piece_id=PFKQTBP6RN4YR4QYDEQQ3NQZQR5OPGWZJC73RBMMMQEXX54XSOBQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.809985033 (32h8m42.593325132s) [noise=true , address=212.102.52.214:4361 , piece_id=25CKSDWDXDQJMSLFBKA325YMHZIGDCI3MTVELOLHX2WDODTZ4G4Q, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.813255723 (32h8m42.596595822s) [noise=true , address=212.102.52.216:4400 , piece_id=Z6K5X5RXBACRU5XSF7HGGKSU36RKXRIW2ZKCRISS3BA4G263TRQQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814265039 (32h8m42.597605138s) [noise=true , address=212.102.52.216:4401 , piece_id=VYX7MEZWRAY5QIR77P5DB747OGZ3WARGQGXI6Q35M5SEQ4OAILYA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814932904 (32h8m42.598273023s) [noise=true , address=212.102.52.214:4356 , piece_id=EQRJBTEKQE53XRWUB5UCBJWMI5TI5CHI76VS7ESVDU6ENYNJNNOQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814944145 (32h8m42.598284244s) [seg_pos={0 0}, upload=30773]: Satisfied cohort requirements after 16 pieces May 26 10:12:56.815185655 (32h8m42.598525754s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ufZvREiiPSyPZ7fvKWVEcCn3E84nCiu6aYxe9n6wP4kKf43hY): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815193560 (32h8m42.598533659s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815219931 (32h8m42.59856003s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BiVenoRJiFZVtT6vhvPQLfz3pScWYJ1r2X9CLRg2F2jc8MALC): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815232726 (32h8m42.598572855s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815417979 (32h8m42.598758068s) [noise=true , address=212.102.52.214:4366 , piece_id=JOJAZM7P2L3CAVI3DE4TS5XG65AHLG5IOZM2X5DAXH7K5TPULX4A, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MbNn3rECMrMhp1uJJRHy8v3DZkKaBEcZGwPMGumvPUvvKu5gM): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815423409 (32h8m42.598763508s) [noise=true , address=212.102.52.214:4366 , piece_id=JOJAZM7P2L3CAVI3DE4TS5XG65AHLG5IOZM2X5DAXH7K5TPULX4A, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815511197 (32h8m42.598851296s) [noise=true , address=212.102.52.214:4362 , piece_id=2OKRG7ZMPJYL7D4OEXZHKVKYNXCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815519633 (32h8m42.598859732s) [noise=true , address=212.102.52.214:4362 , piece_id=2OKRG7ZMPJYL7D4OEXZHKVKYNXCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815536816 (32h8m42.598876915s) [seg_pos={0 0}, upload=30773]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 10:12:56.815619714 (32h8m42.598959813s) [upload=30773]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 10:12:56.815623582 (32h8m42.598963681s) [upload=30773]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 10:13:38.419790892 (32h9m24.203130991s) [upload=30773]: Done uploading segments... May 26 10:13:38.419850966 (32h9m24.203191065s) [upload=30773]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.104142803s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....X......................................................] duration: 3.913017931s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:21:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.913144621s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 6 out of 60 is failed (threshold=3) [........X..............X...X....X.........X.......X.........] duration: 4.888092846s trace: https://jaeger.dev.storj.io/trace/1321cf158342be9d FAIL (2026-05-26 10:20:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== XCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427018428 (32h8m41.210358527s) [noise=true , address=212.102.52.213:4334 , piece_id=ZWXHBNCMW7MEFYRM6SXFRKG2GIBZ5ZFLM2SWVDB7MEC6VO5KOCNQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427311697 (32h8m41.210651797s) [noise=true , address=212.102.52.217:4418 , piece_id=MSRUBKKWVUA5TO3T6K3ZXZRVOAXXI2SV7NG745HGWRZCYJZPQE4A, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427732831 (32h8m41.21107293s) [noise=true , address=212.102.52.216:4405 , piece_id=PFKQTBP6RN4YR4QYDEQQ3NQZQR5OPGWZJC73RBMMMQEXX54XSOBQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.428258494 (32h8m41.211598594s) [noise=true , address=212.102.52.216:4400 , piece_id=Z6K5X5RXBACRU5XSF7HGGKSU36RKXRIW2ZKCRISS3BA4G263TRQQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.429342422 (32h8m41.212682521s) [noise=true , address=212.102.52.214:4361 , piece_id=25CKSDWDXDQJMSLFBKA325YMHZIGDCI3MTVELOLHX2WDODTZ4G4Q, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.429548004 (32h8m41.212888103s) [noise=true , address=212.102.52.215:4387 , piece_id=KS33ZTOBOV44QBFP7PA2YFB233WUSPTHTSXVUPX7IX4MDPJQWRTQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.430337871 (32h8m41.21367797s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.430838096 (32h8m41.214178195s) [noise=true , address=212.102.52.215:4370 , piece_id=G4KPC43PMM4KBBYPINQ6LNJFP3NTB64EOULKDLNHZWNRUSHWN6LA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.431382174 (32h8m41.214722273s) [noise=true , address=212.102.52.216:4401 , piece_id=VYX7MEZWRAY5QIR77P5DB747OGZ3WARGQGXI6Q35M5SEQ4OAILYA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.432365170 (32h8m41.215705269s) [noise=true , address=212.102.52.214:4356 , piece_id=EQRJBTEKQE53XRWUB5UCBJWMI5TI5CHI76VS7ESVDU6ENYNJNNOQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.435150415 (32h8m41.218490514s) [noise=true , address=212.102.52.215:4381 , piece_id=2YAZGZDGQJJV6E24Y44RJXAIAZ3RMISLRX6O43LCIMLZCG3CM6UQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.437499377 (32h8m41.220839466s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.439247412 (32h8m41.222587511s) [noise=true , address=212.102.52.217:4419 , piece_id=PFWQMUXSAX6C7YUJUGEYBGWDUTBTQC7F7KPL2ZNJE24ZR63KG2RQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.440309829 (32h8m41.223649928s) [noise=true , address=212.102.52.217:4439 , piece_id=V236RZC26VCPLCY5Q7TTMA6R2PRT4CER6VTTFMIDQSFSEVWTW2IA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.440619900 (32h8m41.22396s) [noise=true , address=212.102.52.217:4433 , piece_id=67DJP7FXERAPOUDXCYSWUMGN4T6THOPCVGXUELTP7FTWLKCBVRHA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:56.505315534 (32h8m42.288655633s) [upload=30773]: Next returned nil segment May 26 10:12:56.505326887 (32h8m42.288666976s) [upload=30773]: Waiting for error group managing segments... May 26 10:12:56.786132791 (32h8m42.56947289s) [noise=true , address=212.102.52.217:4418 , piece_id=MSRUBKKWVUA5TO3T6K3ZXZRVOAXXI2SV7NG745HGWRZCYJZPQE4A, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.793687145 (32h8m42.577027244s) [noise=true , address=212.102.52.217:4419 , piece_id=PFWQMUXSAX6C7YUJUGEYBGWDUTBTQC7F7KPL2ZNJE24ZR63KG2RQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.794583265 (32h8m42.577923354s) [noise=true , address=212.102.52.217:4439 , piece_id=V236RZC26VCPLCY5Q7TTMA6R2PRT4CER6VTTFMIDQSFSEVWTW2IA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795374805 (32h8m42.578714934s) [noise=true , address=212.102.52.213:4329 , piece_id=VCE7AJFHTXECGW6IQ3T4XMCISQVDRM7KVXDIJJFUNFQTTFBO6NIQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795566350 (32h8m42.57890645s) [noise=true , address=212.102.52.213:4332 , piece_id=ZS2NROQDSVY52Q5EETXC2C7LQOSG35KDZO5IRZUX6ZSEYKSHYTFQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795768947 (32h8m42.579109046s) [noise=true , address=212.102.52.213:4333 , piece_id=7FHEGSQNAV7WU3LZSQ24CWD7NXOLPI7H5MHDDX5FJFIJZLTQEFSQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.796537273 (32h8m42.579877362s) [noise=true , address=212.102.52.213:4334 , piece_id=ZWXHBNCMW7MEFYRM6SXFRKG2GIBZ5ZFLM2SWVDB7MEC6VO5KOCNQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.797374871 (32h8m42.58071497s) [noise=true , address=212.102.52.215:4370 , piece_id=G4KPC43PMM4KBBYPINQ6LNJFP3NTB64EOULKDLNHZWNRUSHWN6LA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.797853234 (32h8m42.581193333s) [noise=true , address=212.102.52.217:4433 , piece_id=67DJP7FXERAPOUDXCYSWUMGN4T6THOPCVGXUELTP7FTWLKCBVRHA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.800043733 (32h8m42.583383832s) [noise=true , address=212.102.52.215:4381 , piece_id=2YAZGZDGQJJV6E24Y44RJXAIAZ3RMISLRX6O43LCIMLZCG3CM6UQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.802311351 (32h8m42.58565144s) [noise=true , address=212.102.52.215:4387 , piece_id=KS33ZTOBOV44QBFP7PA2YFB233WUSPTHTSXVUPX7IX4MDPJQWRTQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.803925611 (32h8m42.58726571s) [noise=true , address=212.102.52.216:4405 , piece_id=PFKQTBP6RN4YR4QYDEQQ3NQZQR5OPGWZJC73RBMMMQEXX54XSOBQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.809985033 (32h8m42.593325132s) [noise=true , address=212.102.52.214:4361 , piece_id=25CKSDWDXDQJMSLFBKA325YMHZIGDCI3MTVELOLHX2WDODTZ4G4Q, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.813255723 (32h8m42.596595822s) [noise=true , address=212.102.52.216:4400 , piece_id=Z6K5X5RXBACRU5XSF7HGGKSU36RKXRIW2ZKCRISS3BA4G263TRQQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814265039 (32h8m42.597605138s) [noise=true , address=212.102.52.216:4401 , piece_id=VYX7MEZWRAY5QIR77P5DB747OGZ3WARGQGXI6Q35M5SEQ4OAILYA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814932904 (32h8m42.598273023s) [noise=true , address=212.102.52.214:4356 , piece_id=EQRJBTEKQE53XRWUB5UCBJWMI5TI5CHI76VS7ESVDU6ENYNJNNOQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814944145 (32h8m42.598284244s) [seg_pos={0 0}, upload=30773]: Satisfied cohort requirements after 16 pieces May 26 10:12:56.815185655 (32h8m42.598525754s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ufZvREiiPSyPZ7fvKWVEcCn3E84nCiu6aYxe9n6wP4kKf43hY): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815193560 (32h8m42.598533659s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815219931 (32h8m42.59856003s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BiVenoRJiFZVtT6vhvPQLfz3pScWYJ1r2X9CLRg2F2jc8MALC): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815232726 (32h8m42.598572855s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815417979 (32h8m42.598758068s) [noise=true , address=212.102.52.214:4366 , piece_id=JOJAZM7P2L3CAVI3DE4TS5XG65AHLG5IOZM2X5DAXH7K5TPULX4A, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MbNn3rECMrMhp1uJJRHy8v3DZkKaBEcZGwPMGumvPUvvKu5gM): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815423409 (32h8m42.598763508s) [noise=true , address=212.102.52.214:4366 , piece_id=JOJAZM7P2L3CAVI3DE4TS5XG65AHLG5IOZM2X5DAXH7K5TPULX4A, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815511197 (32h8m42.598851296s) [noise=true , address=212.102.52.214:4362 , piece_id=2OKRG7ZMPJYL7D4OEXZHKVKYNXCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815519633 (32h8m42.598859732s) [noise=true , address=212.102.52.214:4362 , piece_id=2OKRG7ZMPJYL7D4OEXZHKVKYNXCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815536816 (32h8m42.598876915s) [seg_pos={0 0}, upload=30773]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 10:12:56.815619714 (32h8m42.598959813s) [upload=30773]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 10:12:56.815623582 (32h8m42.598963681s) [upload=30773]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 10:13:38.419790892 (32h9m24.203130991s) [upload=30773]: Done uploading segments... May 26 10:13:38.419850966 (32h9m24.203191065s) [upload=30773]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.888116451s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......X.....................................................] duration: 3.962606025s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:20:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.962630732s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......X....................................................] duration: 3.846070771s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:19:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.846094897s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 6 out of 60 is failed (threshold=3) [.........X..............X...X....X.........X.......X........] duration: 4.135470766s trace: https://jaeger.dev.storj.io/trace/1321cf158342be9d FAIL (2026-05-26 10:19:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== XCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427018428 (32h8m41.210358527s) [noise=true , address=212.102.52.213:4334 , piece_id=ZWXHBNCMW7MEFYRM6SXFRKG2GIBZ5ZFLM2SWVDB7MEC6VO5KOCNQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427311697 (32h8m41.210651797s) [noise=true , address=212.102.52.217:4418 , piece_id=MSRUBKKWVUA5TO3T6K3ZXZRVOAXXI2SV7NG745HGWRZCYJZPQE4A, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427732831 (32h8m41.21107293s) [noise=true , address=212.102.52.216:4405 , piece_id=PFKQTBP6RN4YR4QYDEQQ3NQZQR5OPGWZJC73RBMMMQEXX54XSOBQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.428258494 (32h8m41.211598594s) [noise=true , address=212.102.52.216:4400 , piece_id=Z6K5X5RXBACRU5XSF7HGGKSU36RKXRIW2ZKCRISS3BA4G263TRQQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.429342422 (32h8m41.212682521s) [noise=true , address=212.102.52.214:4361 , piece_id=25CKSDWDXDQJMSLFBKA325YMHZIGDCI3MTVELOLHX2WDODTZ4G4Q, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.429548004 (32h8m41.212888103s) [noise=true , address=212.102.52.215:4387 , piece_id=KS33ZTOBOV44QBFP7PA2YFB233WUSPTHTSXVUPX7IX4MDPJQWRTQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.430337871 (32h8m41.21367797s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.430838096 (32h8m41.214178195s) [noise=true , address=212.102.52.215:4370 , piece_id=G4KPC43PMM4KBBYPINQ6LNJFP3NTB64EOULKDLNHZWNRUSHWN6LA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.431382174 (32h8m41.214722273s) [noise=true , address=212.102.52.216:4401 , piece_id=VYX7MEZWRAY5QIR77P5DB747OGZ3WARGQGXI6Q35M5SEQ4OAILYA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.432365170 (32h8m41.215705269s) [noise=true , address=212.102.52.214:4356 , piece_id=EQRJBTEKQE53XRWUB5UCBJWMI5TI5CHI76VS7ESVDU6ENYNJNNOQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.435150415 (32h8m41.218490514s) [noise=true , address=212.102.52.215:4381 , piece_id=2YAZGZDGQJJV6E24Y44RJXAIAZ3RMISLRX6O43LCIMLZCG3CM6UQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.437499377 (32h8m41.220839466s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.439247412 (32h8m41.222587511s) [noise=true , address=212.102.52.217:4419 , piece_id=PFWQMUXSAX6C7YUJUGEYBGWDUTBTQC7F7KPL2ZNJE24ZR63KG2RQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.440309829 (32h8m41.223649928s) [noise=true , address=212.102.52.217:4439 , piece_id=V236RZC26VCPLCY5Q7TTMA6R2PRT4CER6VTTFMIDQSFSEVWTW2IA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.440619900 (32h8m41.22396s) [noise=true , address=212.102.52.217:4433 , piece_id=67DJP7FXERAPOUDXCYSWUMGN4T6THOPCVGXUELTP7FTWLKCBVRHA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:56.505315534 (32h8m42.288655633s) [upload=30773]: Next returned nil segment May 26 10:12:56.505326887 (32h8m42.288666976s) [upload=30773]: Waiting for error group managing segments... May 26 10:12:56.786132791 (32h8m42.56947289s) [noise=true , address=212.102.52.217:4418 , piece_id=MSRUBKKWVUA5TO3T6K3ZXZRVOAXXI2SV7NG745HGWRZCYJZPQE4A, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.793687145 (32h8m42.577027244s) [noise=true , address=212.102.52.217:4419 , piece_id=PFWQMUXSAX6C7YUJUGEYBGWDUTBTQC7F7KPL2ZNJE24ZR63KG2RQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.794583265 (32h8m42.577923354s) [noise=true , address=212.102.52.217:4439 , piece_id=V236RZC26VCPLCY5Q7TTMA6R2PRT4CER6VTTFMIDQSFSEVWTW2IA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795374805 (32h8m42.578714934s) [noise=true , address=212.102.52.213:4329 , piece_id=VCE7AJFHTXECGW6IQ3T4XMCISQVDRM7KVXDIJJFUNFQTTFBO6NIQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795566350 (32h8m42.57890645s) [noise=true , address=212.102.52.213:4332 , piece_id=ZS2NROQDSVY52Q5EETXC2C7LQOSG35KDZO5IRZUX6ZSEYKSHYTFQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795768947 (32h8m42.579109046s) [noise=true , address=212.102.52.213:4333 , piece_id=7FHEGSQNAV7WU3LZSQ24CWD7NXOLPI7H5MHDDX5FJFIJZLTQEFSQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.796537273 (32h8m42.579877362s) [noise=true , address=212.102.52.213:4334 , piece_id=ZWXHBNCMW7MEFYRM6SXFRKG2GIBZ5ZFLM2SWVDB7MEC6VO5KOCNQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.797374871 (32h8m42.58071497s) [noise=true , address=212.102.52.215:4370 , piece_id=G4KPC43PMM4KBBYPINQ6LNJFP3NTB64EOULKDLNHZWNRUSHWN6LA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.797853234 (32h8m42.581193333s) [noise=true , address=212.102.52.217:4433 , piece_id=67DJP7FXERAPOUDXCYSWUMGN4T6THOPCVGXUELTP7FTWLKCBVRHA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.800043733 (32h8m42.583383832s) [noise=true , address=212.102.52.215:4381 , piece_id=2YAZGZDGQJJV6E24Y44RJXAIAZ3RMISLRX6O43LCIMLZCG3CM6UQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.802311351 (32h8m42.58565144s) [noise=true , address=212.102.52.215:4387 , piece_id=KS33ZTOBOV44QBFP7PA2YFB233WUSPTHTSXVUPX7IX4MDPJQWRTQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.803925611 (32h8m42.58726571s) [noise=true , address=212.102.52.216:4405 , piece_id=PFKQTBP6RN4YR4QYDEQQ3NQZQR5OPGWZJC73RBMMMQEXX54XSOBQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.809985033 (32h8m42.593325132s) [noise=true , address=212.102.52.214:4361 , piece_id=25CKSDWDXDQJMSLFBKA325YMHZIGDCI3MTVELOLHX2WDODTZ4G4Q, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.813255723 (32h8m42.596595822s) [noise=true , address=212.102.52.216:4400 , piece_id=Z6K5X5RXBACRU5XSF7HGGKSU36RKXRIW2ZKCRISS3BA4G263TRQQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814265039 (32h8m42.597605138s) [noise=true , address=212.102.52.216:4401 , piece_id=VYX7MEZWRAY5QIR77P5DB747OGZ3WARGQGXI6Q35M5SEQ4OAILYA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814932904 (32h8m42.598273023s) [noise=true , address=212.102.52.214:4356 , piece_id=EQRJBTEKQE53XRWUB5UCBJWMI5TI5CHI76VS7ESVDU6ENYNJNNOQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814944145 (32h8m42.598284244s) [seg_pos={0 0}, upload=30773]: Satisfied cohort requirements after 16 pieces May 26 10:12:56.815185655 (32h8m42.598525754s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ufZvREiiPSyPZ7fvKWVEcCn3E84nCiu6aYxe9n6wP4kKf43hY): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815193560 (32h8m42.598533659s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815219931 (32h8m42.59856003s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BiVenoRJiFZVtT6vhvPQLfz3pScWYJ1r2X9CLRg2F2jc8MALC): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815232726 (32h8m42.598572855s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815417979 (32h8m42.598758068s) [noise=true , address=212.102.52.214:4366 , piece_id=JOJAZM7P2L3CAVI3DE4TS5XG65AHLG5IOZM2X5DAXH7K5TPULX4A, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MbNn3rECMrMhp1uJJRHy8v3DZkKaBEcZGwPMGumvPUvvKu5gM): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815423409 (32h8m42.598763508s) [noise=true , address=212.102.52.214:4366 , piece_id=JOJAZM7P2L3CAVI3DE4TS5XG65AHLG5IOZM2X5DAXH7K5TPULX4A, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815511197 (32h8m42.598851296s) [noise=true , address=212.102.52.214:4362 , piece_id=2OKRG7ZMPJYL7D4OEXZHKVKYNXCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815519633 (32h8m42.598859732s) [noise=true , address=212.102.52.214:4362 , piece_id=2OKRG7ZMPJYL7D4OEXZHKVKYNXCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815536816 (32h8m42.598876915s) [seg_pos={0 0}, upload=30773]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 10:12:56.815619714 (32h8m42.598959813s) [upload=30773]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 10:12:56.815623582 (32h8m42.598963681s) [upload=30773]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 10:13:38.419790892 (32h9m24.203130991s) [upload=30773]: Done uploading segments... May 26 10:13:38.419850966 (32h9m24.203191065s) [upload=30773]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.135493359s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........X...................................................] duration: 3.735641357s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:19:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.735664062s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 6 out of 60 is failed (threshold=3) [..........X..............X...X....X.........X.......X.......] duration: 7.228070624s trace: https://jaeger.dev.storj.io/trace/1321cf158342be9d FAIL (2026-05-26 10:18:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== XCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427018428 (32h8m41.210358527s) [noise=true , address=212.102.52.213:4334 , piece_id=ZWXHBNCMW7MEFYRM6SXFRKG2GIBZ5ZFLM2SWVDB7MEC6VO5KOCNQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427311697 (32h8m41.210651797s) [noise=true , address=212.102.52.217:4418 , piece_id=MSRUBKKWVUA5TO3T6K3ZXZRVOAXXI2SV7NG745HGWRZCYJZPQE4A, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427732831 (32h8m41.21107293s) [noise=true , address=212.102.52.216:4405 , piece_id=PFKQTBP6RN4YR4QYDEQQ3NQZQR5OPGWZJC73RBMMMQEXX54XSOBQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.428258494 (32h8m41.211598594s) [noise=true , address=212.102.52.216:4400 , piece_id=Z6K5X5RXBACRU5XSF7HGGKSU36RKXRIW2ZKCRISS3BA4G263TRQQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.429342422 (32h8m41.212682521s) [noise=true , address=212.102.52.214:4361 , piece_id=25CKSDWDXDQJMSLFBKA325YMHZIGDCI3MTVELOLHX2WDODTZ4G4Q, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.429548004 (32h8m41.212888103s) [noise=true , address=212.102.52.215:4387 , piece_id=KS33ZTOBOV44QBFP7PA2YFB233WUSPTHTSXVUPX7IX4MDPJQWRTQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.430337871 (32h8m41.21367797s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.430838096 (32h8m41.214178195s) [noise=true , address=212.102.52.215:4370 , piece_id=G4KPC43PMM4KBBYPINQ6LNJFP3NTB64EOULKDLNHZWNRUSHWN6LA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.431382174 (32h8m41.214722273s) [noise=true , address=212.102.52.216:4401 , piece_id=VYX7MEZWRAY5QIR77P5DB747OGZ3WARGQGXI6Q35M5SEQ4OAILYA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.432365170 (32h8m41.215705269s) [noise=true , address=212.102.52.214:4356 , piece_id=EQRJBTEKQE53XRWUB5UCBJWMI5TI5CHI76VS7ESVDU6ENYNJNNOQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.435150415 (32h8m41.218490514s) [noise=true , address=212.102.52.215:4381 , piece_id=2YAZGZDGQJJV6E24Y44RJXAIAZ3RMISLRX6O43LCIMLZCG3CM6UQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.437499377 (32h8m41.220839466s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.439247412 (32h8m41.222587511s) [noise=true , address=212.102.52.217:4419 , piece_id=PFWQMUXSAX6C7YUJUGEYBGWDUTBTQC7F7KPL2ZNJE24ZR63KG2RQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.440309829 (32h8m41.223649928s) [noise=true , address=212.102.52.217:4439 , piece_id=V236RZC26VCPLCY5Q7TTMA6R2PRT4CER6VTTFMIDQSFSEVWTW2IA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.440619900 (32h8m41.22396s) [noise=true , address=212.102.52.217:4433 , piece_id=67DJP7FXERAPOUDXCYSWUMGN4T6THOPCVGXUELTP7FTWLKCBVRHA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:56.505315534 (32h8m42.288655633s) [upload=30773]: Next returned nil segment May 26 10:12:56.505326887 (32h8m42.288666976s) [upload=30773]: Waiting for error group managing segments... May 26 10:12:56.786132791 (32h8m42.56947289s) [noise=true , address=212.102.52.217:4418 , piece_id=MSRUBKKWVUA5TO3T6K3ZXZRVOAXXI2SV7NG745HGWRZCYJZPQE4A, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.793687145 (32h8m42.577027244s) [noise=true , address=212.102.52.217:4419 , piece_id=PFWQMUXSAX6C7YUJUGEYBGWDUTBTQC7F7KPL2ZNJE24ZR63KG2RQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.794583265 (32h8m42.577923354s) [noise=true , address=212.102.52.217:4439 , piece_id=V236RZC26VCPLCY5Q7TTMA6R2PRT4CER6VTTFMIDQSFSEVWTW2IA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795374805 (32h8m42.578714934s) [noise=true , address=212.102.52.213:4329 , piece_id=VCE7AJFHTXECGW6IQ3T4XMCISQVDRM7KVXDIJJFUNFQTTFBO6NIQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795566350 (32h8m42.57890645s) [noise=true , address=212.102.52.213:4332 , piece_id=ZS2NROQDSVY52Q5EETXC2C7LQOSG35KDZO5IRZUX6ZSEYKSHYTFQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795768947 (32h8m42.579109046s) [noise=true , address=212.102.52.213:4333 , piece_id=7FHEGSQNAV7WU3LZSQ24CWD7NXOLPI7H5MHDDX5FJFIJZLTQEFSQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.796537273 (32h8m42.579877362s) [noise=true , address=212.102.52.213:4334 , piece_id=ZWXHBNCMW7MEFYRM6SXFRKG2GIBZ5ZFLM2SWVDB7MEC6VO5KOCNQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.797374871 (32h8m42.58071497s) [noise=true , address=212.102.52.215:4370 , piece_id=G4KPC43PMM4KBBYPINQ6LNJFP3NTB64EOULKDLNHZWNRUSHWN6LA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.797853234 (32h8m42.581193333s) [noise=true , address=212.102.52.217:4433 , piece_id=67DJP7FXERAPOUDXCYSWUMGN4T6THOPCVGXUELTP7FTWLKCBVRHA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.800043733 (32h8m42.583383832s) [noise=true , address=212.102.52.215:4381 , piece_id=2YAZGZDGQJJV6E24Y44RJXAIAZ3RMISLRX6O43LCIMLZCG3CM6UQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.802311351 (32h8m42.58565144s) [noise=true , address=212.102.52.215:4387 , piece_id=KS33ZTOBOV44QBFP7PA2YFB233WUSPTHTSXVUPX7IX4MDPJQWRTQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.803925611 (32h8m42.58726571s) [noise=true , address=212.102.52.216:4405 , piece_id=PFKQTBP6RN4YR4QYDEQQ3NQZQR5OPGWZJC73RBMMMQEXX54XSOBQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.809985033 (32h8m42.593325132s) [noise=true , address=212.102.52.214:4361 , piece_id=25CKSDWDXDQJMSLFBKA325YMHZIGDCI3MTVELOLHX2WDODTZ4G4Q, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.813255723 (32h8m42.596595822s) [noise=true , address=212.102.52.216:4400 , piece_id=Z6K5X5RXBACRU5XSF7HGGKSU36RKXRIW2ZKCRISS3BA4G263TRQQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814265039 (32h8m42.597605138s) [noise=true , address=212.102.52.216:4401 , piece_id=VYX7MEZWRAY5QIR77P5DB747OGZ3WARGQGXI6Q35M5SEQ4OAILYA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814932904 (32h8m42.598273023s) [noise=true , address=212.102.52.214:4356 , piece_id=EQRJBTEKQE53XRWUB5UCBJWMI5TI5CHI76VS7ESVDU6ENYNJNNOQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814944145 (32h8m42.598284244s) [seg_pos={0 0}, upload=30773]: Satisfied cohort requirements after 16 pieces May 26 10:12:56.815185655 (32h8m42.598525754s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ufZvREiiPSyPZ7fvKWVEcCn3E84nCiu6aYxe9n6wP4kKf43hY): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815193560 (32h8m42.598533659s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815219931 (32h8m42.59856003s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BiVenoRJiFZVtT6vhvPQLfz3pScWYJ1r2X9CLRg2F2jc8MALC): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815232726 (32h8m42.598572855s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815417979 (32h8m42.598758068s) [noise=true , address=212.102.52.214:4366 , piece_id=JOJAZM7P2L3CAVI3DE4TS5XG65AHLG5IOZM2X5DAXH7K5TPULX4A, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MbNn3rECMrMhp1uJJRHy8v3DZkKaBEcZGwPMGumvPUvvKu5gM): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815423409 (32h8m42.598763508s) [noise=true , address=212.102.52.214:4366 , piece_id=JOJAZM7P2L3CAVI3DE4TS5XG65AHLG5IOZM2X5DAXH7K5TPULX4A, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815511197 (32h8m42.598851296s) [noise=true , address=212.102.52.214:4362 , piece_id=2OKRG7ZMPJYL7D4OEXZHKVKYNXCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815519633 (32h8m42.598859732s) [noise=true , address=212.102.52.214:4362 , piece_id=2OKRG7ZMPJYL7D4OEXZHKVKYNXCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815536816 (32h8m42.598876915s) [seg_pos={0 0}, upload=30773]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 10:12:56.815619714 (32h8m42.598959813s) [upload=30773]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 10:12:56.815623582 (32h8m42.598963681s) [upload=30773]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 10:13:38.419790892 (32h9m24.203130991s) [upload=30773]: Done uploading segments... May 26 10:13:38.419850966 (32h9m24.203191065s) [upload=30773]: Upload finished. err: metaclient: context deadline exceeded Duration: 7.228094661s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........X..................................................] duration: 3.70373201s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:18:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.703751547s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........X.................................................] duration: 3.817084003s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:17:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.817105203s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 6 out of 60 is failed (threshold=3) [...........X..............X...X....X.........X.......X......] duration: 4.185505898s trace: https://jaeger.dev.storj.io/trace/1321cf158342be9d FAIL (2026-05-26 10:17:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== XCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427018428 (32h8m41.210358527s) [noise=true , address=212.102.52.213:4334 , piece_id=ZWXHBNCMW7MEFYRM6SXFRKG2GIBZ5ZFLM2SWVDB7MEC6VO5KOCNQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427311697 (32h8m41.210651797s) [noise=true , address=212.102.52.217:4418 , piece_id=MSRUBKKWVUA5TO3T6K3ZXZRVOAXXI2SV7NG745HGWRZCYJZPQE4A, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427732831 (32h8m41.21107293s) [noise=true , address=212.102.52.216:4405 , piece_id=PFKQTBP6RN4YR4QYDEQQ3NQZQR5OPGWZJC73RBMMMQEXX54XSOBQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.428258494 (32h8m41.211598594s) [noise=true , address=212.102.52.216:4400 , piece_id=Z6K5X5RXBACRU5XSF7HGGKSU36RKXRIW2ZKCRISS3BA4G263TRQQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.429342422 (32h8m41.212682521s) [noise=true , address=212.102.52.214:4361 , piece_id=25CKSDWDXDQJMSLFBKA325YMHZIGDCI3MTVELOLHX2WDODTZ4G4Q, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.429548004 (32h8m41.212888103s) [noise=true , address=212.102.52.215:4387 , piece_id=KS33ZTOBOV44QBFP7PA2YFB233WUSPTHTSXVUPX7IX4MDPJQWRTQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.430337871 (32h8m41.21367797s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.430838096 (32h8m41.214178195s) [noise=true , address=212.102.52.215:4370 , piece_id=G4KPC43PMM4KBBYPINQ6LNJFP3NTB64EOULKDLNHZWNRUSHWN6LA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.431382174 (32h8m41.214722273s) [noise=true , address=212.102.52.216:4401 , piece_id=VYX7MEZWRAY5QIR77P5DB747OGZ3WARGQGXI6Q35M5SEQ4OAILYA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.432365170 (32h8m41.215705269s) [noise=true , address=212.102.52.214:4356 , piece_id=EQRJBTEKQE53XRWUB5UCBJWMI5TI5CHI76VS7ESVDU6ENYNJNNOQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.435150415 (32h8m41.218490514s) [noise=true , address=212.102.52.215:4381 , piece_id=2YAZGZDGQJJV6E24Y44RJXAIAZ3RMISLRX6O43LCIMLZCG3CM6UQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.437499377 (32h8m41.220839466s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.439247412 (32h8m41.222587511s) [noise=true , address=212.102.52.217:4419 , piece_id=PFWQMUXSAX6C7YUJUGEYBGWDUTBTQC7F7KPL2ZNJE24ZR63KG2RQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.440309829 (32h8m41.223649928s) [noise=true , address=212.102.52.217:4439 , piece_id=V236RZC26VCPLCY5Q7TTMA6R2PRT4CER6VTTFMIDQSFSEVWTW2IA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.440619900 (32h8m41.22396s) [noise=true , address=212.102.52.217:4433 , piece_id=67DJP7FXERAPOUDXCYSWUMGN4T6THOPCVGXUELTP7FTWLKCBVRHA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:56.505315534 (32h8m42.288655633s) [upload=30773]: Next returned nil segment May 26 10:12:56.505326887 (32h8m42.288666976s) [upload=30773]: Waiting for error group managing segments... May 26 10:12:56.786132791 (32h8m42.56947289s) [noise=true , address=212.102.52.217:4418 , piece_id=MSRUBKKWVUA5TO3T6K3ZXZRVOAXXI2SV7NG745HGWRZCYJZPQE4A, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.793687145 (32h8m42.577027244s) [noise=true , address=212.102.52.217:4419 , piece_id=PFWQMUXSAX6C7YUJUGEYBGWDUTBTQC7F7KPL2ZNJE24ZR63KG2RQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.794583265 (32h8m42.577923354s) [noise=true , address=212.102.52.217:4439 , piece_id=V236RZC26VCPLCY5Q7TTMA6R2PRT4CER6VTTFMIDQSFSEVWTW2IA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795374805 (32h8m42.578714934s) [noise=true , address=212.102.52.213:4329 , piece_id=VCE7AJFHTXECGW6IQ3T4XMCISQVDRM7KVXDIJJFUNFQTTFBO6NIQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795566350 (32h8m42.57890645s) [noise=true , address=212.102.52.213:4332 , piece_id=ZS2NROQDSVY52Q5EETXC2C7LQOSG35KDZO5IRZUX6ZSEYKSHYTFQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795768947 (32h8m42.579109046s) [noise=true , address=212.102.52.213:4333 , piece_id=7FHEGSQNAV7WU3LZSQ24CWD7NXOLPI7H5MHDDX5FJFIJZLTQEFSQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.796537273 (32h8m42.579877362s) [noise=true , address=212.102.52.213:4334 , piece_id=ZWXHBNCMW7MEFYRM6SXFRKG2GIBZ5ZFLM2SWVDB7MEC6VO5KOCNQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.797374871 (32h8m42.58071497s) [noise=true , address=212.102.52.215:4370 , piece_id=G4KPC43PMM4KBBYPINQ6LNJFP3NTB64EOULKDLNHZWNRUSHWN6LA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.797853234 (32h8m42.581193333s) [noise=true , address=212.102.52.217:4433 , piece_id=67DJP7FXERAPOUDXCYSWUMGN4T6THOPCVGXUELTP7FTWLKCBVRHA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.800043733 (32h8m42.583383832s) [noise=true , address=212.102.52.215:4381 , piece_id=2YAZGZDGQJJV6E24Y44RJXAIAZ3RMISLRX6O43LCIMLZCG3CM6UQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.802311351 (32h8m42.58565144s) [noise=true , address=212.102.52.215:4387 , piece_id=KS33ZTOBOV44QBFP7PA2YFB233WUSPTHTSXVUPX7IX4MDPJQWRTQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.803925611 (32h8m42.58726571s) [noise=true , address=212.102.52.216:4405 , piece_id=PFKQTBP6RN4YR4QYDEQQ3NQZQR5OPGWZJC73RBMMMQEXX54XSOBQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.809985033 (32h8m42.593325132s) [noise=true , address=212.102.52.214:4361 , piece_id=25CKSDWDXDQJMSLFBKA325YMHZIGDCI3MTVELOLHX2WDODTZ4G4Q, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.813255723 (32h8m42.596595822s) [noise=true , address=212.102.52.216:4400 , piece_id=Z6K5X5RXBACRU5XSF7HGGKSU36RKXRIW2ZKCRISS3BA4G263TRQQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814265039 (32h8m42.597605138s) [noise=true , address=212.102.52.216:4401 , piece_id=VYX7MEZWRAY5QIR77P5DB747OGZ3WARGQGXI6Q35M5SEQ4OAILYA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814932904 (32h8m42.598273023s) [noise=true , address=212.102.52.214:4356 , piece_id=EQRJBTEKQE53XRWUB5UCBJWMI5TI5CHI76VS7ESVDU6ENYNJNNOQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814944145 (32h8m42.598284244s) [seg_pos={0 0}, upload=30773]: Satisfied cohort requirements after 16 pieces May 26 10:12:56.815185655 (32h8m42.598525754s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ufZvREiiPSyPZ7fvKWVEcCn3E84nCiu6aYxe9n6wP4kKf43hY): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815193560 (32h8m42.598533659s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815219931 (32h8m42.59856003s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BiVenoRJiFZVtT6vhvPQLfz3pScWYJ1r2X9CLRg2F2jc8MALC): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815232726 (32h8m42.598572855s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815417979 (32h8m42.598758068s) [noise=true , address=212.102.52.214:4366 , piece_id=JOJAZM7P2L3CAVI3DE4TS5XG65AHLG5IOZM2X5DAXH7K5TPULX4A, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MbNn3rECMrMhp1uJJRHy8v3DZkKaBEcZGwPMGumvPUvvKu5gM): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815423409 (32h8m42.598763508s) [noise=true , address=212.102.52.214:4366 , piece_id=JOJAZM7P2L3CAVI3DE4TS5XG65AHLG5IOZM2X5DAXH7K5TPULX4A, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815511197 (32h8m42.598851296s) [noise=true , address=212.102.52.214:4362 , piece_id=2OKRG7ZMPJYL7D4OEXZHKVKYNXCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815519633 (32h8m42.598859732s) [noise=true , address=212.102.52.214:4362 , piece_id=2OKRG7ZMPJYL7D4OEXZHKVKYNXCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815536816 (32h8m42.598876915s) [seg_pos={0 0}, upload=30773]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 10:12:56.815619714 (32h8m42.598959813s) [upload=30773]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 10:12:56.815623582 (32h8m42.598963681s) [upload=30773]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 10:13:38.419790892 (32h9m24.203130991s) [upload=30773]: Done uploading segments... May 26 10:13:38.419850966 (32h9m24.203191065s) [upload=30773]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.185528051s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........X................................................] duration: 3.917355275s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:17:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.917376976s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [............X...............................................] duration: 3.825588248s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:16:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.825602175s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 6 out of 60 is failed (threshold=3) [............X..............X...X....X.........X.......X.....] duration: 6.438778155s trace: https://jaeger.dev.storj.io/trace/1321cf158342be9d FAIL (2026-05-26 10:16:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== XCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427018428 (32h8m41.210358527s) [noise=true , address=212.102.52.213:4334 , piece_id=ZWXHBNCMW7MEFYRM6SXFRKG2GIBZ5ZFLM2SWVDB7MEC6VO5KOCNQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427311697 (32h8m41.210651797s) [noise=true , address=212.102.52.217:4418 , piece_id=MSRUBKKWVUA5TO3T6K3ZXZRVOAXXI2SV7NG745HGWRZCYJZPQE4A, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427732831 (32h8m41.21107293s) [noise=true , address=212.102.52.216:4405 , piece_id=PFKQTBP6RN4YR4QYDEQQ3NQZQR5OPGWZJC73RBMMMQEXX54XSOBQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.428258494 (32h8m41.211598594s) [noise=true , address=212.102.52.216:4400 , piece_id=Z6K5X5RXBACRU5XSF7HGGKSU36RKXRIW2ZKCRISS3BA4G263TRQQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.429342422 (32h8m41.212682521s) [noise=true , address=212.102.52.214:4361 , piece_id=25CKSDWDXDQJMSLFBKA325YMHZIGDCI3MTVELOLHX2WDODTZ4G4Q, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.429548004 (32h8m41.212888103s) [noise=true , address=212.102.52.215:4387 , piece_id=KS33ZTOBOV44QBFP7PA2YFB233WUSPTHTSXVUPX7IX4MDPJQWRTQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.430337871 (32h8m41.21367797s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.430838096 (32h8m41.214178195s) [noise=true , address=212.102.52.215:4370 , piece_id=G4KPC43PMM4KBBYPINQ6LNJFP3NTB64EOULKDLNHZWNRUSHWN6LA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.431382174 (32h8m41.214722273s) [noise=true , address=212.102.52.216:4401 , piece_id=VYX7MEZWRAY5QIR77P5DB747OGZ3WARGQGXI6Q35M5SEQ4OAILYA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.432365170 (32h8m41.215705269s) [noise=true , address=212.102.52.214:4356 , piece_id=EQRJBTEKQE53XRWUB5UCBJWMI5TI5CHI76VS7ESVDU6ENYNJNNOQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.435150415 (32h8m41.218490514s) [noise=true , address=212.102.52.215:4381 , piece_id=2YAZGZDGQJJV6E24Y44RJXAIAZ3RMISLRX6O43LCIMLZCG3CM6UQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.437499377 (32h8m41.220839466s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.439247412 (32h8m41.222587511s) [noise=true , address=212.102.52.217:4419 , piece_id=PFWQMUXSAX6C7YUJUGEYBGWDUTBTQC7F7KPL2ZNJE24ZR63KG2RQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.440309829 (32h8m41.223649928s) [noise=true , address=212.102.52.217:4439 , piece_id=V236RZC26VCPLCY5Q7TTMA6R2PRT4CER6VTTFMIDQSFSEVWTW2IA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.440619900 (32h8m41.22396s) [noise=true , address=212.102.52.217:4433 , piece_id=67DJP7FXERAPOUDXCYSWUMGN4T6THOPCVGXUELTP7FTWLKCBVRHA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:56.505315534 (32h8m42.288655633s) [upload=30773]: Next returned nil segment May 26 10:12:56.505326887 (32h8m42.288666976s) [upload=30773]: Waiting for error group managing segments... May 26 10:12:56.786132791 (32h8m42.56947289s) [noise=true , address=212.102.52.217:4418 , piece_id=MSRUBKKWVUA5TO3T6K3ZXZRVOAXXI2SV7NG745HGWRZCYJZPQE4A, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.793687145 (32h8m42.577027244s) [noise=true , address=212.102.52.217:4419 , piece_id=PFWQMUXSAX6C7YUJUGEYBGWDUTBTQC7F7KPL2ZNJE24ZR63KG2RQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.794583265 (32h8m42.577923354s) [noise=true , address=212.102.52.217:4439 , piece_id=V236RZC26VCPLCY5Q7TTMA6R2PRT4CER6VTTFMIDQSFSEVWTW2IA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795374805 (32h8m42.578714934s) [noise=true , address=212.102.52.213:4329 , piece_id=VCE7AJFHTXECGW6IQ3T4XMCISQVDRM7KVXDIJJFUNFQTTFBO6NIQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795566350 (32h8m42.57890645s) [noise=true , address=212.102.52.213:4332 , piece_id=ZS2NROQDSVY52Q5EETXC2C7LQOSG35KDZO5IRZUX6ZSEYKSHYTFQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795768947 (32h8m42.579109046s) [noise=true , address=212.102.52.213:4333 , piece_id=7FHEGSQNAV7WU3LZSQ24CWD7NXOLPI7H5MHDDX5FJFIJZLTQEFSQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.796537273 (32h8m42.579877362s) [noise=true , address=212.102.52.213:4334 , piece_id=ZWXHBNCMW7MEFYRM6SXFRKG2GIBZ5ZFLM2SWVDB7MEC6VO5KOCNQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.797374871 (32h8m42.58071497s) [noise=true , address=212.102.52.215:4370 , piece_id=G4KPC43PMM4KBBYPINQ6LNJFP3NTB64EOULKDLNHZWNRUSHWN6LA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.797853234 (32h8m42.581193333s) [noise=true , address=212.102.52.217:4433 , piece_id=67DJP7FXERAPOUDXCYSWUMGN4T6THOPCVGXUELTP7FTWLKCBVRHA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.800043733 (32h8m42.583383832s) [noise=true , address=212.102.52.215:4381 , piece_id=2YAZGZDGQJJV6E24Y44RJXAIAZ3RMISLRX6O43LCIMLZCG3CM6UQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.802311351 (32h8m42.58565144s) [noise=true , address=212.102.52.215:4387 , piece_id=KS33ZTOBOV44QBFP7PA2YFB233WUSPTHTSXVUPX7IX4MDPJQWRTQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.803925611 (32h8m42.58726571s) [noise=true , address=212.102.52.216:4405 , piece_id=PFKQTBP6RN4YR4QYDEQQ3NQZQR5OPGWZJC73RBMMMQEXX54XSOBQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.809985033 (32h8m42.593325132s) [noise=true , address=212.102.52.214:4361 , piece_id=25CKSDWDXDQJMSLFBKA325YMHZIGDCI3MTVELOLHX2WDODTZ4G4Q, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.813255723 (32h8m42.596595822s) [noise=true , address=212.102.52.216:4400 , piece_id=Z6K5X5RXBACRU5XSF7HGGKSU36RKXRIW2ZKCRISS3BA4G263TRQQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814265039 (32h8m42.597605138s) [noise=true , address=212.102.52.216:4401 , piece_id=VYX7MEZWRAY5QIR77P5DB747OGZ3WARGQGXI6Q35M5SEQ4OAILYA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814932904 (32h8m42.598273023s) [noise=true , address=212.102.52.214:4356 , piece_id=EQRJBTEKQE53XRWUB5UCBJWMI5TI5CHI76VS7ESVDU6ENYNJNNOQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814944145 (32h8m42.598284244s) [seg_pos={0 0}, upload=30773]: Satisfied cohort requirements after 16 pieces May 26 10:12:56.815185655 (32h8m42.598525754s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ufZvREiiPSyPZ7fvKWVEcCn3E84nCiu6aYxe9n6wP4kKf43hY): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815193560 (32h8m42.598533659s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815219931 (32h8m42.59856003s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BiVenoRJiFZVtT6vhvPQLfz3pScWYJ1r2X9CLRg2F2jc8MALC): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815232726 (32h8m42.598572855s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815417979 (32h8m42.598758068s) [noise=true , address=212.102.52.214:4366 , piece_id=JOJAZM7P2L3CAVI3DE4TS5XG65AHLG5IOZM2X5DAXH7K5TPULX4A, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MbNn3rECMrMhp1uJJRHy8v3DZkKaBEcZGwPMGumvPUvvKu5gM): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815423409 (32h8m42.598763508s) [noise=true , address=212.102.52.214:4366 , piece_id=JOJAZM7P2L3CAVI3DE4TS5XG65AHLG5IOZM2X5DAXH7K5TPULX4A, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815511197 (32h8m42.598851296s) [noise=true , address=212.102.52.214:4362 , piece_id=2OKRG7ZMPJYL7D4OEXZHKVKYNXCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815519633 (32h8m42.598859732s) [noise=true , address=212.102.52.214:4362 , piece_id=2OKRG7ZMPJYL7D4OEXZHKVKYNXCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815536816 (32h8m42.598876915s) [seg_pos={0 0}, upload=30773]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 10:12:56.815619714 (32h8m42.598959813s) [upload=30773]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 10:12:56.815623582 (32h8m42.598963681s) [upload=30773]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 10:13:38.419790892 (32h9m24.203130991s) [upload=30773]: Done uploading segments... May 26 10:13:38.419850966 (32h9m24.203191065s) [upload=30773]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.438799797s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.............X..............................................] duration: 3.756773686s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:15:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.756786801s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 6 out of 60 is failed (threshold=3) [.............X..............X...X....X.........X.......X....] duration: 4.065786932s trace: https://jaeger.dev.storj.io/trace/1321cf158342be9d FAIL (2026-05-26 10:15:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== XCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427018428 (32h8m41.210358527s) [noise=true , address=212.102.52.213:4334 , piece_id=ZWXHBNCMW7MEFYRM6SXFRKG2GIBZ5ZFLM2SWVDB7MEC6VO5KOCNQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427311697 (32h8m41.210651797s) [noise=true , address=212.102.52.217:4418 , piece_id=MSRUBKKWVUA5TO3T6K3ZXZRVOAXXI2SV7NG745HGWRZCYJZPQE4A, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427732831 (32h8m41.21107293s) [noise=true , address=212.102.52.216:4405 , piece_id=PFKQTBP6RN4YR4QYDEQQ3NQZQR5OPGWZJC73RBMMMQEXX54XSOBQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.428258494 (32h8m41.211598594s) [noise=true , address=212.102.52.216:4400 , piece_id=Z6K5X5RXBACRU5XSF7HGGKSU36RKXRIW2ZKCRISS3BA4G263TRQQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.429342422 (32h8m41.212682521s) [noise=true , address=212.102.52.214:4361 , piece_id=25CKSDWDXDQJMSLFBKA325YMHZIGDCI3MTVELOLHX2WDODTZ4G4Q, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.429548004 (32h8m41.212888103s) [noise=true , address=212.102.52.215:4387 , piece_id=KS33ZTOBOV44QBFP7PA2YFB233WUSPTHTSXVUPX7IX4MDPJQWRTQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.430337871 (32h8m41.21367797s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.430838096 (32h8m41.214178195s) [noise=true , address=212.102.52.215:4370 , piece_id=G4KPC43PMM4KBBYPINQ6LNJFP3NTB64EOULKDLNHZWNRUSHWN6LA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.431382174 (32h8m41.214722273s) [noise=true , address=212.102.52.216:4401 , piece_id=VYX7MEZWRAY5QIR77P5DB747OGZ3WARGQGXI6Q35M5SEQ4OAILYA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.432365170 (32h8m41.215705269s) [noise=true , address=212.102.52.214:4356 , piece_id=EQRJBTEKQE53XRWUB5UCBJWMI5TI5CHI76VS7ESVDU6ENYNJNNOQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.435150415 (32h8m41.218490514s) [noise=true , address=212.102.52.215:4381 , piece_id=2YAZGZDGQJJV6E24Y44RJXAIAZ3RMISLRX6O43LCIMLZCG3CM6UQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.437499377 (32h8m41.220839466s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.439247412 (32h8m41.222587511s) [noise=true , address=212.102.52.217:4419 , piece_id=PFWQMUXSAX6C7YUJUGEYBGWDUTBTQC7F7KPL2ZNJE24ZR63KG2RQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.440309829 (32h8m41.223649928s) [noise=true , address=212.102.52.217:4439 , piece_id=V236RZC26VCPLCY5Q7TTMA6R2PRT4CER6VTTFMIDQSFSEVWTW2IA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.440619900 (32h8m41.22396s) [noise=true , address=212.102.52.217:4433 , piece_id=67DJP7FXERAPOUDXCYSWUMGN4T6THOPCVGXUELTP7FTWLKCBVRHA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:56.505315534 (32h8m42.288655633s) [upload=30773]: Next returned nil segment May 26 10:12:56.505326887 (32h8m42.288666976s) [upload=30773]: Waiting for error group managing segments... May 26 10:12:56.786132791 (32h8m42.56947289s) [noise=true , address=212.102.52.217:4418 , piece_id=MSRUBKKWVUA5TO3T6K3ZXZRVOAXXI2SV7NG745HGWRZCYJZPQE4A, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.793687145 (32h8m42.577027244s) [noise=true , address=212.102.52.217:4419 , piece_id=PFWQMUXSAX6C7YUJUGEYBGWDUTBTQC7F7KPL2ZNJE24ZR63KG2RQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.794583265 (32h8m42.577923354s) [noise=true , address=212.102.52.217:4439 , piece_id=V236RZC26VCPLCY5Q7TTMA6R2PRT4CER6VTTFMIDQSFSEVWTW2IA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795374805 (32h8m42.578714934s) [noise=true , address=212.102.52.213:4329 , piece_id=VCE7AJFHTXECGW6IQ3T4XMCISQVDRM7KVXDIJJFUNFQTTFBO6NIQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795566350 (32h8m42.57890645s) [noise=true , address=212.102.52.213:4332 , piece_id=ZS2NROQDSVY52Q5EETXC2C7LQOSG35KDZO5IRZUX6ZSEYKSHYTFQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795768947 (32h8m42.579109046s) [noise=true , address=212.102.52.213:4333 , piece_id=7FHEGSQNAV7WU3LZSQ24CWD7NXOLPI7H5MHDDX5FJFIJZLTQEFSQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.796537273 (32h8m42.579877362s) [noise=true , address=212.102.52.213:4334 , piece_id=ZWXHBNCMW7MEFYRM6SXFRKG2GIBZ5ZFLM2SWVDB7MEC6VO5KOCNQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.797374871 (32h8m42.58071497s) [noise=true , address=212.102.52.215:4370 , piece_id=G4KPC43PMM4KBBYPINQ6LNJFP3NTB64EOULKDLNHZWNRUSHWN6LA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.797853234 (32h8m42.581193333s) [noise=true , address=212.102.52.217:4433 , piece_id=67DJP7FXERAPOUDXCYSWUMGN4T6THOPCVGXUELTP7FTWLKCBVRHA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.800043733 (32h8m42.583383832s) [noise=true , address=212.102.52.215:4381 , piece_id=2YAZGZDGQJJV6E24Y44RJXAIAZ3RMISLRX6O43LCIMLZCG3CM6UQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.802311351 (32h8m42.58565144s) [noise=true , address=212.102.52.215:4387 , piece_id=KS33ZTOBOV44QBFP7PA2YFB233WUSPTHTSXVUPX7IX4MDPJQWRTQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.803925611 (32h8m42.58726571s) [noise=true , address=212.102.52.216:4405 , piece_id=PFKQTBP6RN4YR4QYDEQQ3NQZQR5OPGWZJC73RBMMMQEXX54XSOBQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.809985033 (32h8m42.593325132s) [noise=true , address=212.102.52.214:4361 , piece_id=25CKSDWDXDQJMSLFBKA325YMHZIGDCI3MTVELOLHX2WDODTZ4G4Q, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.813255723 (32h8m42.596595822s) [noise=true , address=212.102.52.216:4400 , piece_id=Z6K5X5RXBACRU5XSF7HGGKSU36RKXRIW2ZKCRISS3BA4G263TRQQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814265039 (32h8m42.597605138s) [noise=true , address=212.102.52.216:4401 , piece_id=VYX7MEZWRAY5QIR77P5DB747OGZ3WARGQGXI6Q35M5SEQ4OAILYA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814932904 (32h8m42.598273023s) [noise=true , address=212.102.52.214:4356 , piece_id=EQRJBTEKQE53XRWUB5UCBJWMI5TI5CHI76VS7ESVDU6ENYNJNNOQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814944145 (32h8m42.598284244s) [seg_pos={0 0}, upload=30773]: Satisfied cohort requirements after 16 pieces May 26 10:12:56.815185655 (32h8m42.598525754s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ufZvREiiPSyPZ7fvKWVEcCn3E84nCiu6aYxe9n6wP4kKf43hY): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815193560 (32h8m42.598533659s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815219931 (32h8m42.59856003s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BiVenoRJiFZVtT6vhvPQLfz3pScWYJ1r2X9CLRg2F2jc8MALC): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815232726 (32h8m42.598572855s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815417979 (32h8m42.598758068s) [noise=true , address=212.102.52.214:4366 , piece_id=JOJAZM7P2L3CAVI3DE4TS5XG65AHLG5IOZM2X5DAXH7K5TPULX4A, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MbNn3rECMrMhp1uJJRHy8v3DZkKaBEcZGwPMGumvPUvvKu5gM): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815423409 (32h8m42.598763508s) [noise=true , address=212.102.52.214:4366 , piece_id=JOJAZM7P2L3CAVI3DE4TS5XG65AHLG5IOZM2X5DAXH7K5TPULX4A, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815511197 (32h8m42.598851296s) [noise=true , address=212.102.52.214:4362 , piece_id=2OKRG7ZMPJYL7D4OEXZHKVKYNXCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815519633 (32h8m42.598859732s) [noise=true , address=212.102.52.214:4362 , piece_id=2OKRG7ZMPJYL7D4OEXZHKVKYNXCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815536816 (32h8m42.598876915s) [seg_pos={0 0}, upload=30773]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 10:12:56.815619714 (32h8m42.598959813s) [upload=30773]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 10:12:56.815623582 (32h8m42.598963681s) [upload=30773]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 10:13:38.419790892 (32h9m24.203130991s) [upload=30773]: Done uploading segments... May 26 10:13:38.419850966 (32h9m24.203191065s) [upload=30773]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.065806789s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 6 out of 60 is failed (threshold=3) [..............X..............X...X....X.........X.......X...] duration: 5.944946519s trace: https://jaeger.dev.storj.io/trace/1321cf158342be9d FAIL (2026-05-26 10:14:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== XCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427018428 (32h8m41.210358527s) [noise=true , address=212.102.52.213:4334 , piece_id=ZWXHBNCMW7MEFYRM6SXFRKG2GIBZ5ZFLM2SWVDB7MEC6VO5KOCNQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427311697 (32h8m41.210651797s) [noise=true , address=212.102.52.217:4418 , piece_id=MSRUBKKWVUA5TO3T6K3ZXZRVOAXXI2SV7NG745HGWRZCYJZPQE4A, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427732831 (32h8m41.21107293s) [noise=true , address=212.102.52.216:4405 , piece_id=PFKQTBP6RN4YR4QYDEQQ3NQZQR5OPGWZJC73RBMMMQEXX54XSOBQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.428258494 (32h8m41.211598594s) [noise=true , address=212.102.52.216:4400 , piece_id=Z6K5X5RXBACRU5XSF7HGGKSU36RKXRIW2ZKCRISS3BA4G263TRQQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.429342422 (32h8m41.212682521s) [noise=true , address=212.102.52.214:4361 , piece_id=25CKSDWDXDQJMSLFBKA325YMHZIGDCI3MTVELOLHX2WDODTZ4G4Q, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.429548004 (32h8m41.212888103s) [noise=true , address=212.102.52.215:4387 , piece_id=KS33ZTOBOV44QBFP7PA2YFB233WUSPTHTSXVUPX7IX4MDPJQWRTQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.430337871 (32h8m41.21367797s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.430838096 (32h8m41.214178195s) [noise=true , address=212.102.52.215:4370 , piece_id=G4KPC43PMM4KBBYPINQ6LNJFP3NTB64EOULKDLNHZWNRUSHWN6LA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.431382174 (32h8m41.214722273s) [noise=true , address=212.102.52.216:4401 , piece_id=VYX7MEZWRAY5QIR77P5DB747OGZ3WARGQGXI6Q35M5SEQ4OAILYA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.432365170 (32h8m41.215705269s) [noise=true , address=212.102.52.214:4356 , piece_id=EQRJBTEKQE53XRWUB5UCBJWMI5TI5CHI76VS7ESVDU6ENYNJNNOQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.435150415 (32h8m41.218490514s) [noise=true , address=212.102.52.215:4381 , piece_id=2YAZGZDGQJJV6E24Y44RJXAIAZ3RMISLRX6O43LCIMLZCG3CM6UQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.437499377 (32h8m41.220839466s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.439247412 (32h8m41.222587511s) [noise=true , address=212.102.52.217:4419 , piece_id=PFWQMUXSAX6C7YUJUGEYBGWDUTBTQC7F7KPL2ZNJE24ZR63KG2RQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.440309829 (32h8m41.223649928s) [noise=true , address=212.102.52.217:4439 , piece_id=V236RZC26VCPLCY5Q7TTMA6R2PRT4CER6VTTFMIDQSFSEVWTW2IA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.440619900 (32h8m41.22396s) [noise=true , address=212.102.52.217:4433 , piece_id=67DJP7FXERAPOUDXCYSWUMGN4T6THOPCVGXUELTP7FTWLKCBVRHA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:56.505315534 (32h8m42.288655633s) [upload=30773]: Next returned nil segment May 26 10:12:56.505326887 (32h8m42.288666976s) [upload=30773]: Waiting for error group managing segments... May 26 10:12:56.786132791 (32h8m42.56947289s) [noise=true , address=212.102.52.217:4418 , piece_id=MSRUBKKWVUA5TO3T6K3ZXZRVOAXXI2SV7NG745HGWRZCYJZPQE4A, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.793687145 (32h8m42.577027244s) [noise=true , address=212.102.52.217:4419 , piece_id=PFWQMUXSAX6C7YUJUGEYBGWDUTBTQC7F7KPL2ZNJE24ZR63KG2RQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.794583265 (32h8m42.577923354s) [noise=true , address=212.102.52.217:4439 , piece_id=V236RZC26VCPLCY5Q7TTMA6R2PRT4CER6VTTFMIDQSFSEVWTW2IA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795374805 (32h8m42.578714934s) [noise=true , address=212.102.52.213:4329 , piece_id=VCE7AJFHTXECGW6IQ3T4XMCISQVDRM7KVXDIJJFUNFQTTFBO6NIQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795566350 (32h8m42.57890645s) [noise=true , address=212.102.52.213:4332 , piece_id=ZS2NROQDSVY52Q5EETXC2C7LQOSG35KDZO5IRZUX6ZSEYKSHYTFQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795768947 (32h8m42.579109046s) [noise=true , address=212.102.52.213:4333 , piece_id=7FHEGSQNAV7WU3LZSQ24CWD7NXOLPI7H5MHDDX5FJFIJZLTQEFSQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.796537273 (32h8m42.579877362s) [noise=true , address=212.102.52.213:4334 , piece_id=ZWXHBNCMW7MEFYRM6SXFRKG2GIBZ5ZFLM2SWVDB7MEC6VO5KOCNQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.797374871 (32h8m42.58071497s) [noise=true , address=212.102.52.215:4370 , piece_id=G4KPC43PMM4KBBYPINQ6LNJFP3NTB64EOULKDLNHZWNRUSHWN6LA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.797853234 (32h8m42.581193333s) [noise=true , address=212.102.52.217:4433 , piece_id=67DJP7FXERAPOUDXCYSWUMGN4T6THOPCVGXUELTP7FTWLKCBVRHA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.800043733 (32h8m42.583383832s) [noise=true , address=212.102.52.215:4381 , piece_id=2YAZGZDGQJJV6E24Y44RJXAIAZ3RMISLRX6O43LCIMLZCG3CM6UQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.802311351 (32h8m42.58565144s) [noise=true , address=212.102.52.215:4387 , piece_id=KS33ZTOBOV44QBFP7PA2YFB233WUSPTHTSXVUPX7IX4MDPJQWRTQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.803925611 (32h8m42.58726571s) [noise=true , address=212.102.52.216:4405 , piece_id=PFKQTBP6RN4YR4QYDEQQ3NQZQR5OPGWZJC73RBMMMQEXX54XSOBQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.809985033 (32h8m42.593325132s) [noise=true , address=212.102.52.214:4361 , piece_id=25CKSDWDXDQJMSLFBKA325YMHZIGDCI3MTVELOLHX2WDODTZ4G4Q, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.813255723 (32h8m42.596595822s) [noise=true , address=212.102.52.216:4400 , piece_id=Z6K5X5RXBACRU5XSF7HGGKSU36RKXRIW2ZKCRISS3BA4G263TRQQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814265039 (32h8m42.597605138s) [noise=true , address=212.102.52.216:4401 , piece_id=VYX7MEZWRAY5QIR77P5DB747OGZ3WARGQGXI6Q35M5SEQ4OAILYA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814932904 (32h8m42.598273023s) [noise=true , address=212.102.52.214:4356 , piece_id=EQRJBTEKQE53XRWUB5UCBJWMI5TI5CHI76VS7ESVDU6ENYNJNNOQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814944145 (32h8m42.598284244s) [seg_pos={0 0}, upload=30773]: Satisfied cohort requirements after 16 pieces May 26 10:12:56.815185655 (32h8m42.598525754s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ufZvREiiPSyPZ7fvKWVEcCn3E84nCiu6aYxe9n6wP4kKf43hY): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815193560 (32h8m42.598533659s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815219931 (32h8m42.59856003s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BiVenoRJiFZVtT6vhvPQLfz3pScWYJ1r2X9CLRg2F2jc8MALC): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815232726 (32h8m42.598572855s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815417979 (32h8m42.598758068s) [noise=true , address=212.102.52.214:4366 , piece_id=JOJAZM7P2L3CAVI3DE4TS5XG65AHLG5IOZM2X5DAXH7K5TPULX4A, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MbNn3rECMrMhp1uJJRHy8v3DZkKaBEcZGwPMGumvPUvvKu5gM): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815423409 (32h8m42.598763508s) [noise=true , address=212.102.52.214:4366 , piece_id=JOJAZM7P2L3CAVI3DE4TS5XG65AHLG5IOZM2X5DAXH7K5TPULX4A, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815511197 (32h8m42.598851296s) [noise=true , address=212.102.52.214:4362 , piece_id=2OKRG7ZMPJYL7D4OEXZHKVKYNXCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815519633 (32h8m42.598859732s) [noise=true , address=212.102.52.214:4362 , piece_id=2OKRG7ZMPJYL7D4OEXZHKVKYNXCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815536816 (32h8m42.598876915s) [seg_pos={0 0}, upload=30773]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 10:12:56.815619714 (32h8m42.598959813s) [upload=30773]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 10:12:56.815623582 (32h8m42.598963681s) [upload=30773]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 10:13:38.419790892 (32h9m24.203130991s) [upload=30773]: Done uploading segments... May 26 10:13:38.419850966 (32h9m24.203191065s) [upload=30773]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.944958031s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..............X.............................................] duration: 3.753615895s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:14:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.753637977s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...............X............................................] duration: 3.725141083s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:14:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.725161883s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 6 out of 60 is failed (threshold=3) [...............X..............X...X....X.........X.......X..] duration: 5.346759955s trace: https://jaeger.dev.storj.io/trace/1321cf158342be9d FAIL (2026-05-26 10:14:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== XCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427018428 (32h8m41.210358527s) [noise=true , address=212.102.52.213:4334 , piece_id=ZWXHBNCMW7MEFYRM6SXFRKG2GIBZ5ZFLM2SWVDB7MEC6VO5KOCNQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427311697 (32h8m41.210651797s) [noise=true , address=212.102.52.217:4418 , piece_id=MSRUBKKWVUA5TO3T6K3ZXZRVOAXXI2SV7NG745HGWRZCYJZPQE4A, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427732831 (32h8m41.21107293s) [noise=true , address=212.102.52.216:4405 , piece_id=PFKQTBP6RN4YR4QYDEQQ3NQZQR5OPGWZJC73RBMMMQEXX54XSOBQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.428258494 (32h8m41.211598594s) [noise=true , address=212.102.52.216:4400 , piece_id=Z6K5X5RXBACRU5XSF7HGGKSU36RKXRIW2ZKCRISS3BA4G263TRQQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.429342422 (32h8m41.212682521s) [noise=true , address=212.102.52.214:4361 , piece_id=25CKSDWDXDQJMSLFBKA325YMHZIGDCI3MTVELOLHX2WDODTZ4G4Q, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.429548004 (32h8m41.212888103s) [noise=true , address=212.102.52.215:4387 , piece_id=KS33ZTOBOV44QBFP7PA2YFB233WUSPTHTSXVUPX7IX4MDPJQWRTQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.430337871 (32h8m41.21367797s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.430838096 (32h8m41.214178195s) [noise=true , address=212.102.52.215:4370 , piece_id=G4KPC43PMM4KBBYPINQ6LNJFP3NTB64EOULKDLNHZWNRUSHWN6LA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.431382174 (32h8m41.214722273s) [noise=true , address=212.102.52.216:4401 , piece_id=VYX7MEZWRAY5QIR77P5DB747OGZ3WARGQGXI6Q35M5SEQ4OAILYA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.432365170 (32h8m41.215705269s) [noise=true , address=212.102.52.214:4356 , piece_id=EQRJBTEKQE53XRWUB5UCBJWMI5TI5CHI76VS7ESVDU6ENYNJNNOQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.435150415 (32h8m41.218490514s) [noise=true , address=212.102.52.215:4381 , piece_id=2YAZGZDGQJJV6E24Y44RJXAIAZ3RMISLRX6O43LCIMLZCG3CM6UQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.437499377 (32h8m41.220839466s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.439247412 (32h8m41.222587511s) [noise=true , address=212.102.52.217:4419 , piece_id=PFWQMUXSAX6C7YUJUGEYBGWDUTBTQC7F7KPL2ZNJE24ZR63KG2RQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.440309829 (32h8m41.223649928s) [noise=true , address=212.102.52.217:4439 , piece_id=V236RZC26VCPLCY5Q7TTMA6R2PRT4CER6VTTFMIDQSFSEVWTW2IA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.440619900 (32h8m41.22396s) [noise=true , address=212.102.52.217:4433 , piece_id=67DJP7FXERAPOUDXCYSWUMGN4T6THOPCVGXUELTP7FTWLKCBVRHA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:56.505315534 (32h8m42.288655633s) [upload=30773]: Next returned nil segment May 26 10:12:56.505326887 (32h8m42.288666976s) [upload=30773]: Waiting for error group managing segments... May 26 10:12:56.786132791 (32h8m42.56947289s) [noise=true , address=212.102.52.217:4418 , piece_id=MSRUBKKWVUA5TO3T6K3ZXZRVOAXXI2SV7NG745HGWRZCYJZPQE4A, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.793687145 (32h8m42.577027244s) [noise=true , address=212.102.52.217:4419 , piece_id=PFWQMUXSAX6C7YUJUGEYBGWDUTBTQC7F7KPL2ZNJE24ZR63KG2RQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.794583265 (32h8m42.577923354s) [noise=true , address=212.102.52.217:4439 , piece_id=V236RZC26VCPLCY5Q7TTMA6R2PRT4CER6VTTFMIDQSFSEVWTW2IA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795374805 (32h8m42.578714934s) [noise=true , address=212.102.52.213:4329 , piece_id=VCE7AJFHTXECGW6IQ3T4XMCISQVDRM7KVXDIJJFUNFQTTFBO6NIQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795566350 (32h8m42.57890645s) [noise=true , address=212.102.52.213:4332 , piece_id=ZS2NROQDSVY52Q5EETXC2C7LQOSG35KDZO5IRZUX6ZSEYKSHYTFQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795768947 (32h8m42.579109046s) [noise=true , address=212.102.52.213:4333 , piece_id=7FHEGSQNAV7WU3LZSQ24CWD7NXOLPI7H5MHDDX5FJFIJZLTQEFSQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.796537273 (32h8m42.579877362s) [noise=true , address=212.102.52.213:4334 , piece_id=ZWXHBNCMW7MEFYRM6SXFRKG2GIBZ5ZFLM2SWVDB7MEC6VO5KOCNQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.797374871 (32h8m42.58071497s) [noise=true , address=212.102.52.215:4370 , piece_id=G4KPC43PMM4KBBYPINQ6LNJFP3NTB64EOULKDLNHZWNRUSHWN6LA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.797853234 (32h8m42.581193333s) [noise=true , address=212.102.52.217:4433 , piece_id=67DJP7FXERAPOUDXCYSWUMGN4T6THOPCVGXUELTP7FTWLKCBVRHA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.800043733 (32h8m42.583383832s) [noise=true , address=212.102.52.215:4381 , piece_id=2YAZGZDGQJJV6E24Y44RJXAIAZ3RMISLRX6O43LCIMLZCG3CM6UQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.802311351 (32h8m42.58565144s) [noise=true , address=212.102.52.215:4387 , piece_id=KS33ZTOBOV44QBFP7PA2YFB233WUSPTHTSXVUPX7IX4MDPJQWRTQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.803925611 (32h8m42.58726571s) [noise=true , address=212.102.52.216:4405 , piece_id=PFKQTBP6RN4YR4QYDEQQ3NQZQR5OPGWZJC73RBMMMQEXX54XSOBQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.809985033 (32h8m42.593325132s) [noise=true , address=212.102.52.214:4361 , piece_id=25CKSDWDXDQJMSLFBKA325YMHZIGDCI3MTVELOLHX2WDODTZ4G4Q, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.813255723 (32h8m42.596595822s) [noise=true , address=212.102.52.216:4400 , piece_id=Z6K5X5RXBACRU5XSF7HGGKSU36RKXRIW2ZKCRISS3BA4G263TRQQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814265039 (32h8m42.597605138s) [noise=true , address=212.102.52.216:4401 , piece_id=VYX7MEZWRAY5QIR77P5DB747OGZ3WARGQGXI6Q35M5SEQ4OAILYA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814932904 (32h8m42.598273023s) [noise=true , address=212.102.52.214:4356 , piece_id=EQRJBTEKQE53XRWUB5UCBJWMI5TI5CHI76VS7ESVDU6ENYNJNNOQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814944145 (32h8m42.598284244s) [seg_pos={0 0}, upload=30773]: Satisfied cohort requirements after 16 pieces May 26 10:12:56.815185655 (32h8m42.598525754s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ufZvREiiPSyPZ7fvKWVEcCn3E84nCiu6aYxe9n6wP4kKf43hY): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815193560 (32h8m42.598533659s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815219931 (32h8m42.59856003s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BiVenoRJiFZVtT6vhvPQLfz3pScWYJ1r2X9CLRg2F2jc8MALC): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815232726 (32h8m42.598572855s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815417979 (32h8m42.598758068s) [noise=true , address=212.102.52.214:4366 , piece_id=JOJAZM7P2L3CAVI3DE4TS5XG65AHLG5IOZM2X5DAXH7K5TPULX4A, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MbNn3rECMrMhp1uJJRHy8v3DZkKaBEcZGwPMGumvPUvvKu5gM): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815423409 (32h8m42.598763508s) [noise=true , address=212.102.52.214:4366 , piece_id=JOJAZM7P2L3CAVI3DE4TS5XG65AHLG5IOZM2X5DAXH7K5TPULX4A, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815511197 (32h8m42.598851296s) [noise=true , address=212.102.52.214:4362 , piece_id=2OKRG7ZMPJYL7D4OEXZHKVKYNXCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815519633 (32h8m42.598859732s) [noise=true , address=212.102.52.214:4362 , piece_id=2OKRG7ZMPJYL7D4OEXZHKVKYNXCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815536816 (32h8m42.598876915s) [seg_pos={0 0}, upload=30773]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 10:12:56.815619714 (32h8m42.598959813s) [upload=30773]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 10:12:56.815623582 (32h8m42.598963681s) [upload=30773]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 10:13:38.419790892 (32h9m24.203130991s) [upload=30773]: Done uploading segments... May 26 10:13:38.419850966 (32h9m24.203191065s) [upload=30773]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.346780674s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 6 out of 60 is failed (threshold=3) [................X..............X...X....X.........X.......X.] duration: 3.95743201s trace: https://jaeger.dev.storj.io/trace/1321cf158342be9d FAIL (2026-05-26 10:13:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== XCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427018428 (32h8m41.210358527s) [noise=true , address=212.102.52.213:4334 , piece_id=ZWXHBNCMW7MEFYRM6SXFRKG2GIBZ5ZFLM2SWVDB7MEC6VO5KOCNQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427311697 (32h8m41.210651797s) [noise=true , address=212.102.52.217:4418 , piece_id=MSRUBKKWVUA5TO3T6K3ZXZRVOAXXI2SV7NG745HGWRZCYJZPQE4A, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427732831 (32h8m41.21107293s) [noise=true , address=212.102.52.216:4405 , piece_id=PFKQTBP6RN4YR4QYDEQQ3NQZQR5OPGWZJC73RBMMMQEXX54XSOBQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.428258494 (32h8m41.211598594s) [noise=true , address=212.102.52.216:4400 , piece_id=Z6K5X5RXBACRU5XSF7HGGKSU36RKXRIW2ZKCRISS3BA4G263TRQQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.429342422 (32h8m41.212682521s) [noise=true , address=212.102.52.214:4361 , piece_id=25CKSDWDXDQJMSLFBKA325YMHZIGDCI3MTVELOLHX2WDODTZ4G4Q, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.429548004 (32h8m41.212888103s) [noise=true , address=212.102.52.215:4387 , piece_id=KS33ZTOBOV44QBFP7PA2YFB233WUSPTHTSXVUPX7IX4MDPJQWRTQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.430337871 (32h8m41.21367797s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.430838096 (32h8m41.214178195s) [noise=true , address=212.102.52.215:4370 , piece_id=G4KPC43PMM4KBBYPINQ6LNJFP3NTB64EOULKDLNHZWNRUSHWN6LA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.431382174 (32h8m41.214722273s) [noise=true , address=212.102.52.216:4401 , piece_id=VYX7MEZWRAY5QIR77P5DB747OGZ3WARGQGXI6Q35M5SEQ4OAILYA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.432365170 (32h8m41.215705269s) [noise=true , address=212.102.52.214:4356 , piece_id=EQRJBTEKQE53XRWUB5UCBJWMI5TI5CHI76VS7ESVDU6ENYNJNNOQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.435150415 (32h8m41.218490514s) [noise=true , address=212.102.52.215:4381 , piece_id=2YAZGZDGQJJV6E24Y44RJXAIAZ3RMISLRX6O43LCIMLZCG3CM6UQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.437499377 (32h8m41.220839466s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.439247412 (32h8m41.222587511s) [noise=true , address=212.102.52.217:4419 , piece_id=PFWQMUXSAX6C7YUJUGEYBGWDUTBTQC7F7KPL2ZNJE24ZR63KG2RQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.440309829 (32h8m41.223649928s) [noise=true , address=212.102.52.217:4439 , piece_id=V236RZC26VCPLCY5Q7TTMA6R2PRT4CER6VTTFMIDQSFSEVWTW2IA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.440619900 (32h8m41.22396s) [noise=true , address=212.102.52.217:4433 , piece_id=67DJP7FXERAPOUDXCYSWUMGN4T6THOPCVGXUELTP7FTWLKCBVRHA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:56.505315534 (32h8m42.288655633s) [upload=30773]: Next returned nil segment May 26 10:12:56.505326887 (32h8m42.288666976s) [upload=30773]: Waiting for error group managing segments... May 26 10:12:56.786132791 (32h8m42.56947289s) [noise=true , address=212.102.52.217:4418 , piece_id=MSRUBKKWVUA5TO3T6K3ZXZRVOAXXI2SV7NG745HGWRZCYJZPQE4A, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.793687145 (32h8m42.577027244s) [noise=true , address=212.102.52.217:4419 , piece_id=PFWQMUXSAX6C7YUJUGEYBGWDUTBTQC7F7KPL2ZNJE24ZR63KG2RQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.794583265 (32h8m42.577923354s) [noise=true , address=212.102.52.217:4439 , piece_id=V236RZC26VCPLCY5Q7TTMA6R2PRT4CER6VTTFMIDQSFSEVWTW2IA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795374805 (32h8m42.578714934s) [noise=true , address=212.102.52.213:4329 , piece_id=VCE7AJFHTXECGW6IQ3T4XMCISQVDRM7KVXDIJJFUNFQTTFBO6NIQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795566350 (32h8m42.57890645s) [noise=true , address=212.102.52.213:4332 , piece_id=ZS2NROQDSVY52Q5EETXC2C7LQOSG35KDZO5IRZUX6ZSEYKSHYTFQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795768947 (32h8m42.579109046s) [noise=true , address=212.102.52.213:4333 , piece_id=7FHEGSQNAV7WU3LZSQ24CWD7NXOLPI7H5MHDDX5FJFIJZLTQEFSQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.796537273 (32h8m42.579877362s) [noise=true , address=212.102.52.213:4334 , piece_id=ZWXHBNCMW7MEFYRM6SXFRKG2GIBZ5ZFLM2SWVDB7MEC6VO5KOCNQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.797374871 (32h8m42.58071497s) [noise=true , address=212.102.52.215:4370 , piece_id=G4KPC43PMM4KBBYPINQ6LNJFP3NTB64EOULKDLNHZWNRUSHWN6LA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.797853234 (32h8m42.581193333s) [noise=true , address=212.102.52.217:4433 , piece_id=67DJP7FXERAPOUDXCYSWUMGN4T6THOPCVGXUELTP7FTWLKCBVRHA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.800043733 (32h8m42.583383832s) [noise=true , address=212.102.52.215:4381 , piece_id=2YAZGZDGQJJV6E24Y44RJXAIAZ3RMISLRX6O43LCIMLZCG3CM6UQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.802311351 (32h8m42.58565144s) [noise=true , address=212.102.52.215:4387 , piece_id=KS33ZTOBOV44QBFP7PA2YFB233WUSPTHTSXVUPX7IX4MDPJQWRTQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.803925611 (32h8m42.58726571s) [noise=true , address=212.102.52.216:4405 , piece_id=PFKQTBP6RN4YR4QYDEQQ3NQZQR5OPGWZJC73RBMMMQEXX54XSOBQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.809985033 (32h8m42.593325132s) [noise=true , address=212.102.52.214:4361 , piece_id=25CKSDWDXDQJMSLFBKA325YMHZIGDCI3MTVELOLHX2WDODTZ4G4Q, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.813255723 (32h8m42.596595822s) [noise=true , address=212.102.52.216:4400 , piece_id=Z6K5X5RXBACRU5XSF7HGGKSU36RKXRIW2ZKCRISS3BA4G263TRQQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814265039 (32h8m42.597605138s) [noise=true , address=212.102.52.216:4401 , piece_id=VYX7MEZWRAY5QIR77P5DB747OGZ3WARGQGXI6Q35M5SEQ4OAILYA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814932904 (32h8m42.598273023s) [noise=true , address=212.102.52.214:4356 , piece_id=EQRJBTEKQE53XRWUB5UCBJWMI5TI5CHI76VS7ESVDU6ENYNJNNOQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814944145 (32h8m42.598284244s) [seg_pos={0 0}, upload=30773]: Satisfied cohort requirements after 16 pieces May 26 10:12:56.815185655 (32h8m42.598525754s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ufZvREiiPSyPZ7fvKWVEcCn3E84nCiu6aYxe9n6wP4kKf43hY): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815193560 (32h8m42.598533659s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815219931 (32h8m42.59856003s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BiVenoRJiFZVtT6vhvPQLfz3pScWYJ1r2X9CLRg2F2jc8MALC): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815232726 (32h8m42.598572855s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815417979 (32h8m42.598758068s) [noise=true , address=212.102.52.214:4366 , piece_id=JOJAZM7P2L3CAVI3DE4TS5XG65AHLG5IOZM2X5DAXH7K5TPULX4A, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MbNn3rECMrMhp1uJJRHy8v3DZkKaBEcZGwPMGumvPUvvKu5gM): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815423409 (32h8m42.598763508s) [noise=true , address=212.102.52.214:4366 , piece_id=JOJAZM7P2L3CAVI3DE4TS5XG65AHLG5IOZM2X5DAXH7K5TPULX4A, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815511197 (32h8m42.598851296s) [noise=true , address=212.102.52.214:4362 , piece_id=2OKRG7ZMPJYL7D4OEXZHKVKYNXCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815519633 (32h8m42.598859732s) [noise=true , address=212.102.52.214:4362 , piece_id=2OKRG7ZMPJYL7D4OEXZHKVKYNXCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815536816 (32h8m42.598876915s) [seg_pos={0 0}, upload=30773]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 10:12:56.815619714 (32h8m42.598959813s) [upload=30773]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 10:12:56.815623582 (32h8m42.598963681s) [upload=30773]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 10:13:38.419790892 (32h9m24.203130991s) [upload=30773]: Done uploading segments... May 26 10:13:38.419850966 (32h9m24.203191065s) [upload=30773]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.957475464s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 6 out of 60 is failed (threshold=3) [.................X..............X...X....X.........X.......X] duration: 1m13.424220306s trace: https://jaeger.dev.storj.io/trace/1321cf158342be9d FAIL (2026-05-26 10:13:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== XCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427018428 (32h8m41.210358527s) [noise=true , address=212.102.52.213:4334 , piece_id=ZWXHBNCMW7MEFYRM6SXFRKG2GIBZ5ZFLM2SWVDB7MEC6VO5KOCNQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427311697 (32h8m41.210651797s) [noise=true , address=212.102.52.217:4418 , piece_id=MSRUBKKWVUA5TO3T6K3ZXZRVOAXXI2SV7NG745HGWRZCYJZPQE4A, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.427732831 (32h8m41.21107293s) [noise=true , address=212.102.52.216:4405 , piece_id=PFKQTBP6RN4YR4QYDEQQ3NQZQR5OPGWZJC73RBMMMQEXX54XSOBQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.428258494 (32h8m41.211598594s) [noise=true , address=212.102.52.216:4400 , piece_id=Z6K5X5RXBACRU5XSF7HGGKSU36RKXRIW2ZKCRISS3BA4G263TRQQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.429342422 (32h8m41.212682521s) [noise=true , address=212.102.52.214:4361 , piece_id=25CKSDWDXDQJMSLFBKA325YMHZIGDCI3MTVELOLHX2WDODTZ4G4Q, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.429548004 (32h8m41.212888103s) [noise=true , address=212.102.52.215:4387 , piece_id=KS33ZTOBOV44QBFP7PA2YFB233WUSPTHTSXVUPX7IX4MDPJQWRTQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.430337871 (32h8m41.21367797s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.430838096 (32h8m41.214178195s) [noise=true , address=212.102.52.215:4370 , piece_id=G4KPC43PMM4KBBYPINQ6LNJFP3NTB64EOULKDLNHZWNRUSHWN6LA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.431382174 (32h8m41.214722273s) [noise=true , address=212.102.52.216:4401 , piece_id=VYX7MEZWRAY5QIR77P5DB747OGZ3WARGQGXI6Q35M5SEQ4OAILYA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.432365170 (32h8m41.215705269s) [noise=true , address=212.102.52.214:4356 , piece_id=EQRJBTEKQE53XRWUB5UCBJWMI5TI5CHI76VS7ESVDU6ENYNJNNOQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.435150415 (32h8m41.218490514s) [noise=true , address=212.102.52.215:4381 , piece_id=2YAZGZDGQJJV6E24Y44RJXAIAZ3RMISLRX6O43LCIMLZCG3CM6UQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.437499377 (32h8m41.220839466s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.439247412 (32h8m41.222587511s) [noise=true , address=212.102.52.217:4419 , piece_id=PFWQMUXSAX6C7YUJUGEYBGWDUTBTQC7F7KPL2ZNJE24ZR63KG2RQ, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.440309829 (32h8m41.223649928s) [noise=true , address=212.102.52.217:4439 , piece_id=V236RZC26VCPLCY5Q7TTMA6R2PRT4CER6VTTFMIDQSFSEVWTW2IA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:55.440619900 (32h8m41.22396s) [noise=true , address=212.102.52.217:4433 , piece_id=67DJP7FXERAPOUDXCYSWUMGN4T6THOPCVGXUELTP7FTWLKCBVRHA, seg_pos={0 0}, upload=30773]: Uploading piece... May 26 10:12:56.505315534 (32h8m42.288655633s) [upload=30773]: Next returned nil segment May 26 10:12:56.505326887 (32h8m42.288666976s) [upload=30773]: Waiting for error group managing segments... May 26 10:12:56.786132791 (32h8m42.56947289s) [noise=true , address=212.102.52.217:4418 , piece_id=MSRUBKKWVUA5TO3T6K3ZXZRVOAXXI2SV7NG745HGWRZCYJZPQE4A, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.793687145 (32h8m42.577027244s) [noise=true , address=212.102.52.217:4419 , piece_id=PFWQMUXSAX6C7YUJUGEYBGWDUTBTQC7F7KPL2ZNJE24ZR63KG2RQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.794583265 (32h8m42.577923354s) [noise=true , address=212.102.52.217:4439 , piece_id=V236RZC26VCPLCY5Q7TTMA6R2PRT4CER6VTTFMIDQSFSEVWTW2IA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795374805 (32h8m42.578714934s) [noise=true , address=212.102.52.213:4329 , piece_id=VCE7AJFHTXECGW6IQ3T4XMCISQVDRM7KVXDIJJFUNFQTTFBO6NIQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795566350 (32h8m42.57890645s) [noise=true , address=212.102.52.213:4332 , piece_id=ZS2NROQDSVY52Q5EETXC2C7LQOSG35KDZO5IRZUX6ZSEYKSHYTFQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.795768947 (32h8m42.579109046s) [noise=true , address=212.102.52.213:4333 , piece_id=7FHEGSQNAV7WU3LZSQ24CWD7NXOLPI7H5MHDDX5FJFIJZLTQEFSQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.796537273 (32h8m42.579877362s) [noise=true , address=212.102.52.213:4334 , piece_id=ZWXHBNCMW7MEFYRM6SXFRKG2GIBZ5ZFLM2SWVDB7MEC6VO5KOCNQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.797374871 (32h8m42.58071497s) [noise=true , address=212.102.52.215:4370 , piece_id=G4KPC43PMM4KBBYPINQ6LNJFP3NTB64EOULKDLNHZWNRUSHWN6LA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.797853234 (32h8m42.581193333s) [noise=true , address=212.102.52.217:4433 , piece_id=67DJP7FXERAPOUDXCYSWUMGN4T6THOPCVGXUELTP7FTWLKCBVRHA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.800043733 (32h8m42.583383832s) [noise=true , address=212.102.52.215:4381 , piece_id=2YAZGZDGQJJV6E24Y44RJXAIAZ3RMISLRX6O43LCIMLZCG3CM6UQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.802311351 (32h8m42.58565144s) [noise=true , address=212.102.52.215:4387 , piece_id=KS33ZTOBOV44QBFP7PA2YFB233WUSPTHTSXVUPX7IX4MDPJQWRTQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.803925611 (32h8m42.58726571s) [noise=true , address=212.102.52.216:4405 , piece_id=PFKQTBP6RN4YR4QYDEQQ3NQZQR5OPGWZJC73RBMMMQEXX54XSOBQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.809985033 (32h8m42.593325132s) [noise=true , address=212.102.52.214:4361 , piece_id=25CKSDWDXDQJMSLFBKA325YMHZIGDCI3MTVELOLHX2WDODTZ4G4Q, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.813255723 (32h8m42.596595822s) [noise=true , address=212.102.52.216:4400 , piece_id=Z6K5X5RXBACRU5XSF7HGGKSU36RKXRIW2ZKCRISS3BA4G263TRQQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814265039 (32h8m42.597605138s) [noise=true , address=212.102.52.216:4401 , piece_id=VYX7MEZWRAY5QIR77P5DB747OGZ3WARGQGXI6Q35M5SEQ4OAILYA, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814932904 (32h8m42.598273023s) [noise=true , address=212.102.52.214:4356 , piece_id=EQRJBTEKQE53XRWUB5UCBJWMI5TI5CHI76VS7ESVDU6ENYNJNNOQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: <nil> May 26 10:12:56.814944145 (32h8m42.598284244s) [seg_pos={0 0}, upload=30773]: Satisfied cohort requirements after 16 pieces May 26 10:12:56.815185655 (32h8m42.598525754s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ufZvREiiPSyPZ7fvKWVEcCn3E84nCiu6aYxe9n6wP4kKf43hY): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815193560 (32h8m42.598533659s) [noise=true , address=212.102.52.215:4371 , piece_id=HV6DQIIHYR6H4VKD5WBHFB6IQUOC2JXVKHIO2UBSDWZHCJUTMBHQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815219931 (32h8m42.59856003s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BiVenoRJiFZVtT6vhvPQLfz3pScWYJ1r2X9CLRg2F2jc8MALC): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815232726 (32h8m42.598572855s) [noise=true , address=212.102.52.216:4410 , piece_id=SR6IG6V6IXVI3QDHL3JJUPVK2LFGXERBULCWTWM74Q7RYBR2DWKQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815417979 (32h8m42.598758068s) [noise=true , address=212.102.52.214:4366 , piece_id=JOJAZM7P2L3CAVI3DE4TS5XG65AHLG5IOZM2X5DAXH7K5TPULX4A, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MbNn3rECMrMhp1uJJRHy8v3DZkKaBEcZGwPMGumvPUvvKu5gM): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815423409 (32h8m42.598763508s) [noise=true , address=212.102.52.214:4366 , piece_id=JOJAZM7P2L3CAVI3DE4TS5XG65AHLG5IOZM2X5DAXH7K5TPULX4A, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815511197 (32h8m42.598851296s) [noise=true , address=212.102.52.214:4362 , piece_id=2OKRG7ZMPJYL7D4OEXZHKVKYNXCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 26 10:12:56.815519633 (32h8m42.598859732s) [noise=true , address=212.102.52.214:4362 , piece_id=2OKRG7ZMPJYL7D4OEXZHKVKYNXCPABH6DQKIUVFFY3RL55SBTKAQ, seg_pos={0 0}, upload=30773]: Long tail cancellation due to optimal threshold May 26 10:12:56.815536816 (32h8m42.598876915s) [seg_pos={0 0}, upload=30773]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 10:12:56.815619714 (32h8m42.598959813s) [upload=30773]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 10:12:56.815623582 (32h8m42.598963681s) [upload=30773]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 10:13:38.419790892 (32h9m24.203130991s) [upload=30773]: Done uploading segments... May 26 10:13:38.419850966 (32h9m24.203191065s) [upload=30773]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m13.424236146s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [................X...........................................] duration: 3.801249795s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:13:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.80126236s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.................X..........................................] duration: 3.786794651s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:12:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.786814419s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 5 out of 60 is failed (threshold=3) [..................X..............X...X....X.........X.......] duration: 5.064322594s trace: https://jaeger.dev.storj.io/trace/7331054063047c7d FAIL (2026-05-26 10:11:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 10:06:38.429494862 (32h2m24.212834961s) [upload=30679]: Starting upload May 26 10:06:38.429528336 (32h2m24.212868435s) [upload=30679]: Done starting upload May 26 10:06:38.429582539 (32h2m24.212922628s) [upload=30679]: Uploading segments... May 26 10:06:38.429702087 (32h2m24.213042187s) [upload=30679]: Got next segment. Inline: false May 26 10:06:38.429729320 (32h2m24.213069419s) [upload=30679]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 10:06:38.429732706 (32h2m24.213072805s) [upload=30679]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 10:07:36.123411478 (32h3m21.906751577s) [upload=30679]: Next segment err: context deadline exceeded May 26 10:07:36.123730437 (32h3m21.907070536s) [upload=30679]: Done uploading segments... May 26 10:07:36.123774350 (32h3m21.907114449s) [upload=30679]: Upload finished. err: context deadline exceeded Duration: 5.064343114s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 5 out of 60 is failed (threshold=3) [...................X..............X...X....X.........X......] duration: 4.417030713s trace: https://jaeger.dev.storj.io/trace/7331054063047c7d FAIL (2026-05-26 10:11:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 10:06:38.429494862 (32h2m24.212834961s) [upload=30679]: Starting upload May 26 10:06:38.429528336 (32h2m24.212868435s) [upload=30679]: Done starting upload May 26 10:06:38.429582539 (32h2m24.212922628s) [upload=30679]: Uploading segments... May 26 10:06:38.429702087 (32h2m24.213042187s) [upload=30679]: Got next segment. Inline: false May 26 10:06:38.429729320 (32h2m24.213069419s) [upload=30679]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 10:06:38.429732706 (32h2m24.213072805s) [upload=30679]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 10:07:36.123411478 (32h3m21.906751577s) [upload=30679]: Next segment err: context deadline exceeded May 26 10:07:36.123730437 (32h3m21.907070536s) [upload=30679]: Done uploading segments... May 26 10:07:36.123774350 (32h3m21.907114449s) [upload=30679]: Upload finished. err: context deadline exceeded Duration: 4.417053145s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..................X.........................................] duration: 3.874750245s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:11:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.874789981s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...................X........................................] duration: 4.799414341s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:10:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.799435781s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 5 out of 60 is failed (threshold=3) [....................X..............X...X....X.........X.....] duration: 4.015578082s trace: https://jaeger.dev.storj.io/trace/7331054063047c7d FAIL (2026-05-26 10:10:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 10:06:38.429494862 (32h2m24.212834961s) [upload=30679]: Starting upload May 26 10:06:38.429528336 (32h2m24.212868435s) [upload=30679]: Done starting upload May 26 10:06:38.429582539 (32h2m24.212922628s) [upload=30679]: Uploading segments... May 26 10:06:38.429702087 (32h2m24.213042187s) [upload=30679]: Got next segment. Inline: false May 26 10:06:38.429729320 (32h2m24.213069419s) [upload=30679]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 10:06:38.429732706 (32h2m24.213072805s) [upload=30679]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 10:07:36.123411478 (32h3m21.906751577s) [upload=30679]: Next segment err: context deadline exceeded May 26 10:07:36.123730437 (32h3m21.907070536s) [upload=30679]: Done uploading segments... May 26 10:07:36.123774350 (32h3m21.907114449s) [upload=30679]: Upload finished. err: context deadline exceeded Duration: 4.015591638s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....................X.......................................] duration: 3.800988324s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:09:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.801010675s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 5 out of 60 is failed (threshold=3) [.....................X..............X...X....X.........X....] duration: 9.024649766s trace: https://jaeger.dev.storj.io/trace/7331054063047c7d FAIL (2026-05-26 10:09:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 10:06:38.429494862 (32h2m24.212834961s) [upload=30679]: Starting upload May 26 10:06:38.429528336 (32h2m24.212868435s) [upload=30679]: Done starting upload May 26 10:06:38.429582539 (32h2m24.212922628s) [upload=30679]: Uploading segments... May 26 10:06:38.429702087 (32h2m24.213042187s) [upload=30679]: Got next segment. Inline: false May 26 10:06:38.429729320 (32h2m24.213069419s) [upload=30679]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 10:06:38.429732706 (32h2m24.213072805s) [upload=30679]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 10:07:36.123411478 (32h3m21.906751577s) [upload=30679]: Next segment err: context deadline exceeded May 26 10:07:36.123730437 (32h3m21.907070536s) [upload=30679]: Done uploading segments... May 26 10:07:36.123774350 (32h3m21.907114449s) [upload=30679]: Upload finished. err: context deadline exceeded Duration: 9.024676458s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....................X......................................] duration: 3.875170792s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:09:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.875192643s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 5 out of 60 is failed (threshold=3) [......................X..............X...X....X.........X...] duration: 4.230491241s trace: https://jaeger.dev.storj.io/trace/7331054063047c7d FAIL (2026-05-26 10:08:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 10:06:38.429494862 (32h2m24.212834961s) [upload=30679]: Starting upload May 26 10:06:38.429528336 (32h2m24.212868435s) [upload=30679]: Done starting upload May 26 10:06:38.429582539 (32h2m24.212922628s) [upload=30679]: Uploading segments... May 26 10:06:38.429702087 (32h2m24.213042187s) [upload=30679]: Got next segment. Inline: false May 26 10:06:38.429729320 (32h2m24.213069419s) [upload=30679]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 10:06:38.429732706 (32h2m24.213072805s) [upload=30679]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 10:07:36.123411478 (32h3m21.906751577s) [upload=30679]: Next segment err: context deadline exceeded May 26 10:07:36.123730437 (32h3m21.907070536s) [upload=30679]: Done uploading segments... May 26 10:07:36.123774350 (32h3m21.907114449s) [upload=30679]: Upload finished. err: context deadline exceeded Duration: 4.230516388s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......................X.....................................] duration: 3.834818523s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:08:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.834841828s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 5 out of 60 is failed (threshold=3) [.......................X..............X...X....X.........X..] duration: 5.309345789s trace: https://jaeger.dev.storj.io/trace/7331054063047c7d FAIL (2026-05-26 10:08:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 10:06:38.429494862 (32h2m24.212834961s) [upload=30679]: Starting upload May 26 10:06:38.429528336 (32h2m24.212868435s) [upload=30679]: Done starting upload May 26 10:06:38.429582539 (32h2m24.212922628s) [upload=30679]: Uploading segments... May 26 10:06:38.429702087 (32h2m24.213042187s) [upload=30679]: Got next segment. Inline: false May 26 10:06:38.429729320 (32h2m24.213069419s) [upload=30679]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 10:06:38.429732706 (32h2m24.213072805s) [upload=30679]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 10:07:36.123411478 (32h3m21.906751577s) [upload=30679]: Next segment err: context deadline exceeded May 26 10:07:36.123730437 (32h3m21.907070536s) [upload=30679]: Done uploading segments... May 26 10:07:36.123774350 (32h3m21.907114449s) [upload=30679]: Upload finished. err: context deadline exceeded Duration: 5.309368373s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......................X....................................] duration: 3.772089364s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:07:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.772112289s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 5 out of 60 is failed (threshold=3) [........................X..............X...X....X.........X.] duration: 4.240777789s trace: https://jaeger.dev.storj.io/trace/7331054063047c7d FAIL (2026-05-26 10:07:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 10:06:38.429494862 (32h2m24.212834961s) [upload=30679]: Starting upload May 26 10:06:38.429528336 (32h2m24.212868435s) [upload=30679]: Done starting upload May 26 10:06:38.429582539 (32h2m24.212922628s) [upload=30679]: Uploading segments... May 26 10:06:38.429702087 (32h2m24.213042187s) [upload=30679]: Got next segment. Inline: false May 26 10:06:38.429729320 (32h2m24.213069419s) [upload=30679]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 10:06:38.429732706 (32h2m24.213072805s) [upload=30679]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 10:07:36.123411478 (32h3m21.906751577s) [upload=30679]: Next segment err: context deadline exceeded May 26 10:07:36.123730437 (32h3m21.907070536s) [upload=30679]: Done uploading segments... May 26 10:07:36.123774350 (32h3m21.907114449s) [upload=30679]: Upload finished. err: context deadline exceeded Duration: 4.240788659s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 5 out of 60 is failed (threshold=3) [.........................X..............X...X....X.........X] duration: 1m0.001574126s trace: https://jaeger.dev.storj.io/trace/7331054063047c7d FAIL (2026-05-26 10:07:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 10:06:38.429494862 (32h2m24.212834961s) [upload=30679]: Starting upload May 26 10:06:38.429528336 (32h2m24.212868435s) [upload=30679]: Done starting upload May 26 10:06:38.429582539 (32h2m24.212922628s) [upload=30679]: Uploading segments... May 26 10:06:38.429702087 (32h2m24.213042187s) [upload=30679]: Got next segment. Inline: false May 26 10:06:38.429729320 (32h2m24.213069419s) [upload=30679]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 10:06:38.429732706 (32h2m24.213072805s) [upload=30679]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 10:07:36.123411478 (32h3m21.906751577s) [upload=30679]: Next segment err: context deadline exceeded May 26 10:07:36.123730437 (32h3m21.907070536s) [upload=30679]: Done uploading segments... May 26 10:07:36.123774350 (32h3m21.907114449s) [upload=30679]: Upload finished. err: context deadline exceeded Duration: 1m0.00159162s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........................X...................................] duration: 3.702694804s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:06:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.702717056s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........................X..................................] duration: 3.785961772s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:06:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.785983915s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [..........................X..............X...X....X.........] duration: 4.157470985s trace: https://jaeger.dev.storj.io/trace/4ae0893df65c4124 FAIL (2026-05-26 10:06:05 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 4.157484881s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........................X.................................] duration: 3.595688693s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:05:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.59570304s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [...........................X..............X...X....X........] duration: 4.059110328s trace: https://jaeger.dev.storj.io/trace/4ae0893df65c4124 FAIL (2026-05-26 10:04:53 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 4.059122139s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................X................................] duration: 3.64747425s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:04:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.647497003s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 5 out of 60 is failed (threshold=3) [X...........................X..............X...X....X.......] duration: 4.127614765s trace: https://jaeger.dev.storj.io/trace/4ae0893df65c4124 FAIL (2026-05-26 10:04:07 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 4.127634953s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [............................X...............................] duration: 3.711561814s trace: https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26 FAIL (2026-05-26 10:03:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.711577514s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)