Orbiter History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 4.123960689s trace: https://jaeger.dev.storj.io/trace/10cf85c88fbff7f2 FAIL (2026-05-26 01:47:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 73305s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077219624 (23h8m32.860559723s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077607393 (23h8m32.860947482s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077996095 (23h8m32.861336194s) [seg_pos={0 0}, upload=22129]: Done begin upload segment. May 26 01:12:47.078027404 (23h8m32.861367503s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078373255 (23h8m32.861713354s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078598184 (23h8m32.861938283s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078926380 (23h8m32.862266479s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079225942 (23h8m32.862566041s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079519963 (23h8m32.862860052s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079775280 (23h8m32.863115379s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079945595 (23h8m32.863285694s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080458293 (23h8m32.863798392s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080778473 (23h8m32.864118573s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081079678 (23h8m32.864419777s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081435958 (23h8m32.864776057s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:48.142155727 (23h8m33.925495826s) [upload=22129]: Next returned nil segment May 26 01:12:48.142166708 (23h8m33.925506807s) [upload=22129]: Waiting for error group managing segments... May 26 01:12:48.422091343 (23h8m34.205431442s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.422758206 (23h8m34.206098295s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.423949939 (23h8m34.207290038s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.434367296 (23h8m34.217707395s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.435546887 (23h8m34.218886976s) [noise=true , address=212.102.52.213:4321 , piece_id=3KI2TVBA2G7OQKU2LQ6UHCDT5NT7FS6DTTTH2KXCXAGG4S3Z7EGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.437176967 (23h8m34.220517066s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.442827448 (23h8m34.226167547s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.445883780 (23h8m34.229223879s) [noise=true , address=212.102.52.217:4420 , piece_id=AUSAGK4RA5HZNSLETZ5O6XBHFAYUKB56ARIFUSDOAK5XJRGWUY3Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.448026138 (23h8m34.231366227s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.455811973 (23h8m34.239152073s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.456893056 (23h8m34.240233145s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.459265984 (23h8m34.242606083s) [noise=true , address=212.102.52.216:4411 , piece_id=I3IKFE7KKKO6K4UY4WT5ZOFSMNYXJZRYRWAXZ53Y6WPWS33VQJLQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.481083542 (23h8m34.264423641s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485409336 (23h8m34.268749435s) [noise=true , address=212.102.52.214:4357 , piece_id=F5SSZFAGJJM6OFBBCHP7BE6CZ6XADGZYY2356VENA6GBM3ZNQABQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485788209 (23h8m34.269128298s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489811155 (23h8m34.273151254s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489828819 (23h8m34.273168918s) [seg_pos={0 0}, upload=22129]: Satisfied cohort requirements after 16 pieces May 26 01:12:48.489984897 (23h8m34.273324996s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CUR4ziwaFaL7wLYxjArf8qYim7mzRtxobseMP1yBy3GAsWYPy): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.489990096 (23h8m34.273330185s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490143429 (23h8m34.273483528s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490152586 (23h8m34.273492675s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490170020 (23h8m34.273510119s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490179918 (23h8m34.273520007s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490253409 (23h8m34.273593498s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16niLmCkzYrrqsg6P7QNtpwXobbL79UjWi1YnHyKBPwZSQq3QW): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490259701 (23h8m34.27359979s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490279890 (23h8m34.273619989s) [seg_pos={0 0}, upload=22129]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 01:12:48.490334683 (23h8m34.273674782s) [upload=22129]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 01:12:48.490339794 (23h8m34.273679893s) [upload=22129]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 01:12:57.535364419 (23h8m43.318704518s) [upload=22129]: Done uploading segments... May 26 01:12:57.535408573 (23h8m43.318748672s) [upload=22129]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.123982832s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [....................X...................X...................] duration: 3.596862467s trace: https://jaeger.dev.storj.io/trace/366d6ef762a831a7 FAIL (2026-05-26 01:47:50 UTC) orbiter warning: context deadline exceeded Duration: 3.596878186s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 4.114176851s trace: https://jaeger.dev.storj.io/trace/10cf85c88fbff7f2 FAIL (2026-05-26 01:47:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 73305s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077219624 (23h8m32.860559723s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077607393 (23h8m32.860947482s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077996095 (23h8m32.861336194s) [seg_pos={0 0}, upload=22129]: Done begin upload segment. May 26 01:12:47.078027404 (23h8m32.861367503s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078373255 (23h8m32.861713354s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078598184 (23h8m32.861938283s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078926380 (23h8m32.862266479s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079225942 (23h8m32.862566041s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079519963 (23h8m32.862860052s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079775280 (23h8m32.863115379s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079945595 (23h8m32.863285694s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080458293 (23h8m32.863798392s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080778473 (23h8m32.864118573s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081079678 (23h8m32.864419777s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081435958 (23h8m32.864776057s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:48.142155727 (23h8m33.925495826s) [upload=22129]: Next returned nil segment May 26 01:12:48.142166708 (23h8m33.925506807s) [upload=22129]: Waiting for error group managing segments... May 26 01:12:48.422091343 (23h8m34.205431442s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.422758206 (23h8m34.206098295s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.423949939 (23h8m34.207290038s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.434367296 (23h8m34.217707395s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.435546887 (23h8m34.218886976s) [noise=true , address=212.102.52.213:4321 , piece_id=3KI2TVBA2G7OQKU2LQ6UHCDT5NT7FS6DTTTH2KXCXAGG4S3Z7EGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.437176967 (23h8m34.220517066s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.442827448 (23h8m34.226167547s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.445883780 (23h8m34.229223879s) [noise=true , address=212.102.52.217:4420 , piece_id=AUSAGK4RA5HZNSLETZ5O6XBHFAYUKB56ARIFUSDOAK5XJRGWUY3Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.448026138 (23h8m34.231366227s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.455811973 (23h8m34.239152073s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.456893056 (23h8m34.240233145s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.459265984 (23h8m34.242606083s) [noise=true , address=212.102.52.216:4411 , piece_id=I3IKFE7KKKO6K4UY4WT5ZOFSMNYXJZRYRWAXZ53Y6WPWS33VQJLQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.481083542 (23h8m34.264423641s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485409336 (23h8m34.268749435s) [noise=true , address=212.102.52.214:4357 , piece_id=F5SSZFAGJJM6OFBBCHP7BE6CZ6XADGZYY2356VENA6GBM3ZNQABQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485788209 (23h8m34.269128298s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489811155 (23h8m34.273151254s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489828819 (23h8m34.273168918s) [seg_pos={0 0}, upload=22129]: Satisfied cohort requirements after 16 pieces May 26 01:12:48.489984897 (23h8m34.273324996s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CUR4ziwaFaL7wLYxjArf8qYim7mzRtxobseMP1yBy3GAsWYPy): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.489990096 (23h8m34.273330185s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490143429 (23h8m34.273483528s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490152586 (23h8m34.273492675s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490170020 (23h8m34.273510119s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490179918 (23h8m34.273520007s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490253409 (23h8m34.273593498s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16niLmCkzYrrqsg6P7QNtpwXobbL79UjWi1YnHyKBPwZSQq3QW): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490259701 (23h8m34.27359979s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490279890 (23h8m34.273619989s) [seg_pos={0 0}, upload=22129]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 01:12:48.490334683 (23h8m34.273674782s) [upload=22129]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 01:12:48.490339794 (23h8m34.273679893s) [upload=22129]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 01:12:57.535364419 (23h8m43.318704518s) [upload=22129]: Done uploading segments... May 26 01:12:57.535408573 (23h8m43.318748672s) [upload=22129]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.114200998s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 37.41870687s trace: https://jaeger.dev.storj.io/trace/10cf85c88fbff7f2 FAIL (2026-05-26 01:47:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 73305s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077219624 (23h8m32.860559723s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077607393 (23h8m32.860947482s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077996095 (23h8m32.861336194s) [seg_pos={0 0}, upload=22129]: Done begin upload segment. May 26 01:12:47.078027404 (23h8m32.861367503s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078373255 (23h8m32.861713354s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078598184 (23h8m32.861938283s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078926380 (23h8m32.862266479s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079225942 (23h8m32.862566041s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079519963 (23h8m32.862860052s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079775280 (23h8m32.863115379s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079945595 (23h8m32.863285694s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080458293 (23h8m32.863798392s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080778473 (23h8m32.864118573s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081079678 (23h8m32.864419777s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081435958 (23h8m32.864776057s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:48.142155727 (23h8m33.925495826s) [upload=22129]: Next returned nil segment May 26 01:12:48.142166708 (23h8m33.925506807s) [upload=22129]: Waiting for error group managing segments... May 26 01:12:48.422091343 (23h8m34.205431442s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.422758206 (23h8m34.206098295s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.423949939 (23h8m34.207290038s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.434367296 (23h8m34.217707395s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.435546887 (23h8m34.218886976s) [noise=true , address=212.102.52.213:4321 , piece_id=3KI2TVBA2G7OQKU2LQ6UHCDT5NT7FS6DTTTH2KXCXAGG4S3Z7EGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.437176967 (23h8m34.220517066s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.442827448 (23h8m34.226167547s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.445883780 (23h8m34.229223879s) [noise=true , address=212.102.52.217:4420 , piece_id=AUSAGK4RA5HZNSLETZ5O6XBHFAYUKB56ARIFUSDOAK5XJRGWUY3Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.448026138 (23h8m34.231366227s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.455811973 (23h8m34.239152073s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.456893056 (23h8m34.240233145s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.459265984 (23h8m34.242606083s) [noise=true , address=212.102.52.216:4411 , piece_id=I3IKFE7KKKO6K4UY4WT5ZOFSMNYXJZRYRWAXZ53Y6WPWS33VQJLQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.481083542 (23h8m34.264423641s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485409336 (23h8m34.268749435s) [noise=true , address=212.102.52.214:4357 , piece_id=F5SSZFAGJJM6OFBBCHP7BE6CZ6XADGZYY2356VENA6GBM3ZNQABQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485788209 (23h8m34.269128298s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489811155 (23h8m34.273151254s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489828819 (23h8m34.273168918s) [seg_pos={0 0}, upload=22129]: Satisfied cohort requirements after 16 pieces May 26 01:12:48.489984897 (23h8m34.273324996s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CUR4ziwaFaL7wLYxjArf8qYim7mzRtxobseMP1yBy3GAsWYPy): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.489990096 (23h8m34.273330185s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490143429 (23h8m34.273483528s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490152586 (23h8m34.273492675s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490170020 (23h8m34.273510119s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490179918 (23h8m34.273520007s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490253409 (23h8m34.273593498s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16niLmCkzYrrqsg6P7QNtpwXobbL79UjWi1YnHyKBPwZSQq3QW): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490259701 (23h8m34.27359979s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490279890 (23h8m34.273619989s) [seg_pos={0 0}, upload=22129]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 01:12:48.490334683 (23h8m34.273674782s) [upload=22129]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 01:12:48.490339794 (23h8m34.273679893s) [upload=22129]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 01:12:57.535364419 (23h8m43.318704518s) [upload=22129]: Done uploading segments... May 26 01:12:57.535408573 (23h8m43.318748672s) [upload=22129]: Upload finished. err: metaclient: context deadline exceeded Duration: 37.418730896s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [....XX....X.......X..........XX.X...X..X...............X....] duration: 6.287348177s trace: https://jaeger.dev.storj.io/trace/bfb157cac09630c FAIL (2026-05-26 01:47:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.287368014s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.....................X...................X..................] duration: 3.556053222s trace: https://jaeger.dev.storj.io/trace/366d6ef762a831a7 FAIL (2026-05-26 01:46:49 UTC) orbiter warning: context deadline exceeded Duration: 3.556073441s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [.....XX....X.......X..........XX.X...X..X...............X...] duration: 28.988278777s trace: https://jaeger.dev.storj.io/trace/bfb157cac09630c FAIL (2026-05-26 01:46:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 28.988298565s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [......................X...................X.................] duration: 3.600414106s trace: https://jaeger.dev.storj.io/trace/366d6ef762a831a7 FAIL (2026-05-26 01:46:13 UTC) orbiter warning: context deadline exceeded Duration: 3.600435999s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [......XX....X.......X..........XX.X...X..X...............X..] duration: 6.411043292s trace: https://jaeger.dev.storj.io/trace/bfb157cac09630c FAIL (2026-05-26 01:45:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.411067027s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 4.209375344s trace: https://jaeger.dev.storj.io/trace/10cf85c88fbff7f2 FAIL (2026-05-26 01:45:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 73305s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077219624 (23h8m32.860559723s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077607393 (23h8m32.860947482s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077996095 (23h8m32.861336194s) [seg_pos={0 0}, upload=22129]: Done begin upload segment. May 26 01:12:47.078027404 (23h8m32.861367503s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078373255 (23h8m32.861713354s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078598184 (23h8m32.861938283s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078926380 (23h8m32.862266479s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079225942 (23h8m32.862566041s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079519963 (23h8m32.862860052s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079775280 (23h8m32.863115379s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079945595 (23h8m32.863285694s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080458293 (23h8m32.863798392s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080778473 (23h8m32.864118573s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081079678 (23h8m32.864419777s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081435958 (23h8m32.864776057s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:48.142155727 (23h8m33.925495826s) [upload=22129]: Next returned nil segment May 26 01:12:48.142166708 (23h8m33.925506807s) [upload=22129]: Waiting for error group managing segments... May 26 01:12:48.422091343 (23h8m34.205431442s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.422758206 (23h8m34.206098295s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.423949939 (23h8m34.207290038s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.434367296 (23h8m34.217707395s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.435546887 (23h8m34.218886976s) [noise=true , address=212.102.52.213:4321 , piece_id=3KI2TVBA2G7OQKU2LQ6UHCDT5NT7FS6DTTTH2KXCXAGG4S3Z7EGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.437176967 (23h8m34.220517066s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.442827448 (23h8m34.226167547s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.445883780 (23h8m34.229223879s) [noise=true , address=212.102.52.217:4420 , piece_id=AUSAGK4RA5HZNSLETZ5O6XBHFAYUKB56ARIFUSDOAK5XJRGWUY3Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.448026138 (23h8m34.231366227s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.455811973 (23h8m34.239152073s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.456893056 (23h8m34.240233145s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.459265984 (23h8m34.242606083s) [noise=true , address=212.102.52.216:4411 , piece_id=I3IKFE7KKKO6K4UY4WT5ZOFSMNYXJZRYRWAXZ53Y6WPWS33VQJLQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.481083542 (23h8m34.264423641s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485409336 (23h8m34.268749435s) [noise=true , address=212.102.52.214:4357 , piece_id=F5SSZFAGJJM6OFBBCHP7BE6CZ6XADGZYY2356VENA6GBM3ZNQABQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485788209 (23h8m34.269128298s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489811155 (23h8m34.273151254s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489828819 (23h8m34.273168918s) [seg_pos={0 0}, upload=22129]: Satisfied cohort requirements after 16 pieces May 26 01:12:48.489984897 (23h8m34.273324996s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CUR4ziwaFaL7wLYxjArf8qYim7mzRtxobseMP1yBy3GAsWYPy): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.489990096 (23h8m34.273330185s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490143429 (23h8m34.273483528s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490152586 (23h8m34.273492675s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490170020 (23h8m34.273510119s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490179918 (23h8m34.273520007s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490253409 (23h8m34.273593498s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16niLmCkzYrrqsg6P7QNtpwXobbL79UjWi1YnHyKBPwZSQq3QW): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490259701 (23h8m34.27359979s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490279890 (23h8m34.273619989s) [seg_pos={0 0}, upload=22129]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 01:12:48.490334683 (23h8m34.273674782s) [upload=22129]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 01:12:48.490339794 (23h8m34.273679893s) [upload=22129]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 01:12:57.535364419 (23h8m43.318704518s) [upload=22129]: Done uploading segments... May 26 01:12:57.535408573 (23h8m43.318748672s) [upload=22129]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.209398699s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [.......XX....X.......X..........XX.X...X..X...............X.] duration: 43.442648849s trace: https://jaeger.dev.storj.io/trace/bfb157cac09630c FAIL (2026-05-26 01:45:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 43.442659339s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.......................X...................X................] duration: 3.637397269s trace: https://jaeger.dev.storj.io/trace/366d6ef762a831a7 FAIL (2026-05-26 01:45:00 UTC) orbiter warning: context deadline exceeded Duration: 3.637417327s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [........XX....X.......X..........XX.X...X..X...............X] duration: 1m0.001029062s trace: https://jaeger.dev.storj.io/trace/bfb157cac09630c FAIL (2026-05-26 01:44:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001040433s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [........................X...................X...............] duration: 3.69127163s trace: https://jaeger.dev.storj.io/trace/366d6ef762a831a7 FAIL (2026-05-26 01:44:25 UTC) orbiter warning: context deadline exceeded Duration: 3.691293542s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 4.167354665s trace: https://jaeger.dev.storj.io/trace/10cf85c88fbff7f2 FAIL (2026-05-26 01:44:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 73305s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077219624 (23h8m32.860559723s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077607393 (23h8m32.860947482s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077996095 (23h8m32.861336194s) [seg_pos={0 0}, upload=22129]: Done begin upload segment. May 26 01:12:47.078027404 (23h8m32.861367503s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078373255 (23h8m32.861713354s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078598184 (23h8m32.861938283s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078926380 (23h8m32.862266479s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079225942 (23h8m32.862566041s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079519963 (23h8m32.862860052s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079775280 (23h8m32.863115379s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079945595 (23h8m32.863285694s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080458293 (23h8m32.863798392s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080778473 (23h8m32.864118573s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081079678 (23h8m32.864419777s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081435958 (23h8m32.864776057s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:48.142155727 (23h8m33.925495826s) [upload=22129]: Next returned nil segment May 26 01:12:48.142166708 (23h8m33.925506807s) [upload=22129]: Waiting for error group managing segments... May 26 01:12:48.422091343 (23h8m34.205431442s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.422758206 (23h8m34.206098295s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.423949939 (23h8m34.207290038s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.434367296 (23h8m34.217707395s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.435546887 (23h8m34.218886976s) [noise=true , address=212.102.52.213:4321 , piece_id=3KI2TVBA2G7OQKU2LQ6UHCDT5NT7FS6DTTTH2KXCXAGG4S3Z7EGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.437176967 (23h8m34.220517066s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.442827448 (23h8m34.226167547s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.445883780 (23h8m34.229223879s) [noise=true , address=212.102.52.217:4420 , piece_id=AUSAGK4RA5HZNSLETZ5O6XBHFAYUKB56ARIFUSDOAK5XJRGWUY3Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.448026138 (23h8m34.231366227s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.455811973 (23h8m34.239152073s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.456893056 (23h8m34.240233145s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.459265984 (23h8m34.242606083s) [noise=true , address=212.102.52.216:4411 , piece_id=I3IKFE7KKKO6K4UY4WT5ZOFSMNYXJZRYRWAXZ53Y6WPWS33VQJLQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.481083542 (23h8m34.264423641s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485409336 (23h8m34.268749435s) [noise=true , address=212.102.52.214:4357 , piece_id=F5SSZFAGJJM6OFBBCHP7BE6CZ6XADGZYY2356VENA6GBM3ZNQABQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485788209 (23h8m34.269128298s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489811155 (23h8m34.273151254s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489828819 (23h8m34.273168918s) [seg_pos={0 0}, upload=22129]: Satisfied cohort requirements after 16 pieces May 26 01:12:48.489984897 (23h8m34.273324996s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CUR4ziwaFaL7wLYxjArf8qYim7mzRtxobseMP1yBy3GAsWYPy): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.489990096 (23h8m34.273330185s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490143429 (23h8m34.273483528s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490152586 (23h8m34.273492675s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490170020 (23h8m34.273510119s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490179918 (23h8m34.273520007s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490253409 (23h8m34.273593498s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16niLmCkzYrrqsg6P7QNtpwXobbL79UjWi1YnHyKBPwZSQq3QW): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490259701 (23h8m34.27359979s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490279890 (23h8m34.273619989s) [seg_pos={0 0}, upload=22129]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 01:12:48.490334683 (23h8m34.273674782s) [upload=22129]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 01:12:48.490339794 (23h8m34.273679893s) [upload=22129]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 01:12:57.535364419 (23h8m43.318704518s) [upload=22129]: Done uploading segments... May 26 01:12:57.535408573 (23h8m43.318748672s) [upload=22129]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.167400653s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.........................X...................X..............] duration: 3.630080717s trace: https://jaeger.dev.storj.io/trace/366d6ef762a831a7 FAIL (2026-05-26 01:43:46 UTC) orbiter warning: context deadline exceeded Duration: 3.63010273s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 19.495883388s trace: https://jaeger.dev.storj.io/trace/10cf85c88fbff7f2 FAIL (2026-05-26 01:43:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 73305s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077219624 (23h8m32.860559723s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077607393 (23h8m32.860947482s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077996095 (23h8m32.861336194s) [seg_pos={0 0}, upload=22129]: Done begin upload segment. May 26 01:12:47.078027404 (23h8m32.861367503s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078373255 (23h8m32.861713354s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078598184 (23h8m32.861938283s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078926380 (23h8m32.862266479s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079225942 (23h8m32.862566041s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079519963 (23h8m32.862860052s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079775280 (23h8m32.863115379s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079945595 (23h8m32.863285694s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080458293 (23h8m32.863798392s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080778473 (23h8m32.864118573s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081079678 (23h8m32.864419777s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081435958 (23h8m32.864776057s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:48.142155727 (23h8m33.925495826s) [upload=22129]: Next returned nil segment May 26 01:12:48.142166708 (23h8m33.925506807s) [upload=22129]: Waiting for error group managing segments... May 26 01:12:48.422091343 (23h8m34.205431442s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.422758206 (23h8m34.206098295s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.423949939 (23h8m34.207290038s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.434367296 (23h8m34.217707395s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.435546887 (23h8m34.218886976s) [noise=true , address=212.102.52.213:4321 , piece_id=3KI2TVBA2G7OQKU2LQ6UHCDT5NT7FS6DTTTH2KXCXAGG4S3Z7EGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.437176967 (23h8m34.220517066s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.442827448 (23h8m34.226167547s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.445883780 (23h8m34.229223879s) [noise=true , address=212.102.52.217:4420 , piece_id=AUSAGK4RA5HZNSLETZ5O6XBHFAYUKB56ARIFUSDOAK5XJRGWUY3Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.448026138 (23h8m34.231366227s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.455811973 (23h8m34.239152073s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.456893056 (23h8m34.240233145s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.459265984 (23h8m34.242606083s) [noise=true , address=212.102.52.216:4411 , piece_id=I3IKFE7KKKO6K4UY4WT5ZOFSMNYXJZRYRWAXZ53Y6WPWS33VQJLQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.481083542 (23h8m34.264423641s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485409336 (23h8m34.268749435s) [noise=true , address=212.102.52.214:4357 , piece_id=F5SSZFAGJJM6OFBBCHP7BE6CZ6XADGZYY2356VENA6GBM3ZNQABQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485788209 (23h8m34.269128298s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489811155 (23h8m34.273151254s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489828819 (23h8m34.273168918s) [seg_pos={0 0}, upload=22129]: Satisfied cohort requirements after 16 pieces May 26 01:12:48.489984897 (23h8m34.273324996s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CUR4ziwaFaL7wLYxjArf8qYim7mzRtxobseMP1yBy3GAsWYPy): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.489990096 (23h8m34.273330185s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490143429 (23h8m34.273483528s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490152586 (23h8m34.273492675s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490170020 (23h8m34.273510119s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490179918 (23h8m34.273520007s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490253409 (23h8m34.273593498s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16niLmCkzYrrqsg6P7QNtpwXobbL79UjWi1YnHyKBPwZSQq3QW): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490259701 (23h8m34.27359979s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490279890 (23h8m34.273619989s) [seg_pos={0 0}, upload=22129]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 01:12:48.490334683 (23h8m34.273674782s) [upload=22129]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 01:12:48.490339794 (23h8m34.273679893s) [upload=22129]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 01:12:57.535364419 (23h8m43.318704518s) [upload=22129]: Done uploading segments... May 26 01:12:57.535408573 (23h8m43.318748672s) [upload=22129]: Upload finished. err: metaclient: context deadline exceeded Duration: 19.495904879s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 4.215789237s trace: https://jaeger.dev.storj.io/trace/10cf85c88fbff7f2 FAIL (2026-05-26 01:42:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 73305s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077219624 (23h8m32.860559723s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077607393 (23h8m32.860947482s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077996095 (23h8m32.861336194s) [seg_pos={0 0}, upload=22129]: Done begin upload segment. May 26 01:12:47.078027404 (23h8m32.861367503s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078373255 (23h8m32.861713354s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078598184 (23h8m32.861938283s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078926380 (23h8m32.862266479s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079225942 (23h8m32.862566041s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079519963 (23h8m32.862860052s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079775280 (23h8m32.863115379s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079945595 (23h8m32.863285694s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080458293 (23h8m32.863798392s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080778473 (23h8m32.864118573s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081079678 (23h8m32.864419777s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081435958 (23h8m32.864776057s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:48.142155727 (23h8m33.925495826s) [upload=22129]: Next returned nil segment May 26 01:12:48.142166708 (23h8m33.925506807s) [upload=22129]: Waiting for error group managing segments... May 26 01:12:48.422091343 (23h8m34.205431442s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.422758206 (23h8m34.206098295s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.423949939 (23h8m34.207290038s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.434367296 (23h8m34.217707395s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.435546887 (23h8m34.218886976s) [noise=true , address=212.102.52.213:4321 , piece_id=3KI2TVBA2G7OQKU2LQ6UHCDT5NT7FS6DTTTH2KXCXAGG4S3Z7EGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.437176967 (23h8m34.220517066s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.442827448 (23h8m34.226167547s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.445883780 (23h8m34.229223879s) [noise=true , address=212.102.52.217:4420 , piece_id=AUSAGK4RA5HZNSLETZ5O6XBHFAYUKB56ARIFUSDOAK5XJRGWUY3Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.448026138 (23h8m34.231366227s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.455811973 (23h8m34.239152073s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.456893056 (23h8m34.240233145s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.459265984 (23h8m34.242606083s) [noise=true , address=212.102.52.216:4411 , piece_id=I3IKFE7KKKO6K4UY4WT5ZOFSMNYXJZRYRWAXZ53Y6WPWS33VQJLQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.481083542 (23h8m34.264423641s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485409336 (23h8m34.268749435s) [noise=true , address=212.102.52.214:4357 , piece_id=F5SSZFAGJJM6OFBBCHP7BE6CZ6XADGZYY2356VENA6GBM3ZNQABQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485788209 (23h8m34.269128298s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489811155 (23h8m34.273151254s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489828819 (23h8m34.273168918s) [seg_pos={0 0}, upload=22129]: Satisfied cohort requirements after 16 pieces May 26 01:12:48.489984897 (23h8m34.273324996s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CUR4ziwaFaL7wLYxjArf8qYim7mzRtxobseMP1yBy3GAsWYPy): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.489990096 (23h8m34.273330185s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490143429 (23h8m34.273483528s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490152586 (23h8m34.273492675s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490170020 (23h8m34.273510119s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490179918 (23h8m34.273520007s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490253409 (23h8m34.273593498s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16niLmCkzYrrqsg6P7QNtpwXobbL79UjWi1YnHyKBPwZSQq3QW): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490259701 (23h8m34.27359979s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490279890 (23h8m34.273619989s) [seg_pos={0 0}, upload=22129]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 01:12:48.490334683 (23h8m34.273674782s) [upload=22129]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 01:12:48.490339794 (23h8m34.273679893s) [upload=22129]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 01:12:57.535364419 (23h8m43.318704518s) [upload=22129]: Done uploading segments... May 26 01:12:57.535408573 (23h8m43.318748672s) [upload=22129]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.215814936s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [.........XX....X.......X..........XX.X...X..X...............] duration: 11.059183546s trace: https://jaeger.dev.storj.io/trace/7f6c457594a573f6 FAIL (2026-05-26 01:42:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 11.059204706s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..........................X...................X.............] duration: 3.6344623s trace: https://jaeger.dev.storj.io/trace/366d6ef762a831a7 FAIL (2026-05-26 01:42:31 UTC) orbiter warning: context deadline exceeded Duration: 3.634479843s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [..........XX....X.......X..........XX.X...X..X..............] duration: 6.452303609s trace: https://jaeger.dev.storj.io/trace/7f6c457594a573f6 FAIL (2026-05-26 01:41:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.452323507s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 3.937356071s trace: https://jaeger.dev.storj.io/trace/10cf85c88fbff7f2 FAIL (2026-05-26 01:41:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 73305s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077219624 (23h8m32.860559723s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077607393 (23h8m32.860947482s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077996095 (23h8m32.861336194s) [seg_pos={0 0}, upload=22129]: Done begin upload segment. May 26 01:12:47.078027404 (23h8m32.861367503s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078373255 (23h8m32.861713354s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078598184 (23h8m32.861938283s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078926380 (23h8m32.862266479s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079225942 (23h8m32.862566041s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079519963 (23h8m32.862860052s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079775280 (23h8m32.863115379s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079945595 (23h8m32.863285694s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080458293 (23h8m32.863798392s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080778473 (23h8m32.864118573s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081079678 (23h8m32.864419777s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081435958 (23h8m32.864776057s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:48.142155727 (23h8m33.925495826s) [upload=22129]: Next returned nil segment May 26 01:12:48.142166708 (23h8m33.925506807s) [upload=22129]: Waiting for error group managing segments... May 26 01:12:48.422091343 (23h8m34.205431442s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.422758206 (23h8m34.206098295s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.423949939 (23h8m34.207290038s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.434367296 (23h8m34.217707395s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.435546887 (23h8m34.218886976s) [noise=true , address=212.102.52.213:4321 , piece_id=3KI2TVBA2G7OQKU2LQ6UHCDT5NT7FS6DTTTH2KXCXAGG4S3Z7EGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.437176967 (23h8m34.220517066s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.442827448 (23h8m34.226167547s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.445883780 (23h8m34.229223879s) [noise=true , address=212.102.52.217:4420 , piece_id=AUSAGK4RA5HZNSLETZ5O6XBHFAYUKB56ARIFUSDOAK5XJRGWUY3Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.448026138 (23h8m34.231366227s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.455811973 (23h8m34.239152073s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.456893056 (23h8m34.240233145s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.459265984 (23h8m34.242606083s) [noise=true , address=212.102.52.216:4411 , piece_id=I3IKFE7KKKO6K4UY4WT5ZOFSMNYXJZRYRWAXZ53Y6WPWS33VQJLQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.481083542 (23h8m34.264423641s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485409336 (23h8m34.268749435s) [noise=true , address=212.102.52.214:4357 , piece_id=F5SSZFAGJJM6OFBBCHP7BE6CZ6XADGZYY2356VENA6GBM3ZNQABQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485788209 (23h8m34.269128298s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489811155 (23h8m34.273151254s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489828819 (23h8m34.273168918s) [seg_pos={0 0}, upload=22129]: Satisfied cohort requirements after 16 pieces May 26 01:12:48.489984897 (23h8m34.273324996s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CUR4ziwaFaL7wLYxjArf8qYim7mzRtxobseMP1yBy3GAsWYPy): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.489990096 (23h8m34.273330185s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490143429 (23h8m34.273483528s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490152586 (23h8m34.273492675s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490170020 (23h8m34.273510119s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490179918 (23h8m34.273520007s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490253409 (23h8m34.273593498s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16niLmCkzYrrqsg6P7QNtpwXobbL79UjWi1YnHyKBPwZSQq3QW): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490259701 (23h8m34.27359979s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490279890 (23h8m34.273619989s) [seg_pos={0 0}, upload=22129]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 01:12:48.490334683 (23h8m34.273674782s) [upload=22129]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 01:12:48.490339794 (23h8m34.273679893s) [upload=22129]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 01:12:57.535364419 (23h8m43.318704518s) [upload=22129]: Done uploading segments... May 26 01:12:57.535408573 (23h8m43.318748672s) [upload=22129]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.93737712s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...........................X...................X............] duration: 3.688701972s trace: https://jaeger.dev.storj.io/trace/366d6ef762a831a7 FAIL (2026-05-26 01:41:30 UTC) orbiter warning: context deadline exceeded Duration: 3.688723843s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [...........XX....X.......X..........XX.X...X..X.............] duration: 6.37251854s trace: https://jaeger.dev.storj.io/trace/7f6c457594a573f6 FAIL (2026-05-26 01:41:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.372536574s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 4.885141947s trace: https://jaeger.dev.storj.io/trace/10cf85c88fbff7f2 FAIL (2026-05-26 01:40:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 73305s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077219624 (23h8m32.860559723s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077607393 (23h8m32.860947482s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077996095 (23h8m32.861336194s) [seg_pos={0 0}, upload=22129]: Done begin upload segment. May 26 01:12:47.078027404 (23h8m32.861367503s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078373255 (23h8m32.861713354s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078598184 (23h8m32.861938283s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078926380 (23h8m32.862266479s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079225942 (23h8m32.862566041s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079519963 (23h8m32.862860052s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079775280 (23h8m32.863115379s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079945595 (23h8m32.863285694s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080458293 (23h8m32.863798392s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080778473 (23h8m32.864118573s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081079678 (23h8m32.864419777s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081435958 (23h8m32.864776057s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:48.142155727 (23h8m33.925495826s) [upload=22129]: Next returned nil segment May 26 01:12:48.142166708 (23h8m33.925506807s) [upload=22129]: Waiting for error group managing segments... May 26 01:12:48.422091343 (23h8m34.205431442s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.422758206 (23h8m34.206098295s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.423949939 (23h8m34.207290038s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.434367296 (23h8m34.217707395s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.435546887 (23h8m34.218886976s) [noise=true , address=212.102.52.213:4321 , piece_id=3KI2TVBA2G7OQKU2LQ6UHCDT5NT7FS6DTTTH2KXCXAGG4S3Z7EGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.437176967 (23h8m34.220517066s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.442827448 (23h8m34.226167547s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.445883780 (23h8m34.229223879s) [noise=true , address=212.102.52.217:4420 , piece_id=AUSAGK4RA5HZNSLETZ5O6XBHFAYUKB56ARIFUSDOAK5XJRGWUY3Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.448026138 (23h8m34.231366227s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.455811973 (23h8m34.239152073s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.456893056 (23h8m34.240233145s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.459265984 (23h8m34.242606083s) [noise=true , address=212.102.52.216:4411 , piece_id=I3IKFE7KKKO6K4UY4WT5ZOFSMNYXJZRYRWAXZ53Y6WPWS33VQJLQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.481083542 (23h8m34.264423641s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485409336 (23h8m34.268749435s) [noise=true , address=212.102.52.214:4357 , piece_id=F5SSZFAGJJM6OFBBCHP7BE6CZ6XADGZYY2356VENA6GBM3ZNQABQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485788209 (23h8m34.269128298s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489811155 (23h8m34.273151254s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489828819 (23h8m34.273168918s) [seg_pos={0 0}, upload=22129]: Satisfied cohort requirements after 16 pieces May 26 01:12:48.489984897 (23h8m34.273324996s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CUR4ziwaFaL7wLYxjArf8qYim7mzRtxobseMP1yBy3GAsWYPy): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.489990096 (23h8m34.273330185s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490143429 (23h8m34.273483528s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490152586 (23h8m34.273492675s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490170020 (23h8m34.273510119s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490179918 (23h8m34.273520007s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490253409 (23h8m34.273593498s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16niLmCkzYrrqsg6P7QNtpwXobbL79UjWi1YnHyKBPwZSQq3QW): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490259701 (23h8m34.27359979s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490279890 (23h8m34.273619989s) [seg_pos={0 0}, upload=22129]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 01:12:48.490334683 (23h8m34.273674782s) [upload=22129]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 01:12:48.490339794 (23h8m34.273679893s) [upload=22129]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 01:12:57.535364419 (23h8m43.318704518s) [upload=22129]: Done uploading segments... May 26 01:12:57.535408573 (23h8m43.318748672s) [upload=22129]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.885158878s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [............................X...................X...........] duration: 3.495199127s trace: https://jaeger.dev.storj.io/trace/366d6ef762a831a7 FAIL (2026-05-26 01:40:48 UTC) orbiter warning: context deadline exceeded Duration: 3.495217211s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [............XX....X.......X..........XX.X...X..X............] duration: 6.391178854s trace: https://jaeger.dev.storj.io/trace/7f6c457594a573f6 FAIL (2026-05-26 01:40:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.391200806s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.............................X...................X..........] duration: 3.608569776s trace: https://jaeger.dev.storj.io/trace/366d6ef762a831a7 FAIL (2026-05-26 01:40:21 UTC) orbiter warning: context deadline exceeded Duration: 3.608593891s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [.............XX....X.......X..........XX.X...X..X...........] duration: 6.613218365s trace: https://jaeger.dev.storj.io/trace/7f6c457594a573f6 FAIL (2026-05-26 01:40:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.613238352s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 4.018137338s trace: https://jaeger.dev.storj.io/trace/10cf85c88fbff7f2 FAIL (2026-05-26 01:40:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 73305s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077219624 (23h8m32.860559723s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077607393 (23h8m32.860947482s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077996095 (23h8m32.861336194s) [seg_pos={0 0}, upload=22129]: Done begin upload segment. May 26 01:12:47.078027404 (23h8m32.861367503s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078373255 (23h8m32.861713354s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078598184 (23h8m32.861938283s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078926380 (23h8m32.862266479s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079225942 (23h8m32.862566041s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079519963 (23h8m32.862860052s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079775280 (23h8m32.863115379s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079945595 (23h8m32.863285694s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080458293 (23h8m32.863798392s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080778473 (23h8m32.864118573s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081079678 (23h8m32.864419777s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081435958 (23h8m32.864776057s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:48.142155727 (23h8m33.925495826s) [upload=22129]: Next returned nil segment May 26 01:12:48.142166708 (23h8m33.925506807s) [upload=22129]: Waiting for error group managing segments... May 26 01:12:48.422091343 (23h8m34.205431442s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.422758206 (23h8m34.206098295s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.423949939 (23h8m34.207290038s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.434367296 (23h8m34.217707395s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.435546887 (23h8m34.218886976s) [noise=true , address=212.102.52.213:4321 , piece_id=3KI2TVBA2G7OQKU2LQ6UHCDT5NT7FS6DTTTH2KXCXAGG4S3Z7EGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.437176967 (23h8m34.220517066s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.442827448 (23h8m34.226167547s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.445883780 (23h8m34.229223879s) [noise=true , address=212.102.52.217:4420 , piece_id=AUSAGK4RA5HZNSLETZ5O6XBHFAYUKB56ARIFUSDOAK5XJRGWUY3Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.448026138 (23h8m34.231366227s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.455811973 (23h8m34.239152073s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.456893056 (23h8m34.240233145s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.459265984 (23h8m34.242606083s) [noise=true , address=212.102.52.216:4411 , piece_id=I3IKFE7KKKO6K4UY4WT5ZOFSMNYXJZRYRWAXZ53Y6WPWS33VQJLQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.481083542 (23h8m34.264423641s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485409336 (23h8m34.268749435s) [noise=true , address=212.102.52.214:4357 , piece_id=F5SSZFAGJJM6OFBBCHP7BE6CZ6XADGZYY2356VENA6GBM3ZNQABQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485788209 (23h8m34.269128298s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489811155 (23h8m34.273151254s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489828819 (23h8m34.273168918s) [seg_pos={0 0}, upload=22129]: Satisfied cohort requirements after 16 pieces May 26 01:12:48.489984897 (23h8m34.273324996s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CUR4ziwaFaL7wLYxjArf8qYim7mzRtxobseMP1yBy3GAsWYPy): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.489990096 (23h8m34.273330185s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490143429 (23h8m34.273483528s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490152586 (23h8m34.273492675s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490170020 (23h8m34.273510119s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490179918 (23h8m34.273520007s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490253409 (23h8m34.273593498s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16niLmCkzYrrqsg6P7QNtpwXobbL79UjWi1YnHyKBPwZSQq3QW): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490259701 (23h8m34.27359979s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490279890 (23h8m34.273619989s) [seg_pos={0 0}, upload=22129]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 01:12:48.490334683 (23h8m34.273674782s) [upload=22129]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 01:12:48.490339794 (23h8m34.273679893s) [upload=22129]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 01:12:57.535364419 (23h8m43.318704518s) [upload=22129]: Done uploading segments... May 26 01:12:57.535408573 (23h8m43.318748672s) [upload=22129]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.018159649s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..............................X...................X.........] duration: 3.586854502s trace: https://jaeger.dev.storj.io/trace/366d6ef762a831a7 FAIL (2026-05-26 01:39:53 UTC) orbiter warning: context deadline exceeded Duration: 3.586870302s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 3.923023474s trace: https://jaeger.dev.storj.io/trace/10cf85c88fbff7f2 FAIL (2026-05-26 01:39:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 73305s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077219624 (23h8m32.860559723s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077607393 (23h8m32.860947482s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077996095 (23h8m32.861336194s) [seg_pos={0 0}, upload=22129]: Done begin upload segment. May 26 01:12:47.078027404 (23h8m32.861367503s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078373255 (23h8m32.861713354s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078598184 (23h8m32.861938283s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078926380 (23h8m32.862266479s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079225942 (23h8m32.862566041s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079519963 (23h8m32.862860052s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079775280 (23h8m32.863115379s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079945595 (23h8m32.863285694s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080458293 (23h8m32.863798392s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080778473 (23h8m32.864118573s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081079678 (23h8m32.864419777s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081435958 (23h8m32.864776057s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:48.142155727 (23h8m33.925495826s) [upload=22129]: Next returned nil segment May 26 01:12:48.142166708 (23h8m33.925506807s) [upload=22129]: Waiting for error group managing segments... May 26 01:12:48.422091343 (23h8m34.205431442s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.422758206 (23h8m34.206098295s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.423949939 (23h8m34.207290038s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.434367296 (23h8m34.217707395s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.435546887 (23h8m34.218886976s) [noise=true , address=212.102.52.213:4321 , piece_id=3KI2TVBA2G7OQKU2LQ6UHCDT5NT7FS6DTTTH2KXCXAGG4S3Z7EGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.437176967 (23h8m34.220517066s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.442827448 (23h8m34.226167547s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.445883780 (23h8m34.229223879s) [noise=true , address=212.102.52.217:4420 , piece_id=AUSAGK4RA5HZNSLETZ5O6XBHFAYUKB56ARIFUSDOAK5XJRGWUY3Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.448026138 (23h8m34.231366227s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.455811973 (23h8m34.239152073s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.456893056 (23h8m34.240233145s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.459265984 (23h8m34.242606083s) [noise=true , address=212.102.52.216:4411 , piece_id=I3IKFE7KKKO6K4UY4WT5ZOFSMNYXJZRYRWAXZ53Y6WPWS33VQJLQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.481083542 (23h8m34.264423641s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485409336 (23h8m34.268749435s) [noise=true , address=212.102.52.214:4357 , piece_id=F5SSZFAGJJM6OFBBCHP7BE6CZ6XADGZYY2356VENA6GBM3ZNQABQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485788209 (23h8m34.269128298s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489811155 (23h8m34.273151254s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489828819 (23h8m34.273168918s) [seg_pos={0 0}, upload=22129]: Satisfied cohort requirements after 16 pieces May 26 01:12:48.489984897 (23h8m34.273324996s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CUR4ziwaFaL7wLYxjArf8qYim7mzRtxobseMP1yBy3GAsWYPy): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.489990096 (23h8m34.273330185s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490143429 (23h8m34.273483528s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490152586 (23h8m34.273492675s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490170020 (23h8m34.273510119s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490179918 (23h8m34.273520007s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490253409 (23h8m34.273593498s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16niLmCkzYrrqsg6P7QNtpwXobbL79UjWi1YnHyKBPwZSQq3QW): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490259701 (23h8m34.27359979s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490279890 (23h8m34.273619989s) [seg_pos={0 0}, upload=22129]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 01:12:48.490334683 (23h8m34.273674782s) [upload=22129]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 01:12:48.490339794 (23h8m34.273679893s) [upload=22129]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 01:12:57.535364419 (23h8m43.318704518s) [upload=22129]: Done uploading segments... May 26 01:12:57.535408573 (23h8m43.318748672s) [upload=22129]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.923049925s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...............................X...................X........] duration: 3.658957318s trace: https://jaeger.dev.storj.io/trace/366d6ef762a831a7 FAIL (2026-05-26 01:39:31 UTC) orbiter warning: context deadline exceeded Duration: 3.658977776s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [X.............XX....X.......X..........XX.X...X..X..........] duration: 6.792925397s trace: https://jaeger.dev.storj.io/trace/7f6c457594a573f6 FAIL (2026-05-26 01:39:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.792980352s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [................................X...................X.......] duration: 3.691208273s trace: https://jaeger.dev.storj.io/trace/366d6ef762a831a7 FAIL (2026-05-26 01:39:08 UTC) orbiter warning: context deadline exceeded Duration: 3.691231136s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 4.055455978s trace: https://jaeger.dev.storj.io/trace/10cf85c88fbff7f2 FAIL (2026-05-26 01:38:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 73305s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077219624 (23h8m32.860559723s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077607393 (23h8m32.860947482s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077996095 (23h8m32.861336194s) [seg_pos={0 0}, upload=22129]: Done begin upload segment. May 26 01:12:47.078027404 (23h8m32.861367503s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078373255 (23h8m32.861713354s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078598184 (23h8m32.861938283s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078926380 (23h8m32.862266479s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079225942 (23h8m32.862566041s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079519963 (23h8m32.862860052s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079775280 (23h8m32.863115379s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079945595 (23h8m32.863285694s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080458293 (23h8m32.863798392s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080778473 (23h8m32.864118573s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081079678 (23h8m32.864419777s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081435958 (23h8m32.864776057s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:48.142155727 (23h8m33.925495826s) [upload=22129]: Next returned nil segment May 26 01:12:48.142166708 (23h8m33.925506807s) [upload=22129]: Waiting for error group managing segments... May 26 01:12:48.422091343 (23h8m34.205431442s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.422758206 (23h8m34.206098295s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.423949939 (23h8m34.207290038s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.434367296 (23h8m34.217707395s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.435546887 (23h8m34.218886976s) [noise=true , address=212.102.52.213:4321 , piece_id=3KI2TVBA2G7OQKU2LQ6UHCDT5NT7FS6DTTTH2KXCXAGG4S3Z7EGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.437176967 (23h8m34.220517066s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.442827448 (23h8m34.226167547s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.445883780 (23h8m34.229223879s) [noise=true , address=212.102.52.217:4420 , piece_id=AUSAGK4RA5HZNSLETZ5O6XBHFAYUKB56ARIFUSDOAK5XJRGWUY3Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.448026138 (23h8m34.231366227s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.455811973 (23h8m34.239152073s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.456893056 (23h8m34.240233145s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.459265984 (23h8m34.242606083s) [noise=true , address=212.102.52.216:4411 , piece_id=I3IKFE7KKKO6K4UY4WT5ZOFSMNYXJZRYRWAXZ53Y6WPWS33VQJLQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.481083542 (23h8m34.264423641s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485409336 (23h8m34.268749435s) [noise=true , address=212.102.52.214:4357 , piece_id=F5SSZFAGJJM6OFBBCHP7BE6CZ6XADGZYY2356VENA6GBM3ZNQABQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485788209 (23h8m34.269128298s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489811155 (23h8m34.273151254s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489828819 (23h8m34.273168918s) [seg_pos={0 0}, upload=22129]: Satisfied cohort requirements after 16 pieces May 26 01:12:48.489984897 (23h8m34.273324996s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CUR4ziwaFaL7wLYxjArf8qYim7mzRtxobseMP1yBy3GAsWYPy): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.489990096 (23h8m34.273330185s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490143429 (23h8m34.273483528s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490152586 (23h8m34.273492675s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490170020 (23h8m34.273510119s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490179918 (23h8m34.273520007s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490253409 (23h8m34.273593498s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16niLmCkzYrrqsg6P7QNtpwXobbL79UjWi1YnHyKBPwZSQq3QW): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490259701 (23h8m34.27359979s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490279890 (23h8m34.273619989s) [seg_pos={0 0}, upload=22129]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 01:12:48.490334683 (23h8m34.273674782s) [upload=22129]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 01:12:48.490339794 (23h8m34.273679893s) [upload=22129]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 01:12:57.535364419 (23h8m43.318704518s) [upload=22129]: Done uploading segments... May 26 01:12:57.535408573 (23h8m43.318748672s) [upload=22129]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.055470817s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 4.050104803s trace: https://jaeger.dev.storj.io/trace/10cf85c88fbff7f2 FAIL (2026-05-26 01:38:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 73305s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077219624 (23h8m32.860559723s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077607393 (23h8m32.860947482s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077996095 (23h8m32.861336194s) [seg_pos={0 0}, upload=22129]: Done begin upload segment. May 26 01:12:47.078027404 (23h8m32.861367503s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078373255 (23h8m32.861713354s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078598184 (23h8m32.861938283s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078926380 (23h8m32.862266479s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079225942 (23h8m32.862566041s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079519963 (23h8m32.862860052s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079775280 (23h8m32.863115379s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079945595 (23h8m32.863285694s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080458293 (23h8m32.863798392s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080778473 (23h8m32.864118573s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081079678 (23h8m32.864419777s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081435958 (23h8m32.864776057s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:48.142155727 (23h8m33.925495826s) [upload=22129]: Next returned nil segment May 26 01:12:48.142166708 (23h8m33.925506807s) [upload=22129]: Waiting for error group managing segments... May 26 01:12:48.422091343 (23h8m34.205431442s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.422758206 (23h8m34.206098295s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.423949939 (23h8m34.207290038s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.434367296 (23h8m34.217707395s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.435546887 (23h8m34.218886976s) [noise=true , address=212.102.52.213:4321 , piece_id=3KI2TVBA2G7OQKU2LQ6UHCDT5NT7FS6DTTTH2KXCXAGG4S3Z7EGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.437176967 (23h8m34.220517066s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.442827448 (23h8m34.226167547s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.445883780 (23h8m34.229223879s) [noise=true , address=212.102.52.217:4420 , piece_id=AUSAGK4RA5HZNSLETZ5O6XBHFAYUKB56ARIFUSDOAK5XJRGWUY3Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.448026138 (23h8m34.231366227s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.455811973 (23h8m34.239152073s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.456893056 (23h8m34.240233145s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.459265984 (23h8m34.242606083s) [noise=true , address=212.102.52.216:4411 , piece_id=I3IKFE7KKKO6K4UY4WT5ZOFSMNYXJZRYRWAXZ53Y6WPWS33VQJLQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.481083542 (23h8m34.264423641s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485409336 (23h8m34.268749435s) [noise=true , address=212.102.52.214:4357 , piece_id=F5SSZFAGJJM6OFBBCHP7BE6CZ6XADGZYY2356VENA6GBM3ZNQABQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485788209 (23h8m34.269128298s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489811155 (23h8m34.273151254s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489828819 (23h8m34.273168918s) [seg_pos={0 0}, upload=22129]: Satisfied cohort requirements after 16 pieces May 26 01:12:48.489984897 (23h8m34.273324996s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CUR4ziwaFaL7wLYxjArf8qYim7mzRtxobseMP1yBy3GAsWYPy): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.489990096 (23h8m34.273330185s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490143429 (23h8m34.273483528s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490152586 (23h8m34.273492675s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490170020 (23h8m34.273510119s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490179918 (23h8m34.273520007s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490253409 (23h8m34.273593498s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16niLmCkzYrrqsg6P7QNtpwXobbL79UjWi1YnHyKBPwZSQq3QW): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490259701 (23h8m34.27359979s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490279890 (23h8m34.273619989s) [seg_pos={0 0}, upload=22129]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 01:12:48.490334683 (23h8m34.273674782s) [upload=22129]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 01:12:48.490339794 (23h8m34.273679893s) [upload=22129]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 01:12:57.535364419 (23h8m43.318704518s) [upload=22129]: Done uploading segments... May 26 01:12:57.535408573 (23h8m43.318748672s) [upload=22129]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.050116475s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 7.86582653s trace: https://jaeger.dev.storj.io/trace/10cf85c88fbff7f2 FAIL (2026-05-26 01:38:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 73305s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077219624 (23h8m32.860559723s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077607393 (23h8m32.860947482s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077996095 (23h8m32.861336194s) [seg_pos={0 0}, upload=22129]: Done begin upload segment. May 26 01:12:47.078027404 (23h8m32.861367503s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078373255 (23h8m32.861713354s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078598184 (23h8m32.861938283s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078926380 (23h8m32.862266479s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079225942 (23h8m32.862566041s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079519963 (23h8m32.862860052s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079775280 (23h8m32.863115379s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079945595 (23h8m32.863285694s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080458293 (23h8m32.863798392s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080778473 (23h8m32.864118573s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081079678 (23h8m32.864419777s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081435958 (23h8m32.864776057s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:48.142155727 (23h8m33.925495826s) [upload=22129]: Next returned nil segment May 26 01:12:48.142166708 (23h8m33.925506807s) [upload=22129]: Waiting for error group managing segments... May 26 01:12:48.422091343 (23h8m34.205431442s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.422758206 (23h8m34.206098295s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.423949939 (23h8m34.207290038s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.434367296 (23h8m34.217707395s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.435546887 (23h8m34.218886976s) [noise=true , address=212.102.52.213:4321 , piece_id=3KI2TVBA2G7OQKU2LQ6UHCDT5NT7FS6DTTTH2KXCXAGG4S3Z7EGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.437176967 (23h8m34.220517066s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.442827448 (23h8m34.226167547s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.445883780 (23h8m34.229223879s) [noise=true , address=212.102.52.217:4420 , piece_id=AUSAGK4RA5HZNSLETZ5O6XBHFAYUKB56ARIFUSDOAK5XJRGWUY3Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.448026138 (23h8m34.231366227s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.455811973 (23h8m34.239152073s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.456893056 (23h8m34.240233145s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.459265984 (23h8m34.242606083s) [noise=true , address=212.102.52.216:4411 , piece_id=I3IKFE7KKKO6K4UY4WT5ZOFSMNYXJZRYRWAXZ53Y6WPWS33VQJLQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.481083542 (23h8m34.264423641s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485409336 (23h8m34.268749435s) [noise=true , address=212.102.52.214:4357 , piece_id=F5SSZFAGJJM6OFBBCHP7BE6CZ6XADGZYY2356VENA6GBM3ZNQABQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485788209 (23h8m34.269128298s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489811155 (23h8m34.273151254s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489828819 (23h8m34.273168918s) [seg_pos={0 0}, upload=22129]: Satisfied cohort requirements after 16 pieces May 26 01:12:48.489984897 (23h8m34.273324996s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CUR4ziwaFaL7wLYxjArf8qYim7mzRtxobseMP1yBy3GAsWYPy): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.489990096 (23h8m34.273330185s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490143429 (23h8m34.273483528s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490152586 (23h8m34.273492675s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490170020 (23h8m34.273510119s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490179918 (23h8m34.273520007s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490253409 (23h8m34.273593498s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16niLmCkzYrrqsg6P7QNtpwXobbL79UjWi1YnHyKBPwZSQq3QW): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490259701 (23h8m34.27359979s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490279890 (23h8m34.273619989s) [seg_pos={0 0}, upload=22129]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 01:12:48.490334683 (23h8m34.273674782s) [upload=22129]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 01:12:48.490339794 (23h8m34.273679893s) [upload=22129]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 01:12:57.535364419 (23h8m43.318704518s) [upload=22129]: Done uploading segments... May 26 01:12:57.535408573 (23h8m43.318748672s) [upload=22129]: Upload finished. err: metaclient: context deadline exceeded Duration: 7.86585219s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [.X.............XX....X.......X..........XX.X...X..X.........] duration: 6.440214206s trace: https://jaeger.dev.storj.io/trace/7f6c457594a573f6 FAIL (2026-05-26 01:38:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.440438112s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.................................X...................X......] duration: 3.668363997s trace: https://jaeger.dev.storj.io/trace/366d6ef762a831a7 FAIL (2026-05-26 01:38:09 UTC) orbiter warning: context deadline exceeded Duration: 3.668413581s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [..X.............XX....X.......X..........XX.X...X..X........] duration: 6.923532184s trace: https://jaeger.dev.storj.io/trace/7f6c457594a573f6 FAIL (2026-05-26 01:37:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.9235462s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..................................X...................X.....] duration: 3.600170119s trace: https://jaeger.dev.storj.io/trace/366d6ef762a831a7 FAIL (2026-05-26 01:37:28 UTC) orbiter warning: context deadline exceeded Duration: 3.600195427s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 4.049079288s trace: https://jaeger.dev.storj.io/trace/10cf85c88fbff7f2 FAIL (2026-05-26 01:37:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 73305s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077219624 (23h8m32.860559723s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077607393 (23h8m32.860947482s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077996095 (23h8m32.861336194s) [seg_pos={0 0}, upload=22129]: Done begin upload segment. May 26 01:12:47.078027404 (23h8m32.861367503s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078373255 (23h8m32.861713354s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078598184 (23h8m32.861938283s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078926380 (23h8m32.862266479s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079225942 (23h8m32.862566041s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079519963 (23h8m32.862860052s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079775280 (23h8m32.863115379s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079945595 (23h8m32.863285694s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080458293 (23h8m32.863798392s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080778473 (23h8m32.864118573s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081079678 (23h8m32.864419777s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081435958 (23h8m32.864776057s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:48.142155727 (23h8m33.925495826s) [upload=22129]: Next returned nil segment May 26 01:12:48.142166708 (23h8m33.925506807s) [upload=22129]: Waiting for error group managing segments... May 26 01:12:48.422091343 (23h8m34.205431442s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.422758206 (23h8m34.206098295s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.423949939 (23h8m34.207290038s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.434367296 (23h8m34.217707395s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.435546887 (23h8m34.218886976s) [noise=true , address=212.102.52.213:4321 , piece_id=3KI2TVBA2G7OQKU2LQ6UHCDT5NT7FS6DTTTH2KXCXAGG4S3Z7EGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.437176967 (23h8m34.220517066s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.442827448 (23h8m34.226167547s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.445883780 (23h8m34.229223879s) [noise=true , address=212.102.52.217:4420 , piece_id=AUSAGK4RA5HZNSLETZ5O6XBHFAYUKB56ARIFUSDOAK5XJRGWUY3Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.448026138 (23h8m34.231366227s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.455811973 (23h8m34.239152073s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.456893056 (23h8m34.240233145s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.459265984 (23h8m34.242606083s) [noise=true , address=212.102.52.216:4411 , piece_id=I3IKFE7KKKO6K4UY4WT5ZOFSMNYXJZRYRWAXZ53Y6WPWS33VQJLQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.481083542 (23h8m34.264423641s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485409336 (23h8m34.268749435s) [noise=true , address=212.102.52.214:4357 , piece_id=F5SSZFAGJJM6OFBBCHP7BE6CZ6XADGZYY2356VENA6GBM3ZNQABQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485788209 (23h8m34.269128298s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489811155 (23h8m34.273151254s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489828819 (23h8m34.273168918s) [seg_pos={0 0}, upload=22129]: Satisfied cohort requirements after 16 pieces May 26 01:12:48.489984897 (23h8m34.273324996s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CUR4ziwaFaL7wLYxjArf8qYim7mzRtxobseMP1yBy3GAsWYPy): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.489990096 (23h8m34.273330185s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490143429 (23h8m34.273483528s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490152586 (23h8m34.273492675s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490170020 (23h8m34.273510119s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490179918 (23h8m34.273520007s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490253409 (23h8m34.273593498s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16niLmCkzYrrqsg6P7QNtpwXobbL79UjWi1YnHyKBPwZSQq3QW): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490259701 (23h8m34.27359979s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490279890 (23h8m34.273619989s) [seg_pos={0 0}, upload=22129]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 01:12:48.490334683 (23h8m34.273674782s) [upload=22129]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 01:12:48.490339794 (23h8m34.273679893s) [upload=22129]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 01:12:57.535364419 (23h8m43.318704518s) [upload=22129]: Done uploading segments... May 26 01:12:57.535408573 (23h8m43.318748672s) [upload=22129]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.049090009s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 44.029930006s trace: https://jaeger.dev.storj.io/trace/10cf85c88fbff7f2 FAIL (2026-05-26 01:37:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 73305s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077219624 (23h8m32.860559723s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077607393 (23h8m32.860947482s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077996095 (23h8m32.861336194s) [seg_pos={0 0}, upload=22129]: Done begin upload segment. May 26 01:12:47.078027404 (23h8m32.861367503s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078373255 (23h8m32.861713354s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078598184 (23h8m32.861938283s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078926380 (23h8m32.862266479s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079225942 (23h8m32.862566041s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079519963 (23h8m32.862860052s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079775280 (23h8m32.863115379s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079945595 (23h8m32.863285694s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080458293 (23h8m32.863798392s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080778473 (23h8m32.864118573s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081079678 (23h8m32.864419777s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081435958 (23h8m32.864776057s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:48.142155727 (23h8m33.925495826s) [upload=22129]: Next returned nil segment May 26 01:12:48.142166708 (23h8m33.925506807s) [upload=22129]: Waiting for error group managing segments... May 26 01:12:48.422091343 (23h8m34.205431442s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.422758206 (23h8m34.206098295s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.423949939 (23h8m34.207290038s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.434367296 (23h8m34.217707395s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.435546887 (23h8m34.218886976s) [noise=true , address=212.102.52.213:4321 , piece_id=3KI2TVBA2G7OQKU2LQ6UHCDT5NT7FS6DTTTH2KXCXAGG4S3Z7EGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.437176967 (23h8m34.220517066s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.442827448 (23h8m34.226167547s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.445883780 (23h8m34.229223879s) [noise=true , address=212.102.52.217:4420 , piece_id=AUSAGK4RA5HZNSLETZ5O6XBHFAYUKB56ARIFUSDOAK5XJRGWUY3Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.448026138 (23h8m34.231366227s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.455811973 (23h8m34.239152073s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.456893056 (23h8m34.240233145s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.459265984 (23h8m34.242606083s) [noise=true , address=212.102.52.216:4411 , piece_id=I3IKFE7KKKO6K4UY4WT5ZOFSMNYXJZRYRWAXZ53Y6WPWS33VQJLQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.481083542 (23h8m34.264423641s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485409336 (23h8m34.268749435s) [noise=true , address=212.102.52.214:4357 , piece_id=F5SSZFAGJJM6OFBBCHP7BE6CZ6XADGZYY2356VENA6GBM3ZNQABQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485788209 (23h8m34.269128298s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489811155 (23h8m34.273151254s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489828819 (23h8m34.273168918s) [seg_pos={0 0}, upload=22129]: Satisfied cohort requirements after 16 pieces May 26 01:12:48.489984897 (23h8m34.273324996s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CUR4ziwaFaL7wLYxjArf8qYim7mzRtxobseMP1yBy3GAsWYPy): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.489990096 (23h8m34.273330185s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490143429 (23h8m34.273483528s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490152586 (23h8m34.273492675s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490170020 (23h8m34.273510119s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490179918 (23h8m34.273520007s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490253409 (23h8m34.273593498s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16niLmCkzYrrqsg6P7QNtpwXobbL79UjWi1YnHyKBPwZSQq3QW): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490259701 (23h8m34.27359979s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490279890 (23h8m34.273619989s) [seg_pos={0 0}, upload=22129]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 01:12:48.490334683 (23h8m34.273674782s) [upload=22129]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 01:12:48.490339794 (23h8m34.273679893s) [upload=22129]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 01:12:57.535364419 (23h8m43.318704518s) [upload=22129]: Done uploading segments... May 26 01:12:57.535408573 (23h8m43.318748672s) [upload=22129]: Upload finished. err: metaclient: context deadline exceeded Duration: 44.029950575s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [X..X.............XX....X.......X..........XX.X...X..X.......] duration: 6.412643844s trace: https://jaeger.dev.storj.io/trace/7f6c457594a573f6 FAIL (2026-05-26 01:36:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.412826341s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...................................X...................X....] duration: 3.930338208s trace: https://jaeger.dev.storj.io/trace/366d6ef762a831a7 FAIL (2026-05-26 01:36:47 UTC) orbiter warning: context deadline exceeded Duration: 3.930430754s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [.X..X.............XX....X.......X..........XX.X...X..X......] duration: 6.49825238s trace: https://jaeger.dev.storj.io/trace/7f6c457594a573f6 FAIL (2026-05-26 01:36:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.498271378s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [....................................X...................X...] duration: 3.72705673s trace: https://jaeger.dev.storj.io/trace/366d6ef762a831a7 FAIL (2026-05-26 01:36:09 UTC) orbiter warning: context deadline exceeded Duration: 3.727086697s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [..X..X.............XX....X.......X..........XX.X...X..X.....] duration: 17.878923882s trace: https://jaeger.dev.storj.io/trace/7f6c457594a573f6 FAIL (2026-05-26 01:35:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 17.878951304s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 4.069126929s trace: https://jaeger.dev.storj.io/trace/10cf85c88fbff7f2 FAIL (2026-05-26 01:35:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 73305s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077219624 (23h8m32.860559723s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077607393 (23h8m32.860947482s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.077996095 (23h8m32.861336194s) [seg_pos={0 0}, upload=22129]: Done begin upload segment. May 26 01:12:47.078027404 (23h8m32.861367503s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078373255 (23h8m32.861713354s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078598184 (23h8m32.861938283s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.078926380 (23h8m32.862266479s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079225942 (23h8m32.862566041s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079519963 (23h8m32.862860052s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079775280 (23h8m32.863115379s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.079945595 (23h8m32.863285694s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080458293 (23h8m32.863798392s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.080778473 (23h8m32.864118573s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081079678 (23h8m32.864419777s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:47.081435958 (23h8m32.864776057s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Uploading piece... May 26 01:12:48.142155727 (23h8m33.925495826s) [upload=22129]: Next returned nil segment May 26 01:12:48.142166708 (23h8m33.925506807s) [upload=22129]: Waiting for error group managing segments... May 26 01:12:48.422091343 (23h8m34.205431442s) [noise=true , address=212.102.52.213:4325 , piece_id=FFV4CO57HDS7V6M6XTX5NSRY67HMSG4P3T2ZKNFCFYCTZGQ7HCGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.422758206 (23h8m34.206098295s) [noise=true , address=212.102.52.214:4349 , piece_id=PWNZG3YHD5JW5CQQP3ENAFORNUAE7KBY22ME3AE7XHLY3ZH43GRA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.423949939 (23h8m34.207290038s) [noise=true , address=212.102.52.215:4389 , piece_id=FC635AZN2NX43IW4SFEZQITSWBBA3BDU47VBBQQE3UZL3YGLMLXA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.434367296 (23h8m34.217707395s) [noise=true , address=212.102.52.215:4390 , piece_id=7B7OC2W5WLDOGXE6Q6SPXZLL6UTFEIRVSY4MPBDRR3L3EYZXOIWQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.435546887 (23h8m34.218886976s) [noise=true , address=212.102.52.213:4321 , piece_id=3KI2TVBA2G7OQKU2LQ6UHCDT5NT7FS6DTTTH2KXCXAGG4S3Z7EGQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.437176967 (23h8m34.220517066s) [noise=true , address=212.102.52.213:4337 , piece_id=2XQVPGWXLJKE3VYTRNVADH3BJOPCQVXANVKDOX6TTZJPE3JBICTA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.442827448 (23h8m34.226167547s) [noise=true , address=212.102.52.216:4414 , piece_id=RBU5T46SZSW5JNKCMXZJAOLB3D6RZR7SGINWLMBCUF44DC7F223Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.445883780 (23h8m34.229223879s) [noise=true , address=212.102.52.217:4420 , piece_id=AUSAGK4RA5HZNSLETZ5O6XBHFAYUKB56ARIFUSDOAK5XJRGWUY3Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.448026138 (23h8m34.231366227s) [noise=true , address=212.102.52.216:4412 , piece_id=DUYSUBTQZO3KGCA7DE7OPFGODEW2RHATH3QDWGU4HBP43MJFZQMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.455811973 (23h8m34.239152073s) [noise=true , address=212.102.52.217:4440 , piece_id=U7SR5B24PBAVSZJJ5KQMU4JVTJYVDBYVEP2SPAUFSDDS4XA3CY7A, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.456893056 (23h8m34.240233145s) [noise=true , address=212.102.52.215:4375 , piece_id=YOYJIH2GSZLHPYEPXMEYVQS5ZKZ5KZQ4MT7HW44Z2TZ72H7UCJOQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.459265984 (23h8m34.242606083s) [noise=true , address=212.102.52.216:4411 , piece_id=I3IKFE7KKKO6K4UY4WT5ZOFSMNYXJZRYRWAXZ53Y6WPWS33VQJLQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.481083542 (23h8m34.264423641s) [noise=true , address=212.102.52.214:4358 , piece_id=OH4CL4F7WJD46RQI7QRU7FZCPW5LXBUXTP5GI4FEKGD5DWM3TDJQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485409336 (23h8m34.268749435s) [noise=true , address=212.102.52.214:4357 , piece_id=F5SSZFAGJJM6OFBBCHP7BE6CZ6XADGZYY2356VENA6GBM3ZNQABQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.485788209 (23h8m34.269128298s) [noise=true , address=212.102.52.213:4341 , piece_id=UHNM2L5UNPUWZILDNQMPCG4XOFT3OG5TMQHVGLR7T6MQ4KXHL6YA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489811155 (23h8m34.273151254s) [noise=true , address=212.102.52.214:4351 , piece_id=MEYTMD4BD5BFVEOTB4E6Y54PPP4SRXVW3S255AAHNZWOELK2FI5Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: <nil> May 26 01:12:48.489828819 (23h8m34.273168918s) [seg_pos={0 0}, upload=22129]: Satisfied cohort requirements after 16 pieces May 26 01:12:48.489984897 (23h8m34.273324996s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CUR4ziwaFaL7wLYxjArf8qYim7mzRtxobseMP1yBy3GAsWYPy): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.489990096 (23h8m34.273330185s) [noise=true , address=212.102.52.216:4404 , piece_id=NTJ7LPL46TIMYEW4NUSGFGQG6WH2UYONX67GFJFXHAU3LKQADX7Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490143429 (23h8m34.273483528s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mHkZ2yrJaVP3EbaU7YcSCzhcLHCJ58mcYYJpCamzs6oCBErfp): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490152586 (23h8m34.273492675s) [noise=true , address=212.102.52.217:4427 , piece_id=ZVLQL24QPYRYWCQDDAAGVGFEKVR4FA5G53GIEXEGQQG6W7BVSKYA, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490170020 (23h8m34.273510119s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490179918 (23h8m34.273520007s) [noise=true , address=212.102.52.215:4384 , piece_id=RC6TOKKFEFJ7GBTIXORK2MLCEGANBHQLOWATVXZCYS2O2DRFWL2Q, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490253409 (23h8m34.273593498s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16niLmCkzYrrqsg6P7QNtpwXobbL79UjWi1YnHyKBPwZSQq3QW): protocol: expected piece hash; context canceled; EOF May 26 01:12:48.490259701 (23h8m34.27359979s) [noise=true , address=212.102.52.217:4421 , piece_id=SFZ7DIZBRHIZOENPETPPHGIJFBCLZL74BDWY7D4EZNYSABUKUIMQ, seg_pos={0 0}, upload=22129]: Long tail cancellation due to optimal threshold May 26 01:12:48.490279890 (23h8m34.273619989s) [seg_pos={0 0}, upload=22129]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 01:12:48.490334683 (23h8m34.273674782s) [upload=22129]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 01:12:48.490339794 (23h8m34.273679893s) [upload=22129]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 01:12:57.535364419 (23h8m43.318704518s) [upload=22129]: Done uploading segments... May 26 01:12:57.535408573 (23h8m43.318748672s) [upload=22129]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.069148861s core uplink uk-select-1 uk1-placement-17

Orbiter Check History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)